2024-09-13T16:30:17.644 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T16:30:17.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T16:30:17.768 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829 branch: wip-rishabh-testing-20240910.095512-reef description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} email: null first_in_suite: false job_id: '7903829' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.095512-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 50bbe7f395997dcd871813949c49addbbf630361 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 50bbe7f395997dcd871813949c49addbbf630361 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.095512-reef sha1: 50bbe7f395997dcd871813949c49addbbf630361 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1152 sha1: 50bbe7f395997dcd871813949c49addbbf630361 sleep_before_teardown: 0 subset: 984/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.095512-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50bbe7f395997dcd871813949c49addbbf630361 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJiI4c24kdZiyrDpne9Sqv4RAyYbZuCchowkR2DAl/chM3lp4ksNSdvza9HZEC0OSpXXPmyTzM71m6160u6+gic= smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUfyJG6PnAsQPOl4WK/aPczyt/XvDCv6pB9ZsX8XNY3wwmQdB9XDZRFzRlhw+rWfYLVkQnOwfL7Od02m26eeLE= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG+ojbnYm+u31e+eS+yxzBxEhms0tEciXTVw06+2OfyWIQsVGdJEgJrTu9lI4sAi4wC87Kl/BugK1KRpyDZrQfA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:36:41 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T16:30:17.769 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa; will attempt to use it 2024-09-13T16:30:17.769 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa/tasks 2024-09-13T16:30:17.770 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T16:30:17.771 INFO:teuthology.task.internal:Checking packages... 2024-09-13T16:30:17.793 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '50bbe7f395997dcd871813949c49addbbf630361' 2024-09-13T16:30:17.793 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T16:30:17.793 INFO:teuthology.packaging:ref: None 2024-09-13T16:30:17.793 INFO:teuthology.packaging:tag: None 2024-09-13T16:30:17.793 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.095512-reef 2024-09-13T16:30:17.794 INFO:teuthology.packaging:sha1: 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:30:17.794 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.095512-reef 2024-09-13T16:30:17.936 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-850.g50bbe7f3 2024-09-13T16:30:17.938 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T16:30:17.944 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T16:30:17.944 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T16:30:17.959 INFO:teuthology.task.internal:Saving configuration 2024-09-13T16:30:17.979 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T16:30:17.985 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T16:30:18.018 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:25:24.271255', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJiI4c24kdZiyrDpne9Sqv4RAyYbZuCchowkR2DAl/chM3lp4ksNSdvza9HZEC0OSpXXPmyTzM71m6160u6+gic='} 2024-09-13T16:30:18.052 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:25:24.269843', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUfyJG6PnAsQPOl4WK/aPczyt/XvDCv6pB9ZsX8XNY3wwmQdB9XDZRFzRlhw+rWfYLVkQnOwfL7Od02m26eeLE='} 2024-09-13T16:30:18.086 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:25:24.268186', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG+ojbnYm+u31e+eS+yxzBxEhms0tEciXTVw06+2OfyWIQsVGdJEgJrTu9lI4sAi4wC87Kl/BugK1KRpyDZrQfA='} 2024-09-13T16:30:18.086 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T16:30:18.092 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-13T16:30:18.092 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-13T16:30:18.093 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-13T16:30:18.093 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T16:30:18.207 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9a2430bbe0>, signals=[15]) 2024-09-13T16:30:18.207 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T16:30:18.213 INFO:teuthology.task.internal:Opening connections... 2024-09-13T16:30:18.213 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T16:30:18.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:30:18.300 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T16:30:18.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:30:18.382 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T16:30:18.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:30:18.466 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T16:30:18.471 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-13T16:30:18.490 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-13T16:30:18.490 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-13T16:30:18.548 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-09-13T16:30:18.548 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-09-13T16:30:18.548 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T16:30:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T16:30:18.550 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-13T16:30:18.581 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-09-13T16:30:18.600 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-09-13T16:30:18.600 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-09-13T16:30:18.658 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T16:30:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T16:30:18.660 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T16:30:18.660 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-09-13T16:30:18.689 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-09-13T16:30:18.707 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-09-13T16:30:18.707 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-09-13T16:30:18.765 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-09-13T16:30:18.765 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T16:30:18.766 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T16:30:18.767 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-09-13T16:30:18.797 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T16:30:18.807 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T16:30:18.813 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T16:30:18.813 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-13T16:30:18.816 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-09-13T16:30:18.818 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-09-13T16:30:18.834 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T16:30:18.841 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T16:30:18.842 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-13T16:30:18.872 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-09-13T16:30:18.875 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-09-13T16:30:18.967 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T16:30:19.071 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T16:30:19.086 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T16:30:19.086 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-13T16:30:19.086 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-13T16:30:19.086 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T16:30:19.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:30:19.104 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T16:30:19.276 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T16:30:19.276 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T16:30:19.277 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-13T16:30:19.295 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-503.el9.x86_64 2024-09-13T16:30:19.296 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T16:30:19.296 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T16:30:19.297 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum upgrade -y linux-firmware 2024-09-13T16:30:24.086 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.2 MB 00:03 2024-09-13T16:30:42.652 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-13T16:30:48.860 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.5 MB 00:02 2024-09-13T16:30:50.527 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-13T16:30:51.914 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-13T16:30:57.454 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T16:30:59.625 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-13T16:30:59.627 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-13T16:30:59.627 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-13T16:30:59.729 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T16:30:59.729 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T16:30:59.884 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T16:30:59.885 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T16:30:59.887 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi018.front.sepia.ceph.com to complete... 2024-09-13T16:31:06.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13 16:31:06 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T16:31:06.265 INFO:teuthology.orchestra.run.smithi018.stderr:FINISHED --2024-09-13 16:31:06-- 2024-09-13T16:31:06.265 INFO:teuthology.orchestra.run.smithi018.stderr:Total wall clock time: 6.4s 2024-09-13T16:31:06.265 INFO:teuthology.orchestra.run.smithi018.stderr:Downloaded: 1 files, 343M in 6.1s (56.5 MB/s) 2024-09-13T16:31:06.268 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T16:31:06.268 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T16:31:08.476 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying... ######################################## 2024-09-13T16:31:08.616 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing... ######################################## 2024-09-13T16:31:08.735 INFO:teuthology.orchestra.run.smithi018.stdout:Updating / installing... 2024-09-13T16:31:17.191 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T16:31:57.376 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T16:31:57.377 DEBUG:teuthology.orchestra.run.smithi018:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T16:31:57.467 INFO:teuthology.orchestra.run.smithi018.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:31:57.467 INFO:teuthology.orchestra.run.smithi018.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:31:57.467 INFO:teuthology.orchestra.run.smithi018.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:31:57.467 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T16:31:57.468 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T16:31:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T16:31:57.470 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T16:31:57.471 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T16:31:57.472 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T16:31:57.473 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T16:31:57.473 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T16:31:57.473 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T16:31:57.473 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T16:31:57.473 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T16:31:57.473 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T16:31:57.473 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T16:31:57.473 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T16:31:57.473 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T16:31:57.473 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T16:31:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T16:31:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T16:31:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T16:31:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T16:31:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T16:31:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T16:31:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T16:31:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T16:31:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T16:31:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T16:31:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T16:31:57.476 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T16:31:57.477 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T16:31:57.478 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T16:31:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T16:31:57.480 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T16:31:57.481 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T16:31:57.482 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T16:31:57.483 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T16:31:57.484 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T16:31:57.485 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T16:31:57.486 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T16:31:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T16:31:57.488 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T16:31:57.489 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T16:31:57.490 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T16:31:57.491 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T16:31:57.492 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T16:31:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T16:31:57.494 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T16:31:57.495 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T16:31:57.496 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T16:31:57.497 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T16:31:57.498 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T16:31:57.499 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T16:31:57.500 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T16:31:57.501 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T16:31:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T16:31:57.503 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T16:31:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T16:31:57.505 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T16:31:57.506 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T16:31:57.507 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T16:31:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T16:31:57.509 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T16:31:57.510 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T16:31:57.511 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T16:31:57.512 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T16:31:57.513 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T16:31:57.514 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T16:31:57.515 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T16:31:57.516 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T16:31:57.517 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T16:31:57.518 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T16:31:57.519 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T16:31:57.520 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T16:31:57.521 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T16:31:57.522 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T16:31:57.523 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T16:31:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T16:31:57.525 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T16:31:57.526 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T16:31:57.527 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T16:31:57.528 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T16:31:57.529 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T16:31:57.530 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T16:31:57.531 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T16:31:57.532 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T16:31:57.533 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T16:31:57.534 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T16:31:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T16:31:57.536 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T16:31:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T16:31:57.538 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T16:31:57.539 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T16:31:57.540 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T16:31:57.541 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T16:31:57.542 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T16:31:57.543 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T16:31:57.544 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T16:31:57.545 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T16:31:57.546 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T16:31:57.547 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T16:31:57.548 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T16:31:57.549 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T16:31:57.550 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T16:31:57.551 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T16:31:57.552 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T16:31:57.553 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T16:31:57.554 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T16:31:57.555 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T16:31:57.555 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T16:31:57.555 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T16:31:57.555 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T16:31:57.555 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T16:31:57.555 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T16:31:57.555 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T16:31:57.555 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T16:31:57.555 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T16:31:57.555 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T16:31:57.556 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T16:31:57.557 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T16:31:57.558 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T16:31:57.559 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T16:31:57.560 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T16:31:57.561 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T16:31:57.562 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T16:31:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T16:31:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T16:31:57.565 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T16:31:57.566 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T16:31:57.567 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T16:31:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T16:31:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T16:31:57.570 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T16:31:57.572 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T16:31:57.572 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T16:31:57.572 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T16:31:57.572 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T16:31:57.572 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T16:31:57.572 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T16:31:57.572 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T16:31:57.572 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T16:31:57.572 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T16:31:57.572 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T16:31:57.573 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T16:31:57.574 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T16:31:57.574 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T16:31:57.574 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T16:31:57.574 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T16:31:57.574 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T16:31:57.574 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T16:31:57.574 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T16:31:57.574 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T16:31:57.574 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T16:31:57.574 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T16:31:57.575 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T16:31:57.576 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T16:31:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T16:31:57.578 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T16:31:57.579 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T16:31:57.580 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T16:31:57.581 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T16:31:57.582 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T16:31:57.583 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T16:31:57.584 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T16:31:57.585 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T16:31:57.586 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T16:31:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T16:31:57.588 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T16:31:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T16:31:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T16:31:57.591 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T16:31:57.592 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T16:31:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T16:31:57.594 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T16:31:57.595 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T16:31:57.596 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T16:31:57.597 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T16:31:57.598 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T16:31:57.599 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T16:31:57.600 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T16:31:57.601 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T16:31:57.602 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T16:31:57.603 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T16:31:57.604 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T16:31:57.605 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T16:31:57.606 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T16:31:57.607 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T16:31:57.608 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T16:31:57.609 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T16:31:57.610 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T16:31:57.611 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T16:31:57.612 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T16:31:57.613 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T16:31:57.617 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:31:57.617 DEBUG:teuthology.orchestra.run.smithi018:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T16:31:57.641 INFO:teuthology.orchestra.run.smithi018.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T16:31:57.641 INFO:teuthology.orchestra.run.smithi018.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T16:31:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout:for file in vmlinuz System.map config; do 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: fi 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout:done 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T16:31:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:31:57.643 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-09-13T16:31:57.643 INFO:teuthology.orchestra.run.smithi018.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T16:31:57.643 INFO:teuthology.orchestra.run.smithi018.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T16:31:57.643 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:31:57.643 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-09-13T16:31:57.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-09-13T16:31:57.719 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-09-13T16:31:57.719 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-09-13T16:31:57.719 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-09-13T16:31:57.719 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 82.el9 2024-09-13T16:31:57.719 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-09-13T16:31:57.719 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T16:31:57.719 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-09-13T16:31:57.719 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8274670 2024-09-13T16:31:57.719 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T16:31:57.720 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T16:31:57.721 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-09-13T16:31:57.721 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:31:57.721 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T16:31:57.722 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T16:31:57.722 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:31:57.722 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T16:31:58.330 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-09-13T16:31:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T16:31:59.761 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-09-13T16:31:59.763 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-13T16:31:59.778 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.I7akpTPD8r 2024-09-13T16:31:59.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.I7akpTPD8r 2024-09-13T16:31:59.854 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.I7akpTPD8r 2024-09-13T16:31:59.999 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.I7akpTPD8r is 6KB 2024-09-13T16:32:00.047 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.I7akpTPD8r 2024-09-13T16:32:00.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T16:32:00.144 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T16:32:00.144 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T16:32:00.145 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T16:32:00.145 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T16:32:00.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:32:00.283 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-09-13T16:32:30.287 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T16:32:30.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T16:32:30.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:33:30.299 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T16:33:39.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T16:33:39.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:33:42.879 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-13T16:33:43.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T16:33:43.441 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T16:33:43.441 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-13T16:33:43.475 INFO:teuthology.orchestra.run.smithi018.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:33:43.475 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T16:33:43.475 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T16:33:43.475 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T16:33:44.478 DEBUG:teuthology.parallel:result is None 2024-09-13T16:33:44.478 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T16:33:44.486 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T16:33:44.486 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T16:33:44.490 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T16:33:44.493 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T16:33:44.521 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T16:33:44.528 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T16:33:44.575 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T16:33:44.576 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T16:33:44.579 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T16:33:44.582 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T16:33:44.693 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T16:33:44.699 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T16:33:44.700 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T16:33:44.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:33:44.717 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T16:33:44.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:33:44.734 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T16:33:44.738 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T16:33:44.761 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T16:33:44.823 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:33:44.839 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:33:44.841 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:33:44.858 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:33:44.888 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:33:44.969 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:33:44.973 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T16:33:44.981 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T16:33:44.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T16:33:44.985 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T16:33:44.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T16:33:45.040 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T16:33:45.049 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T16:33:45.049 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T16:33:45.053 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T16:33:45.058 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T16:33:45.084 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:33:45.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:33:45.270 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:33:45.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:33:45.406 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:33:45.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T16:33:45.481 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:33:45.536 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:33:45.580 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:33:45.673 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:33:45.708 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:33:45.708 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T16:33:45.775 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:33:45.828 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:33:45.877 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:33:45.970 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:33:46.005 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:33:46.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T16:33:46.073 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-13T16:33:46.077 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-09-13T16:33:46.079 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-09-13T16:33:46.118 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:33:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:33:46.162 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:33:46.554 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T16:33:46.561 INFO:teuthology.task.internal:Starting timer... 2024-09-13T16:33:46.561 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T16:33:46.591 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T16:33:46.610 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-13T16:33:46.610 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-09-13T16:33:46.684 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-09-13T16:33:46.688 DEBUG:teuthology.orchestra.run.smithi094:> sudo service auditd rotate 2024-09-13T16:33:46.756 INFO:teuthology.orchestra.run.smithi094.stdout:Rotating logs: 2024-09-13T16:33:46.758 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2024-09-13T16:33:46.810 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2024-09-13T16:33:46.812 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T16:33:46.812 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-09-13T16:33:46.851 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-09-13T16:33:46.852 DEBUG:teuthology.orchestra.run.smithi094:> /usr/sbin/getenforce 2024-09-13T16:33:46.876 INFO:teuthology.orchestra.run.smithi094.stdout:Permissive 2024-09-13T16:33:46.877 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2024-09-13T16:33:46.904 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2024-09-13T16:33:46.904 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi094.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2024-09-13T16:33:46.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:33:46.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:33:46.966 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:33:46.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:33:46.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:33:47.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:33:47.025 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T16:33:47.025 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-09-13T16:33:47.277 DEBUG:teuthology.orchestra.run.smithi094:> sudo /usr/sbin/setenforce permissive 2024-09-13T16:33:47.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2024-09-13T16:33:47.353 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T16:33:47.362 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T16:33:47.374 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T16:33:47.375 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi094.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T16:38:29.895 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2024-09-13T16:38:29.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T16:38:29.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:38:30.033 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-13T16:38:30.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T16:38:30.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-13T16:38:30.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:38:30.234 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-13T16:38:30.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-13T16:38:30.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-13T16:38:30.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:38:30.447 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-13T16:38:30.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-13T16:38:30.535 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T16:38:30.547 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T16:38:30.548 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T16:38:30.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:38:30.552 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T16:38:30.552 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:38:30.555 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T16:38:30.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:38:30.585 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T16:38:30.600 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T16:38:30.606 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T16:38:30.611 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T16:38:30.622 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T16:38:30.625 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: ntpd: command not found 2024-09-13T16:38:30.637 INFO:teuthology.orchestra.run.smithi094.stdout:506 Cannot talk to daemon 2024-09-13T16:38:30.641 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T16:38:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2024-09-13T16:38:30.652 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T16:38:30.658 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2024-09-13T16:38:30.666 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T16:38:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T16:38:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T16:38:30.693 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-09-13T16:38:30.717 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-09-13T16:38:30.721 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:38:30.725 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:38:30.725 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-09-13T16:38:30.725 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.725 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.725 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.725 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:38:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T16:38:30.747 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:38:30.747 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-13T16:38:30.747 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.748 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.748 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.748 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T16:38:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:38:30.875 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:38:30.875 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-13T16:38:30.875 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.876 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.876 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.876 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:38:30.877 INFO:teuthology.run_tasks:Running task install... 2024-09-13T16:38:30.885 DEBUG:teuthology.task.install:project ceph 2024-09-13T16:38:30.885 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}} 2024-09-13T16:38:30.885 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'} 2024-09-13T16:38:30.885 INFO:teuthology.task.install:Using flavor: default 2024-09-13T16:38:30.897 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T16:38:30.897 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T16:38:30.898 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T16:38:30.898 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:38:30.901 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T16:38:30.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:38:30.902 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T16:38:30.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:38:31.063 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T16:38:31.063 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T16:38:31.075 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T16:38:31.076 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T16:38:31.091 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T16:38:31.091 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T16:38:31.190 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T16:38:31.190 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:38:31.190 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T16:38:31.199 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T16:38:31.199 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:38:31.199 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T16:38:31.216 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T16:38:31.217 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:38:31.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T16:38:31.225 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T16:38:31.226 DEBUG:teuthology.orchestra.run.smithi094:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T16:38:31.243 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T16:38:31.244 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T16:38:31.247 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T16:38:31.247 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T16:38:31.295 DEBUG:teuthology.orchestra.run.smithi094:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T16:38:31.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T16:38:31.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T16:38:31.371 DEBUG:teuthology.orchestra.run.smithi094:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T16:38:31.386 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T16:38:31.424 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T16:38:31.435 INFO:teuthology.orchestra.run.smithi094.stdout:check_obsoletes = 1 2024-09-13T16:38:31.437 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum clean all 2024-09-13T16:38:31.450 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2024-09-13T16:38:31.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2024-09-13T16:38:31.480 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-09-13T16:38:31.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-09-13T16:38:31.660 INFO:teuthology.orchestra.run.smithi094.stdout:45 files removed 2024-09-13T16:38:31.675 INFO:teuthology.orchestra.run.smithi144.stdout:45 files removed 2024-09-13T16:38:31.686 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T16:38:31.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T16:38:31.769 INFO:teuthology.orchestra.run.smithi018.stdout:45 files removed 2024-09-13T16:38:31.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T16:38:32.289 INFO:teuthology.orchestra.run.smithi094.stdout:ceph packages for x86_64 237 kB/s | 77 kB 00:00 2024-09-13T16:38:32.291 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 249 kB/s | 77 kB 00:00 2024-09-13T16:38:32.527 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 242 kB/s | 77 kB 00:00 2024-09-13T16:38:32.565 INFO:teuthology.orchestra.run.smithi094.stdout:ceph noarch packages 49 kB/s | 11 kB 00:00 2024-09-13T16:38:32.583 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-13T16:38:32.828 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-13T16:38:32.832 INFO:teuthology.orchestra.run.smithi094.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-13T16:38:32.867 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-13T16:38:33.135 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 7.0 kB/s | 1.9 kB 00:00 2024-09-13T16:38:34.474 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-09-13T16:38:34.850 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-09-13T16:38:35.087 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-13T16:38:36.142 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-13T16:38:36.893 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-13T16:38:37.013 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-13T16:38:40.401 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-13T16:38:41.902 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-13T16:38:42.577 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-13T16:38:42.964 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-13T16:38:43.214 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-13T16:38:44.806 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-13T16:38:45.078 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 19 kB 00:01 2024-09-13T16:38:46.494 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-13T16:38:46.590 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-13T16:38:48.421 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-13T16:38:50.739 INFO:teuthology.orchestra.run.smithi094.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T16:38:50.740 INFO:teuthology.orchestra.run.smithi094.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T16:38:50.750 INFO:teuthology.orchestra.run.smithi094.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T16:38:50.751 INFO:teuthology.orchestra.run.smithi094.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T16:38:50.752 INFO:teuthology.orchestra.run.smithi094.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T16:38:50.753 INFO:teuthology.orchestra.run.smithi094.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T16:38:50.754 INFO:teuthology.orchestra.run.smithi094.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T16:38:50.756 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T16:38:50.757 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T16:38:50.816 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-09-13T16:38:50.836 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================== 2024-09-13T16:38:50.836 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-09-13T16:38:50.836 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================== 2024-09-13T16:38:50.837 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-09-13T16:38:50.837 INFO:teuthology.orchestra.run.smithi094.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T16:38:50.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T16:38:50.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T16:38:50.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T16:38:50.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T16:38:50.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T16:38:50.838 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T16:38:50.839 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T16:38:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T16:38:50.841 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T16:38:50.841 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T16:38:50.841 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T16:38:50.841 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T16:38:50.841 INFO:teuthology.orchestra.run.smithi094.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T16:38:50.841 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T16:38:50.841 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-09-13T16:38:50.842 INFO:teuthology.orchestra.run.smithi094.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T16:38:50.842 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T16:38:50.842 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T16:38:50.842 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T16:38:50.842 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T16:38:50.842 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T16:38:50.843 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T16:38:50.843 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T16:38:50.843 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T16:38:50.843 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T16:38:50.843 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T16:38:50.844 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T16:38:50.844 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T16:38:50.844 INFO:teuthology.orchestra.run.smithi094.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T16:38:50.844 INFO:teuthology.orchestra.run.smithi094.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T16:38:50.844 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T16:38:50.844 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T16:38:50.845 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T16:38:50.845 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T16:38:50.845 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T16:38:50.845 INFO:teuthology.orchestra.run.smithi094.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T16:38:50.845 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T16:38:50.845 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T16:38:50.846 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T16:38:50.846 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T16:38:50.846 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T16:38:50.846 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T16:38:50.847 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T16:38:50.847 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T16:38:50.847 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T16:38:50.847 INFO:teuthology.orchestra.run.smithi094.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T16:38:50.847 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T16:38:50.848 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T16:38:50.848 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T16:38:50.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T16:38:50.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T16:38:50.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T16:38:50.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T16:38:50.849 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T16:38:50.849 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T16:38:50.849 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T16:38:50.852 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T16:38:50.853 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T16:38:50.853 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T16:38:50.853 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T16:38:50.853 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T16:38:50.853 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T16:38:50.854 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T16:38:50.854 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T16:38:50.854 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T16:38:50.854 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T16:38:50.854 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T16:38:50.854 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T16:38:50.855 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T16:38:50.855 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T16:38:50.855 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T16:38:50.855 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T16:38:50.855 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T16:38:50.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T16:38:50.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T16:38:50.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T16:38:50.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T16:38:50.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T16:38:50.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T16:38:50.857 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T16:38:50.857 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T16:38:50.857 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T16:38:50.857 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T16:38:50.857 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T16:38:50.858 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T16:38:50.858 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T16:38:50.858 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T16:38:50.858 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T16:38:50.858 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T16:38:50.858 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T16:38:50.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T16:38:50.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T16:38:50.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T16:38:50.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T16:38:50.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T16:38:50.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T16:38:50.860 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T16:38:50.860 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T16:38:50.860 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T16:38:50.860 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T16:38:50.860 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T16:38:50.861 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T16:38:50.861 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T16:38:50.861 INFO:teuthology.orchestra.run.smithi094.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T16:38:50.861 INFO:teuthology.orchestra.run.smithi094.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T16:38:50.861 INFO:teuthology.orchestra.run.smithi094.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T16:38:50.861 INFO:teuthology.orchestra.run.smithi094.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T16:38:50.862 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T16:38:50.862 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T16:38:50.862 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:38:50.862 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-09-13T16:38:50.862 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================== 2024-09-13T16:38:50.863 INFO:teuthology.orchestra.run.smithi094.stdout:Install 130 Packages 2024-09-13T16:38:50.863 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 8 Packages 2024-09-13T16:38:50.863 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:38:50.864 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 203 M 2024-09-13T16:38:50.864 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-09-13T16:38:51.156 INFO:teuthology.orchestra.run.smithi094.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 42 kB/s | 6.5 kB 00:00 2024-09-13T16:38:51.456 INFO:teuthology.orchestra.run.smithi094.stdout:(2/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 11 MB/s | 5.1 MB 00:00 2024-09-13T16:38:51.489 INFO:teuthology.orchestra.run.smithi094.stdout:(3/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 2.5 MB/s | 852 kB 00:00 2024-09-13T16:38:51.515 INFO:teuthology.orchestra.run.smithi094.stdout:(4/138): ceph-immutable-object-cache-18.2.4-850 2.4 MB/s | 143 kB 00:00 2024-09-13T16:38:51.607 INFO:teuthology.orchestra.run.smithi094.stdout:(5/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 16 MB/s | 1.5 MB 00:00 2024-09-13T16:38:51.874 INFO:teuthology.orchestra.run.smithi094.stdout:(6/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-13T16:38:51.924 INFO:teuthology.orchestra.run.smithi094.stdout:(7/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 4.8 MB/s | 2.1 MB 00:00 2024-09-13T16:38:52.071 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-13T16:38:52.249 INFO:teuthology.orchestra.run.smithi094.stdout:(8/138): ceph-common-18.2.4-850.g50bbe7f3.el9.x 15 MB/s | 18 MB 00:01 2024-09-13T16:38:52.300 INFO:teuthology.orchestra.run.smithi094.stdout:(9/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9. 505 kB/s | 25 kB 00:00 2024-09-13T16:38:52.842 INFO:teuthology.orchestra.run.smithi094.stdout:(10/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86 17 MB/s | 17 MB 00:00 2024-09-13T16:38:52.950 INFO:teuthology.orchestra.run.smithi094.stdout:(11/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9 7.6 MB/s | 7.8 MB 00:01 2024-09-13T16:38:52.984 INFO:teuthology.orchestra.run.smithi094.stdout:(12/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 1.5 MB/s | 224 kB 00:00 2024-09-13T16:38:53.009 INFO:teuthology.orchestra.run.smithi094.stdout:(13/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 531 kB/s | 31 kB 00:00 2024-09-13T16:38:53.043 INFO:teuthology.orchestra.run.smithi094.stdout:(14/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 12 MB/s | 712 kB 00:00 2024-09-13T16:38:53.058 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-13T16:38:53.068 INFO:teuthology.orchestra.run.smithi094.stdout:(15/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 2.8 MB/s | 166 kB 00:00 2024-09-13T16:38:53.093 INFO:teuthology.orchestra.run.smithi094.stdout:(16/138): librados-devel-18.2.4-850.g50bbe7f3.e 2.5 MB/s | 127 kB 00:00 2024-09-13T16:38:53.119 INFO:teuthology.orchestra.run.smithi094.stdout:(17/138): libradosstriper1-18.2.4-850.g50bbe7f3 9.3 MB/s | 477 kB 00:00 2024-09-13T16:38:53.169 INFO:teuthology.orchestra.run.smithi094.stdout:(18/138): python3-ceph-argparse-18.2.4-850.g50b 902 kB/s | 45 kB 00:00 2024-09-13T16:38:53.253 INFO:teuthology.orchestra.run.smithi094.stdout:(19/138): python3-ceph-common-18.2.4-850.g50bbe 1.5 MB/s | 129 kB 00:00 2024-09-13T16:38:53.328 INFO:teuthology.orchestra.run.smithi094.stdout:(20/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 19 MB/s | 4.5 MB 00:00 2024-09-13T16:38:53.362 INFO:teuthology.orchestra.run.smithi094.stdout:(21/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 1.5 MB/s | 162 kB 00:00 2024-09-13T16:38:53.387 INFO:teuthology.orchestra.run.smithi094.stdout:(22/138): python3-rados-18.2.4-850.g50bbe7f3.el 5.3 MB/s | 319 kB 00:00 2024-09-13T16:38:53.412 INFO:teuthology.orchestra.run.smithi094.stdout:(23/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 5.8 MB/s | 301 kB 00:00 2024-09-13T16:38:53.438 INFO:teuthology.orchestra.run.smithi094.stdout:(24/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T16:38:53.463 INFO:teuthology.orchestra.run.smithi094.stdout:(25/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T16:38:53.517 INFO:teuthology.orchestra.run.smithi094.stdout:(26/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 3.1 MB/s | 172 kB 00:00 2024-09-13T16:38:53.592 INFO:teuthology.orchestra.run.smithi094.stdout:(27/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 19 MB/s | 3.0 MB 00:00 2024-09-13T16:38:53.618 INFO:teuthology.orchestra.run.smithi094.stdout:(28/138): ceph-grafana-dashboards-18.2.4-850.g5 243 kB/s | 24 kB 00:00 2024-09-13T16:38:53.643 INFO:teuthology.orchestra.run.smithi094.stdout:(29/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 2.7 MB/s | 139 kB 00:00 2024-09-13T16:38:54.294 INFO:teuthology.orchestra.run.smithi094.stdout:(30/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 20 MB/s | 40 MB 00:01 2024-09-13T16:38:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T16:38:54.349 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T16:38:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T16:38:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T16:38:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T16:38:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T16:38:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T16:38:54.366 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T16:38:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T16:38:54.385 INFO:teuthology.orchestra.run.smithi094.stdout:(31/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 4.6 MB/s | 3.5 MB 00:00 2024-09-13T16:38:54.410 INFO:teuthology.orchestra.run.smithi094.stdout:(32/138): ceph-mgr-modules-core-18.2.4-850.g50b 2.1 MB/s | 246 kB 00:00 2024-09-13T16:38:54.428 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-13T16:38:54.436 INFO:teuthology.orchestra.run.smithi094.stdout:(33/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 985 kB/s | 49 kB 00:00 2024-09-13T16:38:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================== 2024-09-13T16:38:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-13T16:38:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================== 2024-09-13T16:38:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-13T16:38:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T16:38:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T16:38:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T16:38:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T16:38:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T16:38:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T16:38:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T16:38:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T16:38:54.449 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T16:38:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T16:38:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T16:38:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T16:38:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T16:38:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T16:38:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T16:38:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T16:38:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T16:38:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T16:38:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T16:38:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T16:38:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================== 2024-09-13T16:38:54.457 INFO:teuthology.orchestra.run.smithi144.stdout:Install 130 Packages 2024-09-13T16:38:54.458 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 8 Packages 2024-09-13T16:38:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:38:54.458 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 203 M 2024-09-13T16:38:54.458 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-13T16:38:54.461 INFO:teuthology.orchestra.run.smithi094.stdout:(34/138): ceph-prometheus-alerts-18.2.4-850.g50 327 kB/s | 16 kB 00:00 2024-09-13T16:38:54.562 INFO:teuthology.orchestra.run.smithi094.stdout:(35/138): ceph-mgr-diskprediction-local-18.2.4- 8.1 MB/s | 7.4 MB 00:00 2024-09-13T16:38:54.587 INFO:teuthology.orchestra.run.smithi094.stdout:(36/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 1.7 MB/s | 264 kB 00:00 2024-09-13T16:38:54.612 INFO:teuthology.orchestra.run.smithi094.stdout:(37/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 362 kB/s | 18 kB 00:00 2024-09-13T16:38:54.637 INFO:teuthology.orchestra.run.smithi094.stdout:(38/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 1.3 MB/s | 226 kB 00:00 2024-09-13T16:38:54.788 INFO:teuthology.orchestra.run.smithi094.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 398 kB/s | 80 kB 00:00 2024-09-13T16:38:54.838 INFO:teuthology.orchestra.run.smithi094.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 954 kB/s | 191 kB 00:00 2024-09-13T16:38:54.922 INFO:teuthology.orchestra.run.smithi094.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-13T16:38:54.947 INFO:teuthology.orchestra.run.smithi094.stdout:(42/138): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-13T16:38:54.997 INFO:teuthology.orchestra.run.smithi144.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-13T16:38:54.997 INFO:teuthology.orchestra.run.smithi094.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-13T16:38:55.023 INFO:teuthology.orchestra.run.smithi094.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-13T16:38:55.065 INFO:teuthology.orchestra.run.smithi094.stdout:(45/138): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-09-13T16:38:55.090 INFO:teuthology.orchestra.run.smithi094.stdout:(46/138): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-13T16:38:55.115 INFO:teuthology.orchestra.run.smithi094.stdout:(47/138): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-13T16:38:55.149 INFO:teuthology.orchestra.run.smithi094.stdout:(48/138): automake-1.16.2-8.el9.noarch.rpm 8.0 MB/s | 689 kB 00:00 2024-09-13T16:38:55.191 INFO:teuthology.orchestra.run.smithi094.stdout:(49/138): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-13T16:38:55.216 INFO:teuthology.orchestra.run.smithi094.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-13T16:38:55.247 INFO:teuthology.orchestra.run.smithi144.stdout:(2/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 3.3 MB/s | 852 kB 00:00 2024-09-13T16:38:55.258 INFO:teuthology.orchestra.run.smithi094.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 943 kB 00:00 2024-09-13T16:38:55.283 INFO:teuthology.orchestra.run.smithi094.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-13T16:38:55.318 INFO:teuthology.orchestra.run.smithi094.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-13T16:38:55.331 INFO:teuthology.orchestra.run.smithi144.stdout:(3/138): ceph-immutable-object-cache-18.2.4-850 1.7 MB/s | 143 kB 00:00 2024-09-13T16:38:55.342 INFO:teuthology.orchestra.run.smithi094.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-13T16:38:55.376 INFO:teuthology.orchestra.run.smithi094.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-13T16:38:55.401 INFO:teuthology.orchestra.run.smithi094.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-13T16:38:55.435 INFO:teuthology.orchestra.run.smithi094.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-13T16:38:55.456 INFO:teuthology.orchestra.run.smithi144.stdout:(4/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 8.6 MB/s | 5.1 MB 00:00 2024-09-13T16:38:55.477 INFO:teuthology.orchestra.run.smithi094.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-13T16:38:55.544 INFO:teuthology.orchestra.run.smithi094.stdout:(59/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-09-13T16:38:55.569 INFO:teuthology.orchestra.run.smithi094.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 266 kB/s | 24 kB 00:00 2024-09-13T16:38:55.594 INFO:teuthology.orchestra.run.smithi094.stdout:(61/138): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-13T16:38:55.620 INFO:teuthology.orchestra.run.smithi094.stdout:(62/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-13T16:38:55.645 INFO:teuthology.orchestra.run.smithi094.stdout:(63/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-13T16:38:55.679 INFO:teuthology.orchestra.run.smithi094.stdout:(64/138): openblas-0.3.26-2.el9.x86_64.rpm 457 kB/s | 38 kB 00:00 2024-09-13T16:38:55.697 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T16:38:55.698 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T16:38:55.709 INFO:teuthology.orchestra.run.smithi018.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T16:38:55.710 INFO:teuthology.orchestra.run.smithi018.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T16:38:55.711 INFO:teuthology.orchestra.run.smithi018.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T16:38:55.712 INFO:teuthology.orchestra.run.smithi018.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T16:38:55.714 INFO:teuthology.orchestra.run.smithi018.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T16:38:55.716 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T16:38:55.717 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T16:38:55.723 INFO:teuthology.orchestra.run.smithi144.stdout:(5/138): ceph-common-18.2.4-850.g50bbe7f3.el9.x 21 MB/s | 18 MB 00:00 2024-09-13T16:38:55.765 INFO:teuthology.orchestra.run.smithi144.stdout:(6/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 4.7 MB/s | 1.5 MB 00:00 2024-09-13T16:38:55.783 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-13T16:38:55.795 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-13T16:38:55.795 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-13T16:38:55.795 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-13T16:38:55.795 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-13T16:38:55.795 INFO:teuthology.orchestra.run.smithi018.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T16:38:55.795 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T16:38:55.795 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T16:38:55.795 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T16:38:55.796 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T16:38:55.796 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T16:38:55.796 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T16:38:55.796 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T16:38:55.796 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T16:38:55.796 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T16:38:55.796 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T16:38:55.796 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T16:38:55.796 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T16:38:55.796 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T16:38:55.797 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T16:38:55.798 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T16:38:55.799 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T16:38:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T16:38:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T16:38:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T16:38:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T16:38:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T16:38:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T16:38:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T16:38:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T16:38:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T16:38:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T16:38:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T16:38:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T16:38:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T16:38:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T16:38:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T16:38:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T16:38:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T16:38:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T16:38:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T16:38:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T16:38:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T16:38:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T16:38:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T16:38:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout:Install 130 Packages 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 8 Packages 2024-09-13T16:38:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:38:55.808 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 203 M 2024-09-13T16:38:55.808 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-13T16:38:55.815 INFO:teuthology.orchestra.run.smithi144.stdout:(7/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 4.3 MB/s | 2.1 MB 00:00 2024-09-13T16:38:55.838 INFO:teuthology.orchestra.run.smithi094.stdout:(65/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-13T16:38:55.921 INFO:teuthology.orchestra.run.smithi094.stdout:(66/138): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-13T16:38:55.924 INFO:teuthology.orchestra.run.smithi144.stdout:(8/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 23 MB/s | 4.7 MB 00:00 2024-09-13T16:38:55.966 INFO:teuthology.orchestra.run.smithi144.stdout:(9/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9. 607 kB/s | 25 kB 00:00 2024-09-13T16:38:55.980 INFO:teuthology.orchestra.run.smithi094.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-13T16:38:56.039 INFO:teuthology.orchestra.run.smithi094.stdout:(68/138): openblas-openmp-0.3.26-2.el9.x86_64.r 12 MB/s | 4.9 MB 00:00 2024-09-13T16:38:56.080 INFO:teuthology.orchestra.run.smithi094.stdout:(69/138): postgresql-13.16-1.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-09-13T16:38:56.206 INFO:teuthology.orchestra.run.smithi094.stdout:(70/138): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-13T16:38:56.248 INFO:teuthology.orchestra.run.smithi094.stdout:(71/138): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-13T16:38:56.298 INFO:teuthology.orchestra.run.smithi094.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-13T16:38:56.323 INFO:teuthology.orchestra.run.smithi094.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-09-13T16:38:56.357 INFO:teuthology.orchestra.run.smithi094.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-13T16:38:56.416 INFO:teuthology.orchestra.run.smithi094.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-13T16:38:56.417 INFO:teuthology.orchestra.run.smithi018.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 18 kB/s | 6.5 kB 00:00 2024-09-13T16:38:56.449 INFO:teuthology.orchestra.run.smithi094.stdout:(76/138): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-13T16:38:56.525 INFO:teuthology.orchestra.run.smithi094.stdout:(77/138): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-13T16:38:56.583 INFO:teuthology.orchestra.run.smithi094.stdout:(78/138): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-13T16:38:56.591 INFO:teuthology.orchestra.run.smithi144.stdout:(10/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9 10 MB/s | 7.8 MB 00:00 2024-09-13T16:38:56.650 INFO:teuthology.orchestra.run.smithi144.stdout:(11/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 3.8 MB/s | 224 kB 00:00 2024-09-13T16:38:56.650 INFO:teuthology.orchestra.run.smithi094.stdout:(79/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-09-13T16:38:56.675 INFO:teuthology.orchestra.run.smithi094.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 841 kB/s | 77 kB 00:00 2024-09-13T16:38:56.701 INFO:teuthology.orchestra.run.smithi094.stdout:(81/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 996 kB/s | 250 kB 00:00 2024-09-13T16:38:56.718 INFO:teuthology.orchestra.run.smithi094.stdout:(82/138): python3-prettytable-0.7.2-27.el9.noar 627 kB/s | 42 kB 00:00 2024-09-13T16:38:56.743 INFO:teuthology.orchestra.run.smithi094.stdout:(83/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-13T16:38:56.750 INFO:teuthology.orchestra.run.smithi144.stdout:(12/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 311 kB/s | 31 kB 00:00 2024-09-13T16:38:56.768 INFO:teuthology.orchestra.run.smithi094.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T16:38:56.794 INFO:teuthology.orchestra.run.smithi094.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-13T16:38:56.818 INFO:teuthology.orchestra.run.smithi018.stdout:(2/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 2.1 MB/s | 852 kB 00:00 2024-09-13T16:38:56.850 INFO:teuthology.orchestra.run.smithi144.stdout:(13/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 7.0 MB/s | 712 kB 00:00 2024-09-13T16:38:56.852 INFO:teuthology.orchestra.run.smithi094.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-13T16:38:56.919 INFO:teuthology.orchestra.run.smithi018.stdout:(3/138): ceph-immutable-object-cache-18.2.4-850 1.4 MB/s | 143 kB 00:00 2024-09-13T16:38:56.920 INFO:teuthology.orchestra.run.smithi094.stdout:(87/138): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-13T16:38:56.934 INFO:teuthology.orchestra.run.smithi144.stdout:(14/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 2.0 MB/s | 166 kB 00:00 2024-09-13T16:38:56.953 INFO:teuthology.orchestra.run.smithi094.stdout:(88/138): python3-pyasn1-modules-0.4.8-6.el9.no 1.1 MB/s | 279 kB 00:00 2024-09-13T16:38:56.978 INFO:teuthology.orchestra.run.smithi094.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-09-13T16:38:57.025 INFO:teuthology.orchestra.run.smithi144.stdout:(15/138): librados-devel-18.2.4-850.g50bbe7f3.e 1.3 MB/s | 127 kB 00:00 2024-09-13T16:38:57.028 INFO:teuthology.orchestra.run.smithi094.stdout:(90/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T16:38:57.053 INFO:teuthology.orchestra.run.smithi094.stdout:(91/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 949 kB/s | 96 kB 00:00 2024-09-13T16:38:57.079 INFO:teuthology.orchestra.run.smithi094.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 883 kB/s | 45 kB 00:00 2024-09-13T16:38:57.110 INFO:teuthology.orchestra.run.smithi018.stdout:(4/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 4.8 MB/s | 5.1 MB 00:01 2024-09-13T16:38:57.121 INFO:teuthology.orchestra.run.smithi094.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2024-09-13T16:38:57.126 INFO:teuthology.orchestra.run.smithi144.stdout:(16/138): libradosstriper1-18.2.4-850.g50bbe7f3 4.7 MB/s | 477 kB 00:00 2024-09-13T16:38:57.269 INFO:teuthology.orchestra.run.smithi018.stdout:(5/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 9.2 MB/s | 1.5 MB 00:00 2024-09-13T16:38:57.288 INFO:teuthology.orchestra.run.smithi094.stdout:(94/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-13T16:38:57.338 INFO:teuthology.orchestra.run.smithi094.stdout:(95/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 1.2 MB/s | 308 kB 00:00 2024-09-13T16:38:57.343 INFO:teuthology.orchestra.run.smithi144.stdout:(17/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86 10 MB/s | 17 MB 00:01 2024-09-13T16:38:57.363 INFO:teuthology.orchestra.run.smithi094.stdout:(96/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-09-13T16:38:57.369 INFO:teuthology.orchestra.run.smithi018.stdout:(6/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 4.7 MB/s | 2.1 MB 00:00 2024-09-13T16:38:57.389 INFO:teuthology.orchestra.run.smithi094.stdout:(97/138): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-09-13T16:38:57.414 INFO:teuthology.orchestra.run.smithi094.stdout:(98/138): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T16:38:57.456 INFO:teuthology.orchestra.run.smithi094.stdout:(99/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T16:38:57.490 INFO:teuthology.orchestra.run.smithi094.stdout:(100/138): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-13T16:38:57.515 INFO:teuthology.orchestra.run.smithi094.stdout:(101/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-09-13T16:38:57.540 INFO:teuthology.orchestra.run.smithi094.stdout:(102/138): python3-cachetools-4.2.4-1.el9.noarc 638 kB/s | 32 kB 00:00 2024-09-13T16:38:57.565 INFO:teuthology.orchestra.run.smithi094.stdout:(103/138): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-13T16:38:57.591 INFO:teuthology.orchestra.run.smithi094.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-13T16:38:57.636 INFO:teuthology.orchestra.run.smithi018.stdout:(7/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-13T16:38:57.649 INFO:teuthology.orchestra.run.smithi094.stdout:(105/138): libarrow-9.0.0-11.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2024-09-13T16:38:57.675 INFO:teuthology.orchestra.run.smithi094.stdout:(106/138): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-13T16:38:57.700 INFO:teuthology.orchestra.run.smithi094.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-13T16:38:57.725 INFO:teuthology.orchestra.run.smithi094.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-13T16:38:57.751 INFO:teuthology.orchestra.run.smithi094.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-13T16:38:57.776 INFO:teuthology.orchestra.run.smithi094.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-13T16:38:57.801 INFO:teuthology.orchestra.run.smithi094.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-13T16:38:57.802 INFO:teuthology.orchestra.run.smithi144.stdout:(18/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 22 MB/s | 40 MB 00:01 2024-09-13T16:38:57.827 INFO:teuthology.orchestra.run.smithi094.stdout:(112/138): python3-google-auth-2.34.0-1.el9.noa 935 kB/s | 220 kB 00:00 2024-09-13T16:38:57.827 INFO:teuthology.orchestra.run.smithi144.stdout:(19/138): python3-ceph-argparse-18.2.4-850.g50b 93 kB/s | 45 kB 00:00 2024-09-13T16:38:57.852 INFO:teuthology.orchestra.run.smithi094.stdout:(113/138): python3-logutils-0.3.5-21.el9.noarch 923 kB/s | 46 kB 00:00 2024-09-13T16:38:57.877 INFO:teuthology.orchestra.run.smithi094.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-13T16:38:57.894 INFO:teuthology.orchestra.run.smithi144.stdout:(20/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 5.8 MB/s | 4.5 MB 00:00 2024-09-13T16:38:57.902 INFO:teuthology.orchestra.run.smithi094.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-13T16:38:57.919 INFO:teuthology.orchestra.run.smithi144.stdout:(21/138): python3-ceph-common-18.2.4-850.g50bbe 1.1 MB/s | 129 kB 00:00 2024-09-13T16:38:57.936 INFO:teuthology.orchestra.run.smithi094.stdout:(116/138): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-13T16:38:57.953 INFO:teuthology.orchestra.run.smithi144.stdout:(22/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 1.3 MB/s | 162 kB 00:00 2024-09-13T16:38:57.961 INFO:teuthology.orchestra.run.smithi094.stdout:(117/138): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-13T16:38:57.986 INFO:teuthology.orchestra.run.smithi144.stdout:(23/138): python3-rados-18.2.4-850.g50bbe7f3.el 3.4 MB/s | 319 kB 00:00 2024-09-13T16:38:57.987 INFO:teuthology.orchestra.run.smithi094.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-13T16:38:58.012 INFO:teuthology.orchestra.run.smithi144.stdout:(24/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.7 MB/s | 99 kB 00:00 2024-09-13T16:38:58.012 INFO:teuthology.orchestra.run.smithi094.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 608 kB/s | 31 kB 00:00 2024-09-13T16:38:58.037 INFO:teuthology.orchestra.run.smithi144.stdout:(25/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 2.5 MB/s | 301 kB 00:00 2024-09-13T16:38:58.037 INFO:teuthology.orchestra.run.smithi094.stdout:(120/138): python3-routes-2.5.1-5.el9.noarch.rp 3.6 MB/s | 188 kB 00:00 2024-09-13T16:38:58.062 INFO:teuthology.orchestra.run.smithi144.stdout:(26/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 1.1 MB/s | 87 kB 00:00 2024-09-13T16:38:58.063 INFO:teuthology.orchestra.run.smithi094.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-13T16:38:58.088 INFO:teuthology.orchestra.run.smithi094.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-09-13T16:38:58.096 INFO:teuthology.orchestra.run.smithi144.stdout:(27/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 2.9 MB/s | 172 kB 00:00 2024-09-13T16:38:58.111 INFO:teuthology.orchestra.run.smithi018.stdout:(8/138): ceph-common-18.2.4-850.g50bbe7f3.el9.x 8.9 MB/s | 18 MB 00:02 2024-09-13T16:38:58.114 INFO:teuthology.orchestra.run.smithi094.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T16:38:58.121 INFO:teuthology.orchestra.run.smithi144.stdout:(28/138): ceph-grafana-dashboards-18.2.4-850.g5 417 kB/s | 24 kB 00:00 2024-09-13T16:38:58.147 INFO:teuthology.orchestra.run.smithi144.stdout:(29/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 2.7 MB/s | 139 kB 00:00 2024-09-13T16:38:58.147 INFO:teuthology.orchestra.run.smithi094.stdout:(124/138): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-13T16:38:58.173 INFO:teuthology.orchestra.run.smithi094.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-13T16:38:58.198 INFO:teuthology.orchestra.run.smithi094.stdout:(126/138): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-13T16:38:58.215 INFO:teuthology.orchestra.run.smithi094.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-09-13T16:38:58.240 INFO:teuthology.orchestra.run.smithi094.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 4.4 MB/s | 191 kB 00:00 2024-09-13T16:38:58.245 INFO:teuthology.orchestra.run.smithi018.stdout:(9/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9. 13 MB/s | 7.8 MB 00:00 2024-09-13T16:38:58.255 INFO:teuthology.orchestra.run.smithi144.stdout:(30/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 12 MB/s | 3.0 MB 00:00 2024-09-13T16:38:58.265 INFO:teuthology.orchestra.run.smithi094.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-13T16:38:58.270 INFO:teuthology.orchestra.run.smithi018.stdout:(10/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9 159 kB/s | 25 kB 00:00 2024-09-13T16:38:58.316 INFO:teuthology.orchestra.run.smithi094.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-13T16:38:58.347 INFO:teuthology.orchestra.run.smithi144.stdout:(31/138): ceph-mgr-modules-core-18.2.4-850.g50b 2.6 MB/s | 246 kB 00:00 2024-09-13T16:38:58.370 INFO:teuthology.orchestra.run.smithi018.stdout:(11/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 2.2 MB/s | 224 kB 00:00 2024-09-13T16:38:58.422 INFO:teuthology.orchestra.run.smithi144.stdout:(32/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 660 kB/s | 49 kB 00:00 2024-09-13T16:38:58.462 INFO:teuthology.orchestra.run.smithi018.stdout:(12/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 340 kB/s | 31 kB 00:00 2024-09-13T16:38:58.481 INFO:teuthology.orchestra.run.smithi144.stdout:(33/138): ceph-prometheus-alerts-18.2.4-850.g50 281 kB/s | 16 kB 00:00 2024-09-13T16:38:58.565 INFO:teuthology.orchestra.run.smithi144.stdout:(34/138): ceph-mgr-diskprediction-local-18.2.4- 18 MB/s | 7.4 MB 00:00 2024-09-13T16:38:58.591 INFO:teuthology.orchestra.run.smithi094.stdout:(131/138): NetworkManager-1.49.90-1.el9.x86_64. 8.4 MB/s | 2.3 MB 00:00 2024-09-13T16:38:58.592 INFO:teuthology.orchestra.run.smithi144.stdout:(35/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 2.3 MB/s | 264 kB 00:00 2024-09-13T16:38:58.617 INFO:teuthology.orchestra.run.smithi144.stdout:(36/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 4.2 MB/s | 226 kB 00:00 2024-09-13T16:38:58.659 INFO:teuthology.orchestra.run.smithi144.stdout:(37/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 272 kB/s | 18 kB 00:00 2024-09-13T16:38:58.671 INFO:teuthology.orchestra.run.smithi018.stdout:(13/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86 13 MB/s | 17 MB 00:01 2024-09-13T16:38:58.700 INFO:teuthology.orchestra.run.smithi094.stdout:(132/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 6.9 MB/s | 3.0 MB 00:00 2024-09-13T16:38:58.713 INFO:teuthology.orchestra.run.smithi018.stdout:(14/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 2.8 MB/s | 712 kB 00:00 2024-09-13T16:38:58.718 INFO:teuthology.orchestra.run.smithi144.stdout:(38/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 5.9 MB/s | 3.5 MB 00:00 2024-09-13T16:38:58.738 INFO:teuthology.orchestra.run.smithi018.stdout:(15/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 2.4 MB/s | 166 kB 00:00 2024-09-13T16:38:58.767 INFO:teuthology.orchestra.run.smithi094.stdout:(133/138): NetworkManager-libnm-1.49.90-1.el9.x 10 MB/s | 1.8 MB 00:00 2024-09-13T16:38:58.772 INFO:teuthology.orchestra.run.smithi018.stdout:(16/138): librados-devel-18.2.4-850.g50bbe7f3.e 2.1 MB/s | 127 kB 00:00 2024-09-13T16:38:58.822 INFO:teuthology.orchestra.run.smithi018.stdout:(17/138): libradosstriper1-18.2.4-850.g50bbe7f3 5.6 MB/s | 477 kB 00:00 2024-09-13T16:38:58.825 INFO:teuthology.orchestra.run.smithi094.stdout:(134/138): librados2-18.2.4-850.g50bbe7f3.el9.x 5.7 MB/s | 3.3 MB 00:00 2024-09-13T16:38:58.850 INFO:teuthology.orchestra.run.smithi094.stdout:(135/138): NetworkManager-team-1.49.90-1.el9.x8 270 kB/s | 41 kB 00:00 2024-09-13T16:38:58.876 INFO:teuthology.orchestra.run.smithi094.stdout:(136/138): NetworkManager-tui-1.49.90-1.el9.x86 2.2 MB/s | 249 kB 00:00 2024-09-13T16:38:58.881 INFO:teuthology.orchestra.run.smithi018.stdout:(18/138): python3-ceph-argparse-18.2.4-850.g50b 775 kB/s | 45 kB 00:00 2024-09-13T16:38:58.968 INFO:teuthology.orchestra.run.smithi018.stdout:(19/138): python3-ceph-common-18.2.4-850.g50bbe 1.5 MB/s | 129 kB 00:00 2024-09-13T16:38:59.031 INFO:teuthology.orchestra.run.smithi018.stdout:(20/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 2.5 MB/s | 162 kB 00:00 2024-09-13T16:38:59.043 INFO:teuthology.orchestra.run.smithi094.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 1.4 MB 00:00 2024-09-13T16:38:59.098 INFO:teuthology.orchestra.run.smithi018.stdout:(21/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 14 MB/s | 4.5 MB 00:00 2024-09-13T16:38:59.101 INFO:teuthology.orchestra.run.smithi144.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 165 kB/s | 80 kB 00:00 2024-09-13T16:38:59.123 INFO:teuthology.orchestra.run.smithi018.stdout:(22/138): python3-rados-18.2.4-850.g50bbe7f3.el 3.4 MB/s | 319 kB 00:00 2024-09-13T16:38:59.149 INFO:teuthology.orchestra.run.smithi018.stdout:(23/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 5.9 MB/s | 301 kB 00:00 2024-09-13T16:38:59.174 INFO:teuthology.orchestra.run.smithi018.stdout:(24/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T16:38:59.199 INFO:teuthology.orchestra.run.smithi018.stdout:(25/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T16:38:59.250 INFO:teuthology.orchestra.run.smithi018.stdout:(26/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 3.4 MB/s | 172 kB 00:00 2024-09-13T16:38:59.277 INFO:teuthology.orchestra.run.smithi144.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 342 kB/s | 191 kB 00:00 2024-09-13T16:38:59.317 INFO:teuthology.orchestra.run.smithi018.stdout:(27/138): ceph-grafana-dashboards-18.2.4-850.g5 366 kB/s | 24 kB 00:00 2024-09-13T16:38:59.351 INFO:teuthology.orchestra.run.smithi094.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 2.4 MB 00:00 2024-09-13T16:38:59.356 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:38:59.356 INFO:teuthology.orchestra.run.smithi094.stdout:Total 24 MB/s | 203 MB 00:08 2024-09-13T16:38:59.394 INFO:teuthology.orchestra.run.smithi144.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 868 kB/s | 253 kB 00:00 2024-09-13T16:38:59.409 INFO:teuthology.orchestra.run.smithi018.stdout:(28/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 13 MB/s | 3.0 MB 00:00 2024-09-13T16:38:59.434 INFO:teuthology.orchestra.run.smithi018.stdout:(29/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 1.2 MB/s | 139 kB 00:00 2024-09-13T16:38:59.502 INFO:teuthology.orchestra.run.smithi144.stdout:(42/138): libgfortran-11.5.0-2.el9.x86_64.rpm 951 kB/s | 801 kB 00:00 2024-09-13T16:38:59.528 INFO:teuthology.orchestra.run.smithi144.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 797 kB/s | 106 kB 00:00 2024-09-13T16:38:59.619 INFO:teuthology.orchestra.run.smithi144.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-13T16:38:59.645 INFO:teuthology.orchestra.run.smithi144.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-13T16:38:59.668 INFO:teuthology.orchestra.run.smithi018.stdout:(30/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 14 MB/s | 3.5 MB 00:00 2024-09-13T16:38:59.718 INFO:teuthology.orchestra.run.smithi018.stdout:(31/138): ceph-mgr-modules-core-18.2.4-850.g50b 4.8 MB/s | 246 kB 00:00 2024-09-13T16:38:59.737 INFO:teuthology.orchestra.run.smithi144.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-13T16:38:59.802 INFO:teuthology.orchestra.run.smithi018.stdout:(32/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 591 kB/s | 49 kB 00:00 2024-09-13T16:38:59.919 INFO:teuthology.orchestra.run.smithi018.stdout:(33/138): ceph-mgr-diskprediction-local-18.2.4- 15 MB/s | 7.4 MB 00:00 2024-09-13T16:38:59.944 INFO:teuthology.orchestra.run.smithi018.stdout:(34/138): ceph-prometheus-alerts-18.2.4-850.g50 116 kB/s | 16 kB 00:00 2024-09-13T16:38:59.978 INFO:teuthology.orchestra.run.smithi018.stdout:(35/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 4.4 MB/s | 264 kB 00:00 2024-09-13T16:38:59.987 INFO:teuthology.orchestra.run.smithi144.stdout:(47/138): python3-cryptography-36.0.1-4.el9.x86 1.7 MB/s | 1.2 MB 00:00 2024-09-13T16:39:00.016 INFO:teuthology.orchestra.run.smithi144.stdout:(48/138): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-09-13T16:39:00.017 INFO:teuthology.orchestra.run.smithi018.stdout:(36/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 3.3 MB/s | 226 kB 00:00 2024-09-13T16:39:00.036 INFO:teuthology.orchestra.run.smithi018.stdout:(37/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 312 kB/s | 18 kB 00:00 2024-09-13T16:39:00.071 INFO:teuthology.orchestra.run.smithi144.stdout:(49/138): elfutils-libelf-devel-0.191-4.el9.x86 372 kB/s | 22 kB 00:00 2024-09-13T16:39:00.096 INFO:teuthology.orchestra.run.smithi144.stdout:(50/138): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-13T16:39:00.163 INFO:teuthology.orchestra.run.smithi144.stdout:(51/138): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-13T16:39:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:(52/138): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-09-13T16:39:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:(53/138): boost-program-options-1.75.0-8.el9.x8 425 kB/s | 107 kB 00:00 2024-09-13T16:39:00.264 INFO:teuthology.orchestra.run.smithi144.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-13T16:39:00.306 INFO:teuthology.orchestra.run.smithi144.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-09-13T16:39:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-13T16:39:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-13T16:39:00.451 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-09-13T16:39:00.487 INFO:teuthology.orchestra.run.smithi018.stdout:(38/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 18 MB/s | 40 MB 00:02 2024-09-13T16:39:00.512 INFO:teuthology.orchestra.run.smithi018.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 159 kB/s | 80 kB 00:00 2024-09-13T16:39:00.540 INFO:teuthology.orchestra.run.smithi144.stdout:(58/138): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-13T16:39:00.574 INFO:teuthology.orchestra.run.smithi144.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-09-13T16:39:00.591 INFO:teuthology.orchestra.run.smithi144.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 484 kB/s | 24 kB 00:00 2024-09-13T16:39:00.596 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-09-13T16:39:00.597 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-09-13T16:39:00.616 INFO:teuthology.orchestra.run.smithi144.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-13T16:39:00.629 INFO:teuthology.orchestra.run.smithi018.stdout:(40/138): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-13T16:39:00.650 INFO:teuthology.orchestra.run.smithi144.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-13T16:39:00.654 INFO:teuthology.orchestra.run.smithi018.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-13T16:39:00.667 INFO:teuthology.orchestra.run.smithi144.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-13T16:39:00.680 INFO:teuthology.orchestra.run.smithi018.stdout:(42/138): libquadmath-11.5.0-2.el9.x86_64.rpm 996 kB/s | 191 kB 00:00 2024-09-13T16:39:00.705 INFO:teuthology.orchestra.run.smithi018.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-13T16:39:00.730 INFO:teuthology.orchestra.run.smithi018.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-13T16:39:00.756 INFO:teuthology.orchestra.run.smithi018.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-13T16:39:00.781 INFO:teuthology.orchestra.run.smithi018.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-13T16:39:00.823 INFO:teuthology.orchestra.run.smithi018.stdout:(47/138): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-09-13T16:39:00.940 INFO:teuthology.orchestra.run.smithi018.stdout:(48/138): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-13T16:39:00.992 INFO:teuthology.orchestra.run.smithi144.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.6 MB/s | 3.0 MB 00:00 2024-09-13T16:39:01.015 INFO:teuthology.orchestra.run.smithi018.stdout:(49/138): boost-program-options-1.75.0-8.el9.x8 557 kB/s | 107 kB 00:00 2024-09-13T16:39:01.040 INFO:teuthology.orchestra.run.smithi018.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 217 kB/s | 22 kB 00:00 2024-09-13T16:39:01.074 INFO:teuthology.orchestra.run.smithi018.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-13T16:39:01.100 INFO:teuthology.orchestra.run.smithi144.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-13T16:39:01.149 INFO:teuthology.orchestra.run.smithi018.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-13T16:39:01.175 INFO:teuthology.orchestra.run.smithi018.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-13T16:39:01.176 INFO:teuthology.orchestra.run.smithi144.stdout:(66/138): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-13T16:39:01.234 INFO:teuthology.orchestra.run.smithi144.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-13T16:39:01.250 INFO:teuthology.orchestra.run.smithi018.stdout:(54/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-09-13T16:39:01.275 INFO:teuthology.orchestra.run.smithi018.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-13T16:39:01.300 INFO:teuthology.orchestra.run.smithi018.stdout:(56/138): flexiblas-openblas-openmp-3.0.4-8.el9 121 kB/s | 18 kB 00:00 2024-09-13T16:39:01.326 INFO:teuthology.orchestra.run.smithi018.stdout:(57/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-13T16:39:01.351 INFO:teuthology.orchestra.run.smithi018.stdout:(58/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-13T16:39:01.410 INFO:teuthology.orchestra.run.smithi144.stdout:(68/138): postgresql-server-13.16-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-09-13T16:39:01.435 INFO:teuthology.orchestra.run.smithi018.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-13T16:39:01.460 INFO:teuthology.orchestra.run.smithi018.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-13T16:39:01.493 INFO:teuthology.orchestra.run.smithi018.stdout:(61/138): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-13T16:39:01.519 INFO:teuthology.orchestra.run.smithi018.stdout:(62/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-13T16:39:01.544 INFO:teuthology.orchestra.run.smithi018.stdout:(63/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-13T16:39:01.570 INFO:teuthology.orchestra.run.smithi018.stdout:(64/138): openblas-0.3.26-2.el9.x86_64.rpm 508 kB/s | 38 kB 00:00 2024-09-13T16:39:01.593 INFO:teuthology.orchestra.run.smithi144.stdout:(69/138): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 6.0 MB 00:00 2024-09-13T16:39:01.669 INFO:teuthology.orchestra.run.smithi144.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-13T16:39:01.720 INFO:teuthology.orchestra.run.smithi018.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-13T16:39:01.727 INFO:teuthology.orchestra.run.smithi144.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-13T16:39:01.786 INFO:teuthology.orchestra.run.smithi144.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-09-13T16:39:01.787 INFO:teuthology.orchestra.run.smithi018.stdout:(66/138): openblas-openmp-0.3.26-2.el9.x86_64.r 18 MB/s | 4.9 MB 00:00 2024-09-13T16:39:01.845 INFO:teuthology.orchestra.run.smithi144.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-13T16:39:01.862 INFO:teuthology.orchestra.run.smithi018.stdout:(67/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-13T16:39:01.888 INFO:teuthology.orchestra.run.smithi018.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-13T16:39:01.903 INFO:teuthology.orchestra.run.smithi144.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-13T16:39:01.930 INFO:teuthology.orchestra.run.smithi018.stdout:(69/138): postgresql-contrib-13.16-1.el9.x86_64 4.3 MB/s | 910 kB 00:00 2024-09-13T16:39:01.962 INFO:teuthology.orchestra.run.smithi144.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-09-13T16:39:02.030 INFO:teuthology.orchestra.run.smithi018.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-13T16:39:02.037 INFO:teuthology.orchestra.run.smithi144.stdout:(76/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-09-13T16:39:02.113 INFO:teuthology.orchestra.run.smithi018.stdout:(71/138): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-13T16:39:02.146 INFO:teuthology.orchestra.run.smithi144.stdout:(77/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-13T16:39:02.147 INFO:teuthology.orchestra.run.smithi018.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-13T16:39:02.196 INFO:teuthology.orchestra.run.smithi144.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-13T16:39:02.229 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-09-13T16:39:02.230 INFO:teuthology.orchestra.run.smithi144.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-13T16:39:02.230 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-09-13T16:39:02.247 INFO:teuthology.orchestra.run.smithi018.stdout:(73/138): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-13T16:39:02.255 INFO:teuthology.orchestra.run.smithi144.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-13T16:39:02.272 INFO:teuthology.orchestra.run.smithi018.stdout:(74/138): python3-jsonpatch-1.21-16.el9.noarch. 161 kB/s | 26 kB 00:00 2024-09-13T16:39:02.280 INFO:teuthology.orchestra.run.smithi144.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-09-13T16:39:02.297 INFO:teuthology.orchestra.run.smithi018.stdout:(75/138): python3-jsonpointer-2.0-4.el9.noarch. 127 kB/s | 19 kB 00:00 2024-09-13T16:39:02.323 INFO:teuthology.orchestra.run.smithi018.stdout:(76/138): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-13T16:39:02.355 INFO:teuthology.orchestra.run.smithi144.stdout:(82/138): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-13T16:39:02.365 INFO:teuthology.orchestra.run.smithi018.stdout:(77/138): python3-markupsafe-1.1.1-12.el9.x86_6 521 kB/s | 35 kB 00:00 2024-09-13T16:39:02.381 INFO:teuthology.orchestra.run.smithi144.stdout:(83/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-13T16:39:02.398 INFO:teuthology.orchestra.run.smithi018.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-13T16:39:02.406 INFO:teuthology.orchestra.run.smithi144.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T16:39:02.432 INFO:teuthology.orchestra.run.smithi018.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-13T16:39:02.440 INFO:teuthology.orchestra.run.smithi144.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 915 kB/s | 54 kB 00:00 2024-09-13T16:39:02.507 INFO:teuthology.orchestra.run.smithi018.stdout:(80/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-09-13T16:39:02.515 INFO:teuthology.orchestra.run.smithi144.stdout:(86/138): openblas-openmp-0.3.26-2.el9.x86_64.r 2.6 MB/s | 4.9 MB 00:01 2024-09-13T16:39:02.524 INFO:teuthology.orchestra.run.smithi018.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 460 kB/s | 42 kB 00:00 2024-09-13T16:39:02.532 INFO:teuthology.orchestra.run.smithi144.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 451 kB/s | 42 kB 00:00 2024-09-13T16:39:02.558 INFO:teuthology.orchestra.run.smithi018.stdout:(82/138): python3-packaging-20.9-5.el9.noarch.r 485 kB/s | 77 kB 00:00 2024-09-13T16:39:02.582 INFO:teuthology.orchestra.run.smithi144.stdout:(88/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T16:39:02.583 INFO:teuthology.orchestra.run.smithi018.stdout:(83/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-13T16:39:02.608 INFO:teuthology.orchestra.run.smithi018.stdout:(84/138): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-13T16:39:02.641 INFO:teuthology.orchestra.run.smithi144.stdout:(89/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-13T16:39:02.650 INFO:teuthology.orchestra.run.smithi018.stdout:(85/138): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-09-13T16:39:02.678 INFO:teuthology.orchestra.run.smithi018.stdout:(86/138): python3-requests-oauthlib-1.3.0-12.el 569 kB/s | 54 kB 00:00 2024-09-13T16:39:02.691 INFO:teuthology.orchestra.run.smithi144.stdout:(90/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T16:39:02.720 INFO:teuthology.orchestra.run.smithi018.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 604 kB/s | 42 kB 00:00 2024-09-13T16:39:02.745 INFO:teuthology.orchestra.run.smithi018.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-13T16:39:02.750 INFO:teuthology.orchestra.run.smithi144.stdout:(91/138): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-13T16:39:02.767 INFO:teuthology.orchestra.run.smithi144.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 596 kB/s | 45 kB 00:00 2024-09-13T16:39:02.804 INFO:teuthology.orchestra.run.smithi018.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 691 kB/s | 58 kB 00:00 2024-09-13T16:39:02.829 INFO:teuthology.orchestra.run.smithi018.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-13T16:39:02.879 INFO:teuthology.orchestra.run.smithi018.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 848 kB/s | 64 kB 00:00 2024-09-13T16:39:02.904 INFO:teuthology.orchestra.run.smithi018.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 597 kB/s | 45 kB 00:00 2024-09-13T16:39:02.976 INFO:teuthology.orchestra.run.smithi144.stdout:(93/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-13T16:39:03.034 INFO:teuthology.orchestra.run.smithi144.stdout:(94/138): fmt-8.1.1-5.el9.x86_64.rpm 391 kB/s | 111 kB 00:00 2024-09-13T16:39:03.060 INFO:teuthology.orchestra.run.smithi144.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-13T16:39:03.093 INFO:teuthology.orchestra.run.smithi144.stdout:(96/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 944 kB/s | 308 kB 00:00 2024-09-13T16:39:03.118 INFO:teuthology.orchestra.run.smithi144.stdout:(97/138): liboath-2.6.7-2.el9.x86_64.rpm 832 kB/s | 49 kB 00:00 2024-09-13T16:39:03.138 INFO:teuthology.orchestra.run.smithi018.stdout:(93/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-13T16:39:03.143 INFO:teuthology.orchestra.run.smithi144.stdout:(98/138): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T16:39:03.180 INFO:teuthology.orchestra.run.smithi018.stdout:(94/138): fmt-8.1.1-5.el9.x86_64.rpm 368 kB/s | 111 kB 00:00 2024-09-13T16:39:03.211 INFO:teuthology.orchestra.run.smithi144.stdout:(99/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-13T16:39:03.214 INFO:teuthology.orchestra.run.smithi018.stdout:(95/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 996 kB/s | 308 kB 00:00 2024-09-13T16:39:03.239 INFO:teuthology.orchestra.run.smithi018.stdout:(96/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 461 kB/s | 26 kB 00:00 2024-09-13T16:39:03.244 INFO:teuthology.orchestra.run.smithi144.stdout:(100/138): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-13T16:39:03.264 INFO:teuthology.orchestra.run.smithi018.stdout:(97/138): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-09-13T16:39:03.269 INFO:teuthology.orchestra.run.smithi144.stdout:(101/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-09-13T16:39:03.290 INFO:teuthology.orchestra.run.smithi018.stdout:(98/138): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T16:39:03.295 INFO:teuthology.orchestra.run.smithi144.stdout:(102/138): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-13T16:39:03.320 INFO:teuthology.orchestra.run.smithi144.stdout:(103/138): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-13T16:39:03.345 INFO:teuthology.orchestra.run.smithi144.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-13T16:39:03.365 INFO:teuthology.orchestra.run.smithi018.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 7.2 MB/s | 548 kB 00:00 2024-09-13T16:39:03.379 INFO:teuthology.orchestra.run.smithi144.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-13T16:39:03.404 INFO:teuthology.orchestra.run.smithi144.stdout:(106/138): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-13T16:39:03.407 INFO:teuthology.orchestra.run.smithi018.stdout:(100/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-13T16:39:03.429 INFO:teuthology.orchestra.run.smithi144.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-13T16:39:03.432 INFO:teuthology.orchestra.run.smithi018.stdout:(101/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 649 kB/s | 43 kB 00:00 2024-09-13T16:39:03.455 INFO:teuthology.orchestra.run.smithi144.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-13T16:39:03.457 INFO:teuthology.orchestra.run.smithi018.stdout:(102/138): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-13T16:39:03.480 INFO:teuthology.orchestra.run.smithi144.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-13T16:39:03.483 INFO:teuthology.orchestra.run.smithi018.stdout:(103/138): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-13T16:39:03.505 INFO:teuthology.orchestra.run.smithi144.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-13T16:39:03.531 INFO:teuthology.orchestra.run.smithi144.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-13T16:39:03.545 INFO:teuthology.orchestra.run.smithi018.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 1.9 MB/s | 172 kB 00:00 2024-09-13T16:39:03.564 INFO:teuthology.orchestra.run.smithi144.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-13T16:39:03.583 INFO:teuthology.orchestra.run.smithi018.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-13T16:39:03.609 INFO:teuthology.orchestra.run.smithi018.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-13T16:39:03.623 INFO:teuthology.orchestra.run.smithi144.stdout:(113/138): libarrow-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-09-13T16:39:03.633 INFO:teuthology.orchestra.run.smithi018.stdout:(107/138): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2024-09-13T16:39:03.648 INFO:teuthology.orchestra.run.smithi144.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 943 kB/s | 79 kB 00:00 2024-09-13T16:39:03.659 INFO:teuthology.orchestra.run.smithi018.stdout:(108/138): python3-google-auth-2.34.0-1.el9.noa 1.9 MB/s | 220 kB 00:00 2024-09-13T16:39:03.674 INFO:teuthology.orchestra.run.smithi144.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-13T16:39:03.684 INFO:teuthology.orchestra.run.smithi018.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-13T16:39:03.710 INFO:teuthology.orchestra.run.smithi018.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-13T16:39:03.724 INFO:teuthology.orchestra.run.smithi144.stdout:(116/138): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-13T16:39:03.735 INFO:teuthology.orchestra.run.smithi018.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-13T16:39:03.749 INFO:teuthology.orchestra.run.smithi144.stdout:(117/138): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-09-13T16:39:03.760 INFO:teuthology.orchestra.run.smithi018.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T16:39:03.775 INFO:teuthology.orchestra.run.smithi144.stdout:(118/138): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-13T16:39:03.794 INFO:teuthology.orchestra.run.smithi018.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-13T16:39:03.800 INFO:teuthology.orchestra.run.smithi144.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-13T16:39:03.825 INFO:teuthology.orchestra.run.smithi144.stdout:(120/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 892 kB/s | 90 kB 00:00 2024-09-13T16:39:03.850 INFO:teuthology.orchestra.run.smithi144.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-13T16:39:03.861 INFO:teuthology.orchestra.run.smithi018.stdout:(114/138): libarrow-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-09-13T16:39:03.876 INFO:teuthology.orchestra.run.smithi144.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-13T16:39:03.878 INFO:teuthology.orchestra.run.smithi018.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 690 kB/s | 58 kB 00:00 2024-09-13T16:39:03.901 INFO:teuthology.orchestra.run.smithi144.stdout:(123/138): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-13T16:39:03.911 INFO:teuthology.orchestra.run.smithi018.stdout:(116/138): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-13T16:39:03.926 INFO:teuthology.orchestra.run.smithi144.stdout:(124/138): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-13T16:39:03.952 INFO:teuthology.orchestra.run.smithi144.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-13T16:39:03.953 INFO:teuthology.orchestra.run.smithi018.stdout:(117/138): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-09-13T16:39:03.985 INFO:teuthology.orchestra.run.smithi144.stdout:(126/138): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-13T16:39:03.987 INFO:teuthology.orchestra.run.smithi018.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-13T16:39:04.002 INFO:teuthology.orchestra.run.smithi144.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-13T16:39:04.012 INFO:teuthology.orchestra.run.smithi018.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2024-09-13T16:39:04.036 INFO:teuthology.orchestra.run.smithi144.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T16:39:04.038 INFO:teuthology.orchestra.run.smithi018.stdout:(120/138): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-13T16:39:04.061 INFO:teuthology.orchestra.run.smithi144.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-13T16:39:04.063 INFO:teuthology.orchestra.run.smithi018.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-13T16:39:04.088 INFO:teuthology.orchestra.run.smithi018.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-13T16:39:04.122 INFO:teuthology.orchestra.run.smithi018.stdout:(123/138): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2024-09-13T16:39:04.136 INFO:teuthology.orchestra.run.smithi144.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-13T16:39:04.147 INFO:teuthology.orchestra.run.smithi018.stdout:(124/138): python3-typing-extensions-4.12.2-2.e 888 kB/s | 74 kB 00:00 2024-09-13T16:39:04.172 INFO:teuthology.orchestra.run.smithi018.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-13T16:39:04.298 INFO:teuthology.orchestra.run.smithi018.stdout:(126/138): python3-websocket-client-1.2.3-2.el9 511 kB/s | 90 kB 00:00 2024-09-13T16:39:04.323 INFO:teuthology.orchestra.run.smithi018.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 133 kB/s | 20 kB 00:00 2024-09-13T16:39:04.337 INFO:teuthology.orchestra.run.smithi144.stdout:(131/138): librados2-18.2.4-850.g50bbe7f3.el9.x 11 MB/s | 3.3 MB 00:00 2024-09-13T16:39:04.390 INFO:teuthology.orchestra.run.smithi018.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 1.7 MB/s | 427 kB 00:00 2024-09-13T16:39:04.395 INFO:teuthology.orchestra.run.smithi144.stdout:(132/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 9.0 MB/s | 3.0 MB 00:00 2024-09-13T16:39:04.415 INFO:teuthology.orchestra.run.smithi018.stdout:(129/138): re2-20211101-20.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-13T16:39:04.474 INFO:teuthology.orchestra.run.smithi018.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-13T16:39:04.596 INFO:teuthology.orchestra.run.smithi144.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 204 kB/s | 41 kB 00:00 2024-09-13T16:39:04.691 INFO:teuthology.orchestra.run.smithi018.stdout:(131/138): librados2-18.2.4-850.g50bbe7f3.el9.x 11 MB/s | 3.3 MB 00:00 2024-09-13T16:39:04.758 INFO:teuthology.orchestra.run.smithi018.stdout:(132/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 8.8 MB/s | 3.0 MB 00:00 2024-09-13T16:39:04.841 INFO:teuthology.orchestra.run.smithi018.stdout:(133/138): NetworkManager-1.49.90-1.el9.x86_64. 6.3 MB/s | 2.3 MB 00:00 2024-09-13T16:39:04.867 INFO:teuthology.orchestra.run.smithi018.stdout:(134/138): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-13T16:39:04.892 INFO:teuthology.orchestra.run.smithi018.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-13T16:39:04.896 INFO:teuthology.orchestra.run.smithi144.stdout:(134/138): NetworkManager-tui-1.49.90-1.el9.x86 829 kB/s | 249 kB 00:00 2024-09-13T16:39:04.942 INFO:teuthology.orchestra.run.smithi018.stdout:(136/138): NetworkManager-libnm-1.49.90-1.el9.x 7.2 MB/s | 1.8 MB 00:00 2024-09-13T16:39:05.001 INFO:teuthology.orchestra.run.smithi018.stdout:(137/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-13T16:39:05.068 INFO:teuthology.orchestra.run.smithi018.stdout:(138/138): openssl-3.2.2-6.el9.x86_64.rpm 6.8 MB/s | 1.4 MB 00:00 2024-09-13T16:39:05.074 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:39:05.074 INFO:teuthology.orchestra.run.smithi018.stdout:Total 22 MB/s | 203 MB 00:09 2024-09-13T16:39:05.104 INFO:teuthology.orchestra.run.smithi144.stdout:(135/138): NetworkManager-1.49.90-1.el9.x86_64. 2.4 MB/s | 2.3 MB 00:00 2024-09-13T16:39:05.438 INFO:teuthology.orchestra.run.smithi144.stdout:(136/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.2 MB/s | 2.4 MB 00:00 2024-09-13T16:39:05.563 INFO:teuthology.orchestra.run.smithi144.stdout:(137/138): NetworkManager-libnm-1.49.90-1.el9.x 1.5 MB/s | 1.8 MB 00:01 2024-09-13T16:39:05.697 INFO:teuthology.orchestra.run.smithi144.stdout:(138/138): openssl-3.2.2-6.el9.x86_64.rpm 1.7 MB/s | 1.4 MB 00:00 2024-09-13T16:39:05.703 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:39:05.703 INFO:teuthology.orchestra.run.smithi144.stdout:Total 18 MB/s | 203 MB 00:11 2024-09-13T16:39:06.817 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-13T16:39:06.902 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-13T16:39:06.961 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-13T16:39:06.961 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-13T16:39:07.089 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-13T16:39:07.089 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-13T16:39:07.821 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-09-13T16:39:07.922 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T16:39:08.072 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T16:39:08.133 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T16:39:08.174 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T16:39:08.199 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T16:39:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T16:39:08.570 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T16:39:08.596 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-13T16:39:08.596 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-13T16:39:08.675 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:39:08.792 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:39:08.818 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:39:08.907 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:39:08.938 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T16:39:09.098 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T16:39:09.152 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T16:39:09.188 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:39:09.280 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:39:09.306 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T16:39:09.321 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-13T16:39:09.321 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-13T16:39:09.471 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T16:39:09.603 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T16:39:09.706 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T16:39:09.788 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T16:39:10.091 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T16:39:10.126 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T16:39:10.169 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T16:39:10.243 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T16:39:10.276 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T16:39:10.304 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T16:39:10.374 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T16:39:10.427 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T16:39:10.457 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T16:39:10.501 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T16:39:10.578 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T16:39:10.612 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T16:39:10.647 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T16:39:10.721 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T16:39:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T16:39:10.928 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T16:39:11.455 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T16:39:11.540 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T16:39:11.578 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T16:39:11.616 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T16:39:11.658 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T16:39:11.849 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T16:39:11.900 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T16:39:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T16:39:12.062 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T16:39:12.117 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T16:39:12.190 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T16:39:12.230 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T16:39:12.266 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T16:39:12.312 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T16:39:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T16:39:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T16:39:12.535 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T16:39:12.577 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T16:39:12.618 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T16:39:12.720 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T16:39:12.752 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T16:39:12.797 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T16:39:12.823 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T16:39:12.850 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T16:39:12.883 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T16:39:12.911 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T16:39:12.946 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T16:39:12.982 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T16:39:13.013 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T16:39:13.047 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T16:39:13.081 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T16:39:13.122 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T16:39:13.157 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T16:39:13.192 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T16:39:13.332 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T16:39:13.513 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T16:39:13.569 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T16:39:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-13T16:39:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T16:39:14.289 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T16:39:14.291 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T16:39:14.342 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T16:39:14.349 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T16:39:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T16:39:14.383 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T16:39:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T16:39:14.484 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T16:39:14.517 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T16:39:14.654 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T16:39:14.699 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T16:39:14.723 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T16:39:14.800 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T16:39:15.028 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T16:39:15.103 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:39:15.220 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:39:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:39:15.344 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:39:15.375 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T16:39:15.448 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T16:39:15.521 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T16:39:15.563 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T16:39:15.572 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T16:39:15.600 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:39:15.683 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:39:15.684 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-13T16:39:15.709 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T16:39:15.831 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T16:39:15.873 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T16:39:15.895 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T16:39:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T16:39:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T16:39:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T16:39:16.073 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T16:39:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T16:39:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T16:39:16.199 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T16:39:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T16:39:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T16:39:16.521 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T16:39:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T16:39:16.624 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:39:16.626 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T16:39:16.671 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T16:39:16.698 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T16:39:16.769 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T16:39:16.780 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:39:16.785 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T16:39:16.816 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:39:16.820 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T16:39:16.851 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T16:39:16.878 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T16:39:16.895 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T16:39:16.906 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T16:39:16.939 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T16:39:16.940 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:39:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T16:39:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T16:39:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T16:39:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T16:39:17.139 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T16:39:17.188 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T16:39:17.245 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T16:39:17.254 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T16:39:17.279 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:39:17.281 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T16:39:17.285 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T16:39:17.334 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T16:39:17.377 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T16:39:17.387 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:39:17.407 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T16:39:17.413 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T16:39:17.443 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T16:39:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T16:39:17.844 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T16:39:17.845 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T16:39:17.872 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T16:39:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T16:39:17.943 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T16:39:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T16:39:17.964 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T16:39:17.965 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T16:39:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T16:39:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T16:39:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T16:39:18.120 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T16:39:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T16:39:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T16:39:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T16:39:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T16:39:18.484 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T16:39:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T16:39:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T16:39:18.579 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T16:39:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T16:39:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T16:39:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T16:39:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T16:39:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T16:39:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T16:39:18.737 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T16:39:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T16:39:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T16:39:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T16:39:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T16:39:18.937 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T16:39:18.957 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T16:39:18.979 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T16:39:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T16:39:19.020 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T16:39:19.103 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T16:39:19.121 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T16:39:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T16:39:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T16:39:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T16:39:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T16:39:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T16:39:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T16:39:19.286 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T16:39:19.299 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T16:39:19.327 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T16:39:19.361 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T16:39:19.398 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T16:39:19.428 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T16:39:19.458 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T16:39:19.462 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T16:39:19.496 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T16:39:19.521 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T16:39:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T16:39:19.591 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T16:39:19.626 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T16:39:19.673 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T16:39:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T16:39:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T16:39:20.008 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T16:39:20.045 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T16:39:20.191 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T16:39:20.291 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T16:39:20.342 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T16:39:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T16:39:20.458 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T16:39:20.558 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T16:39:20.561 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T16:39:20.598 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T16:39:20.599 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T16:39:20.642 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T16:39:20.651 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T16:39:20.700 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T16:39:20.700 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T16:39:20.700 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T16:39:20.700 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:20.722 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T16:39:20.733 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T16:39:20.740 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T16:39:20.784 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T16:39:20.858 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T16:39:20.900 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T16:39:20.963 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T16:39:20.968 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T16:39:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T16:39:21.049 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T16:39:21.084 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T16:39:21.235 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T16:39:21.405 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T16:39:21.465 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T16:39:21.525 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T16:39:21.583 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T16:39:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T16:39:21.761 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T16:39:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T16:39:21.856 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T16:39:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T16:39:21.992 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T16:39:22.036 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T16:39:22.079 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T16:39:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T16:39:22.136 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T16:39:22.186 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T16:39:22.223 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T16:39:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T16:39:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T16:39:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T16:39:22.391 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T16:39:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T16:39:22.469 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T16:39:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T16:39:22.536 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T16:39:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T16:39:22.738 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T16:39:22.800 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T16:39:23.077 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T16:39:23.161 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T16:39:23.189 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T16:39:23.222 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T16:39:23.520 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T16:39:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T16:39:23.659 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T16:39:23.690 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T16:39:23.726 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T16:39:23.760 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T16:39:23.852 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T16:39:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T16:39:24.004 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T16:39:24.046 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T16:39:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T16:39:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T16:39:24.218 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T16:39:24.256 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T16:39:24.295 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T16:39:24.326 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T16:39:24.429 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T16:39:25.286 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T16:39:25.429 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T16:39:26.280 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T16:39:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T16:39:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T16:39:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T16:39:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T16:39:27.009 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T16:39:27.009 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T16:39:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:27.041 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T16:39:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T16:39:27.173 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T16:39:27.209 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T16:39:27.242 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T16:39:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T16:39:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T16:39:27.744 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T16:39:27.778 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T16:39:27.827 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T16:39:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T16:39:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T16:39:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T16:39:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T16:39:30.851 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T16:39:30.907 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T16:39:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T16:39:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T16:39:31.750 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T16:39:31.750 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T16:39:31.750 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T16:39:31.750 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:31.794 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T16:39:32.191 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T16:39:32.191 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /sys 2024-09-13T16:39:32.191 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /proc 2024-09-13T16:39:32.191 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /mnt 2024-09-13T16:39:32.191 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /var/tmp 2024-09-13T16:39:32.191 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /home 2024-09-13T16:39:32.191 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /root 2024-09-13T16:39:32.191 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /tmp 2024-09-13T16:39:32.192 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:32.354 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T16:39:32.371 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T16:39:32.371 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:32.371 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T16:39:32.371 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:33.833 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T16:39:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T16:39:33.860 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:33.860 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T16:39:33.860 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T16:39:33.860 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T16:39:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T16:39:34.090 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T16:39:34.090 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:34.090 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T16:39:34.090 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T16:39:34.090 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T16:39:34.090 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:34.534 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T16:39:34.557 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T16:39:34.558 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:34.558 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T16:39:34.558 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T16:39:34.558 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T16:39:34.558 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:34.665 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T16:39:34.721 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T16:39:34.793 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T16:39:34.979 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T16:39:35.035 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T16:39:35.113 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T16:39:35.210 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T16:39:35.356 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T16:39:35.394 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T16:39:35.442 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T16:39:35.470 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T16:39:35.855 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T16:39:35.885 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T16:39:35.914 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T16:39:35.970 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T16:39:36.008 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T16:39:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T16:39:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T16:39:38.038 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T16:39:38.060 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T16:39:38.165 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T16:39:38.317 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T16:39:38.338 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T16:39:38.362 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T16:39:38.362 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:38.363 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T16:39:38.363 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T16:39:38.363 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T16:39:38.363 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:38.413 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T16:39:38.425 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T16:39:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T16:39:38.469 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2024-09-13T16:39:38.469 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2024-09-13T16:39:38.469 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2024-09-13T16:39:38.470 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2024-09-13T16:39:38.470 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2024-09-13T16:39:38.470 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2024-09-13T16:39:38.470 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2024-09-13T16:39:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:38.527 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T16:39:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T16:39:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T16:39:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T16:39:38.651 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:38.651 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T16:39:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:39.290 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T16:39:39.325 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T16:39:39.348 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T16:39:39.348 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:39.348 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T16:39:39.348 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T16:39:39.349 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T16:39:39.349 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:39.392 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T16:39:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T16:39:39.415 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:39.415 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T16:39:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T16:39:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T16:39:39.483 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:39.483 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T16:39:39.483 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T16:39:39.483 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T16:39:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:39.785 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T16:39:39.809 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T16:39:39.809 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:39.809 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T16:39:39.809 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T16:39:39.809 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T16:39:39.809 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:40.096 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T16:39:40.123 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T16:39:40.123 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:40.123 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T16:39:40.123 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T16:39:40.124 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T16:39:40.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:40.330 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T16:39:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T16:39:40.354 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:40.354 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T16:39:40.354 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T16:39:40.354 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T16:39:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:40.806 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T16:39:40.829 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T16:39:40.829 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:40.830 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T16:39:40.830 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T16:39:40.830 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T16:39:40.830 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T16:39:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T16:39:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T16:39:41.233 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T16:39:41.290 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T16:39:41.367 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T16:39:41.456 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T16:39:41.596 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T16:39:41.632 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T16:39:41.663 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T16:39:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T16:39:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T16:39:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T16:39:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T16:39:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T16:39:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T16:39:43.325 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T16:39:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T16:39:43.456 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T16:39:43.499 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T16:39:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T16:39:43.570 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T16:39:43.750 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T16:39:43.801 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T16:39:43.832 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T16:39:43.862 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T16:39:43.916 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T16:39:44.329 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T16:39:44.357 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T16:39:44.459 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T16:39:44.507 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:39:44.548 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:39:44.569 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:39:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T16:39:44.667 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T16:39:44.692 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T16:39:44.692 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:44.692 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T16:39:44.692 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T16:39:44.693 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T16:39:44.693 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:44.698 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T16:39:44.698 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-09-13T16:39:44.698 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-09-13T16:39:44.698 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-09-13T16:39:44.698 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-09-13T16:39:44.699 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-09-13T16:39:44.699 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-09-13T16:39:44.699 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-09-13T16:39:44.699 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:44.743 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T16:39:44.755 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T16:39:44.848 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T16:39:44.900 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T16:39:44.914 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T16:39:44.954 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T16:39:44.954 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:44.954 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T16:39:44.954 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:45.416 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T16:39:45.512 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T16:39:45.553 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T16:39:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T16:39:45.635 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T16:39:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T16:39:45.665 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T16:39:45.669 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T16:39:45.669 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:45.669 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T16:39:45.669 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T16:39:45.669 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T16:39:45.669 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:45.690 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T16:39:45.713 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T16:39:45.716 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T16:39:45.717 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T16:39:45.736 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T16:39:45.736 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:45.736 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T16:39:45.736 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:45.784 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T16:39:45.784 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T16:39:45.788 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T16:39:45.812 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T16:39:45.812 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:45.812 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T16:39:45.812 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T16:39:45.812 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T16:39:45.813 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:45.860 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T16:39:45.885 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T16:39:45.890 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:39:45.891 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:39:46.062 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:39:46.062 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T16:39:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T16:39:46.129 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T16:39:46.129 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:46.129 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T16:39:46.129 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T16:39:46.130 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T16:39:46.130 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:39:46.138 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T16:39:46.201 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:39:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T16:39:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T16:39:46.659 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:46.659 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T16:39:46.659 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T16:39:46.659 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T16:39:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:46.900 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T16:39:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T16:39:46.952 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:46.952 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T16:39:46.952 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T16:39:46.952 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T16:39:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:47.485 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T16:39:47.536 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T16:39:47.536 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:47.536 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T16:39:47.536 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T16:39:47.536 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T16:39:47.536 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:47.668 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T16:39:47.730 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T16:39:47.819 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T16:39:48.062 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T16:39:48.131 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T16:39:48.243 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T16:39:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T16:39:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T16:39:48.608 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T16:39:48.653 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T16:39:48.679 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T16:39:49.237 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T16:39:49.270 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T16:39:49.300 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T16:39:49.371 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T16:39:49.409 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T16:39:49.784 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T16:39:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T16:39:49.866 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T16:39:49.890 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T16:39:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T16:39:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T16:39:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T16:39:50.165 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T16:39:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T16:39:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T16:39:50.744 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T16:39:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:39:50.834 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:39:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:39:51.681 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:39:51.681 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T16:39:51.681 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T16:39:51.681 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T16:39:51.681 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T16:39:51.681 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T16:39:51.682 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T16:39:51.683 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T16:39:51.684 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T16:39:51.685 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T16:39:51.686 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T16:39:51.687 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T16:39:51.688 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T16:39:51.689 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T16:39:51.690 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T16:39:51.691 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T16:39:51.692 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T16:39:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T16:39:51.781 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T16:39:51.821 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T16:39:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T16:39:51.904 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T16:39:51.934 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T16:39:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T16:39:51.959 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T16:39:51.985 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T16:39:51.985 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T16:39:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T16:39:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T16:39:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T16:39:52.145 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T16:39:52.170 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T16:39:52.175 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:39:52.176 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:39:52.253 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T16:39:52.296 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T16:39:52.349 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T16:39:52.349 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:52.349 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T16:39:52.349 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T16:39:52.349 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T16:39:52.350 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:39:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T16:39:52.405 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T16:39:52.432 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T16:39:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T16:39:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:39:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T16:39:52.619 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T16:39:53.478 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T16:39:53.508 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T16:39:53.559 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T16:39:53.559 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:53.559 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T16:39:53.560 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T16:39:53.560 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T16:39:53.560 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T16:39:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T16:39:53.668 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:53.668 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T16:39:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:53.726 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T16:39:53.777 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T16:39:53.777 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:53.777 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T16:39:53.777 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T16:39:53.777 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T16:39:53.777 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:54.126 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T16:39:54.179 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T16:39:54.179 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:39:54.179 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T16:39:54.179 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T16:39:54.179 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T16:39:54.179 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:39:54.322 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:39:54.322 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:54.322 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2024-09-13T16:39:54.322 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T16:39:54.322 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T16:39:54.322 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T16:39:54.322 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T16:39:54.322 INFO:teuthology.orchestra.run.smithi094.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.322 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.323 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.324 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T16:39:54.325 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T16:39:54.326 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T16:39:54.327 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T16:39:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T16:39:54.329 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T16:39:54.330 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T16:39:54.331 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T16:39:54.332 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T16:39:54.333 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T16:39:54.333 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T16:39:54.333 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-09-13T16:39:54.747 DEBUG:teuthology.parallel:result is None 2024-09-13T16:39:57.666 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:39:57.666 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T16:39:57.666 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T16:39:57.666 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T16:39:57.666 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T16:39:57.667 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T16:39:57.668 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T16:39:57.669 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T16:39:57.670 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T16:39:57.671 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T16:39:57.672 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T16:39:57.673 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T16:39:57.674 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T16:39:57.675 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T16:39:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T16:39:57.677 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T16:39:57.677 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T16:39:57.677 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T16:39:57.677 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T16:39:57.677 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T16:39:57.677 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T16:39:57.677 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T16:39:57.677 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T16:39:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T16:39:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T16:39:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T16:39:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T16:39:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T16:39:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T16:39:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T16:39:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T16:39:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T16:39:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:39:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:39:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T16:40:00.353 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:40:00.353 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:40:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-09-13T16:40:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T16:40:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T16:40:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T16:40:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T16:40:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T16:40:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T16:40:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-13T16:40:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T16:40:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T16:40:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T16:40:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T16:40:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T16:40:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T16:40:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T16:40:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T16:40:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T16:40:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T16:40:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T16:40:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T16:40:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T16:40:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T16:40:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T16:40:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T16:40:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T16:40:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T16:40:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T16:40:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T16:40:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T16:40:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T16:40:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T16:40:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T16:40:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T16:40:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T16:40:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T16:40:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T16:40:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T16:40:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T16:40:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T16:40:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T16:40:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T16:40:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T16:40:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T16:40:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T16:40:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T16:40:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T16:40:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T16:40:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T16:40:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T16:40:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T16:40:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T16:40:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T16:40:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T16:40:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T16:40:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T16:40:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T16:40:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T16:40:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T16:40:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T16:40:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T16:40:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T16:40:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T16:40:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T16:40:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T16:40:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T16:40:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T16:40:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T16:40:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T16:40:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T16:40:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T16:40:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T16:40:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T16:40:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T16:40:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T16:40:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T16:40:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T16:40:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T16:40:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T16:40:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T16:40:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T16:40:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T16:40:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T16:40:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T16:40:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T16:40:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T16:40:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T16:40:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T16:40:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T16:40:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T16:40:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T16:40:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T16:40:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T16:40:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T16:40:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T16:40:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T16:40:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T16:40:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T16:40:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T16:40:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T16:40:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T16:40:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:40:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-13T16:40:00.763 DEBUG:teuthology.parallel:result is None 2024-09-13T16:40:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T16:40:01.336 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T16:40:01.395 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T16:40:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T16:40:01.539 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T16:40:01.565 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T16:40:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T16:40:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T16:40:01.733 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T16:40:01.733 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T16:40:01.826 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T16:40:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T16:40:01.867 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:40:01.867 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:40:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T16:40:02.120 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T16:40:02.212 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T16:40:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:40:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:40:02.491 INFO:teuthology.orchestra.run.smithi018.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T16:40:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:40:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T16:40:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T16:40:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T16:40:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T16:40:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T16:40:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T16:40:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T16:40:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T16:40:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T16:40:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T16:40:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T16:40:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T16:40:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T16:40:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T16:40:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T16:40:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T16:40:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T16:40:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T16:40:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T16:40:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T16:40:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T16:40:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T16:40:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T16:40:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T16:40:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T16:40:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T16:40:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T16:40:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T16:40:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T16:40:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T16:40:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T16:40:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T16:40:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T16:40:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T16:40:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T16:40:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T16:40:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T16:40:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T16:40:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T16:40:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T16:40:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T16:40:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T16:40:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T16:40:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T16:40:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T16:40:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T16:40:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T16:40:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T16:40:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T16:40:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T16:40:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T16:40:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T16:40:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T16:40:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T16:40:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T16:40:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T16:40:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T16:40:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T16:40:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T16:40:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T16:40:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T16:40:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T16:40:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T16:40:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T16:40:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T16:40:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T16:40:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T16:40:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T16:40:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T16:40:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T16:40:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T16:40:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T16:40:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T16:40:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T16:40:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T16:40:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T16:40:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T16:40:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T16:40:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T16:40:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T16:40:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T16:40:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T16:40:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T16:40:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T16:40:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T16:40:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T16:40:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T16:40:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T16:40:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T16:40:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T16:40:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T16:40:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T16:40:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T16:40:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T16:40:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T16:40:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T16:40:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T16:40:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T16:40:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T16:40:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T16:40:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T16:40:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T16:40:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T16:40:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T16:40:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T16:40:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T16:40:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T16:40:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T16:40:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T16:40:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T16:40:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T16:40:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T16:40:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T16:40:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T16:40:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T16:40:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T16:40:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:40:10.218 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-13T16:40:11.031 DEBUG:teuthology.parallel:result is None 2024-09-13T16:40:11.032 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:40:11.180 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T16:40:11.226 INFO:teuthology.orchestra.run.smithi018.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T16:40:11.226 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T16:40:11.227 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T16:40:11.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:40:11.378 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T16:40:11.404 INFO:teuthology.orchestra.run.smithi094.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T16:40:11.404 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T16:40:11.405 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T16:40:11.407 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:40:11.555 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T16:40:11.582 INFO:teuthology.orchestra.run.smithi144.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T16:40:11.582 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T16:40:11.582 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T16:40:11.584 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T16:40:11.584 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:40:11.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T16:40:11.644 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:40:11.644 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T16:40:11.677 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:40:11.678 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T16:40:11.710 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T16:40:11.710 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:40:11.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T16:40:11.766 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T16:40:11.864 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:40:11.864 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T16:40:11.894 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T16:40:11.962 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:40:11.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T16:40:11.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T16:40:12.062 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T16:40:12.062 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:40:12.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T16:40:12.119 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T16:40:12.215 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:40:12.215 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T16:40:12.240 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T16:40:12.305 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:40:12.305 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T16:40:12.335 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T16:40:12.405 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T16:40:12.405 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:40:12.405 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T16:40:12.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T16:40:12.560 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:40:12.560 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T16:40:12.585 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T16:40:12.650 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:40:12.651 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T16:40:12.680 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T16:40:12.749 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T16:40:12.852 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-13T16:40:12.852 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:40:12.853 INFO:tasks.cephadm:Cluster fsid is d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:40:12.853 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T16:40:12.853 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.18', 'mon.b': '172.21.15.94', 'mon.c': '172.21.15.144'} 2024-09-13T16:40:12.853 INFO:tasks.cephadm:First mon is mon.a on smithi018 2024-09-13T16:40:12.854 INFO:tasks.cephadm:First mgr is x 2024-09-13T16:40:12.854 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T16:40:12.854 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname $(hostname -s) 2024-09-13T16:40:12.910 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname $(hostname -s) 2024-09-13T16:40:12.935 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname $(hostname -s) 2024-09-13T16:40:12.965 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-13T16:40:12.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:40:13.120 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82946/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-850-g50bbe7f3', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-850.g50bbe7f3'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 12:31:04.094992', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.095512-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-13T16:40:13.272 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240910.095512-reef, sha1 50bbe7f395997dcd871813949c49addbbf630361 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:40:13.274 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm 2024-09-13T16:40:13.274 DEBUG:teuthology.orchestra.run.smithi018:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T16:40:13.649 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r--. 1 ubuntu ubuntu 217224 Sep 13 16:40 /home/ubuntu/cephtest/cephadm 2024-09-13T16:40:13.649 DEBUG:teuthology.orchestra.run.smithi094:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T16:40:13.991 INFO:teuthology.orchestra.run.smithi094.stdout:-rw-r--r--. 1 ubuntu ubuntu 217224 Sep 13 16:40 /home/ubuntu/cephtest/cephadm 2024-09-13T16:40:13.992 DEBUG:teuthology.orchestra.run.smithi144:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T16:40:14.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r--. 1 ubuntu ubuntu 217224 Sep 13 16:40 /home/ubuntu/cephtest/cephadm 2024-09-13T16:40:14.347 DEBUG:teuthology.orchestra.run.smithi018:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T16:40:14.389 DEBUG:teuthology.orchestra.run.smithi094:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T16:40:14.409 DEBUG:teuthology.orchestra.run.smithi144:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T16:40:14.455 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 on all hosts... 2024-09-13T16:40:14.455 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 pull 2024-09-13T16:40:14.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 pull 2024-09-13T16:40:14.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 pull 2024-09-13T16:40:16.004 INFO:teuthology.orchestra.run.smithi144.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T16:40:16.078 INFO:teuthology.orchestra.run.smithi094.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T16:40:16.439 INFO:teuthology.orchestra.run.smithi018.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T16:40:49.798 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T16:40:49.798 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T16:40:49.798 INFO:teuthology.orchestra.run.smithi018.stdout: "image_id": "152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c", 2024-09-13T16:40:49.798 INFO:teuthology.orchestra.run.smithi018.stdout: "repo_digests": [ 2024-09-13T16:40:49.798 INFO:teuthology.orchestra.run.smithi018.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a" 2024-09-13T16:40:49.798 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-13T16:40:49.799 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T16:41:06.554 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-13T16:41:06.554 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T16:41:06.555 INFO:teuthology.orchestra.run.smithi094.stdout: "image_id": "152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c", 2024-09-13T16:41:06.555 INFO:teuthology.orchestra.run.smithi094.stdout: "repo_digests": [ 2024-09-13T16:41:06.555 INFO:teuthology.orchestra.run.smithi094.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a" 2024-09-13T16:41:06.555 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-09-13T16:41:06.555 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-13T16:41:07.632 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-13T16:41:07.632 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T16:41:07.632 INFO:teuthology.orchestra.run.smithi144.stdout: "image_id": "152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c", 2024-09-13T16:41:07.632 INFO:teuthology.orchestra.run.smithi144.stdout: "repo_digests": [ 2024-09-13T16:41:07.632 INFO:teuthology.orchestra.run.smithi144.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a" 2024-09-13T16:41:07.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-13T16:41:07.632 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-13T16:41:07.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph 2024-09-13T16:41:07.715 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph 2024-09-13T16:41:07.748 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph 2024-09-13T16:41:07.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /etc/ceph 2024-09-13T16:41:07.835 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /etc/ceph 2024-09-13T16:41:07.863 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /etc/ceph 2024-09-13T16:41:07.888 INFO:tasks.cephadm:Writing seed config... 2024-09-13T16:41:07.889 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-13T16:41:07.890 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T16:41:07.891 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T16:41:07.891 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T16:41:07.891 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T16:41:07.891 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T16:41:07.891 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T16:41:07.891 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T16:41:07.891 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-13T16:41:07.891 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T16:41:07.891 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T16:41:07.891 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T16:41:07.892 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T16:41:07.893 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-13T16:41:07.893 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T16:41:07.893 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T16:41:07.893 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T16:41:07.893 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T16:41:07.893 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T16:41:07.893 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T16:41:07.893 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-13T16:41:07.893 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-13T16:41:07.894 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:41:07.894 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T16:41:07.931 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d8ff35a0-71ee-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T16:41:07.931 DEBUG:teuthology.orchestra.run.smithi018:mon.a> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.a.service 2024-09-13T16:41:07.976 DEBUG:teuthology.orchestra.run.smithi018:mgr.x> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.x.service 2024-09-13T16:41:08.020 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T16:41:08.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 -v bootstrap --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.18 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:41:08.226 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:41:08.226 INFO:teuthology.orchestra.run.smithi018.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361', '-v', 'bootstrap', '--fsid', 'd8ff35a0-71ee-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.18', '--skip-admin-label'] 2024-09-13T16:41:08.272 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 5.2.2 2024-09-13T16:41:08.272 INFO:teuthology.orchestra.run.smithi018.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T16:41:08.273 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying podman|docker is present... 2024-09-13T16:41:08.330 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 5.2.2 2024-09-13T16:41:08.330 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying lvm2 is present... 2024-09-13T16:41:08.330 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying time synchronization is in place... 2024-09-13T16:41:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T16:41:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T16:41:08.357 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T16:41:08.357 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-13T16:41:08.370 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout enabled 2024-09-13T16:41:08.383 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout active 2024-09-13T16:41:08.383 INFO:teuthology.orchestra.run.smithi018.stdout:Unit chronyd.service is enabled and running 2024-09-13T16:41:08.383 INFO:teuthology.orchestra.run.smithi018.stdout:Repeating the final host check... 2024-09-13T16:41:08.427 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 5.2.2 2024-09-13T16:41:08.427 INFO:teuthology.orchestra.run.smithi018.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T16:41:08.427 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl is present 2024-09-13T16:41:08.427 INFO:teuthology.orchestra.run.smithi018.stdout:lvcreate is present 2024-09-13T16:41:08.440 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T16:41:08.440 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T16:41:08.452 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T16:41:08.452 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-13T16:41:08.465 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout enabled 2024-09-13T16:41:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout active 2024-09-13T16:41:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:Unit chronyd.service is enabled and running 2024-09-13T16:41:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:Host looks OK 2024-09-13T16:41:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:Cluster fsid: d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:Acquiring lock 140389474515456 on /run/cephadm/d8ff35a0-71ee-11ef-bceb-c7b262605968.lock 2024-09-13T16:41:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:Lock 140389474515456 acquired on /run/cephadm/d8ff35a0-71ee-11ef-bceb-c7b262605968.lock 2024-09-13T16:41:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying IP 172.21.15.18 port 3300 ... 2024-09-13T16:41:08.479 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying IP 172.21.15.18 port 6789 ... 2024-09-13T16:41:08.479 INFO:teuthology.orchestra.run.smithi018.stdout:Base mon IP(s) is [172.21.15.18:3300, 172.21.15.18:6789], mon addrv is [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-13T16:41:08.486 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.18 metric 100 2024-09-13T16:41:08.486 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.18 metric 100 2024-09-13T16:41:08.492 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T16:41:08.492 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-13T16:41:08.492 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1793sec hoplimit 64 pref medium 2024-09-13T16:41:08.497 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T16:41:08.497 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T16:41:08.497 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T16:41:08.498 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-13T16:41:08.498 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-13T16:41:08.498 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T16:41:08.498 INFO:teuthology.orchestra.run.smithi018.stdout:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-09-13T16:41:08.498 INFO:teuthology.orchestra.run.smithi018.stdout:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-09-13T16:41:08.499 INFO:teuthology.orchestra.run.smithi018.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T16:41:08.499 INFO:teuthology.orchestra.run.smithi018.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T16:41:08.500 INFO:teuthology.orchestra.run.smithi018.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T16:41:09.021 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c 2024-09-13T16:41:09.021 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T16:41:09.022 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T16:41:09.022 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying blob sha256:3bf8bde7788a2a6694fefa78ba3da98c997a778335fd0748e145012f747287ae 2024-09-13T16:41:09.022 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T16:41:09.022 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying config sha256:152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c 2024-09-13T16:41:09.022 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T16:41:10.158 INFO:teuthology.orchestra.run.smithi018.stdout:ceph: stdout ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable) 2024-09-13T16:41:10.159 INFO:teuthology.orchestra.run.smithi018.stdout:Ceph version: ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable) 2024-09-13T16:41:10.159 INFO:teuthology.orchestra.run.smithi018.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T16:41:11.289 INFO:teuthology.orchestra.run.smithi018.stdout:stat: stdout 167 167 2024-09-13T16:41:11.289 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial keys... 2024-09-13T16:41:12.308 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQAna+RmXVNrKhAAim1U7MLGWToT9RUGWXOSag== 2024-09-13T16:41:13.442 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQAoa+RmpEHBKBAA2+WFD+nTVlQi9zjcDSpnTg== 2024-09-13T16:41:14.513 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQApa+RmN+v+MRAAMCjC4izSe74nUlSsrXEZTw== 2024-09-13T16:41:14.514 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial monmap... 2024-09-13T16:41:15.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T16:41:15.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T16:41:15.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:15.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T16:41:15.529 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool for a [v2:172.21.15.18:3300,v1:172.21.15.18:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T16:41:15.529 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = pacific 2024-09-13T16:41:15.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: set fsid to d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:15.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T16:41:15.529 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:41:15.529 INFO:teuthology.orchestra.run.smithi018.stdout:Creating mon... 2024-09-13T16:41:16.583 INFO:teuthology.orchestra.run.smithi018.stdout:create mon.a on 2024-09-13T16:41:16.906 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T16:41:17.127 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T16:41:17.497 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968.target. 2024-09-13T16:41:17.497 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968.target. 2024-09-13T16:41:17.823 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.a 2024-09-13T16:41:17.823 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-13T16:41:18.101 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968.target.wants/ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@.service. 2024-09-13T16:41:18.697 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:18 smithi018 podman[30593]: 2024-09-13 16:41:18.689814002 +0000 UTC m=+0.367583458 container init 0b87c6bc847c88ca35920e60ed14ea1f7a1a453c8b046af1119b58e0b0e5b641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:41:18.698 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:18 smithi018 podman[30593]: 2024-09-13 16:41:18.696233086 +0000 UTC m=+0.374002532 container start 0b87c6bc847c88ca35920e60ed14ea1f7a1a453c8b046af1119b58e0b0e5b641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T16:41:18.808 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:41:18.808 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-13T16:41:18.822 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:41:18.822 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-13T16:41:18.822 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-13T16:41:18.822 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T16:41:18.823 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mon to start... 2024-09-13T16:41:18.823 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mon... 2024-09-13T16:41:18.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:18 smithi018 ceph-mon[30612]: mkfs d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:18.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:18 smithi018 ceph-mon[30612]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T16:41:18.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:18 smithi018 bash[30593]: 0b87c6bc847c88ca35920e60ed14ea1f7a1a453c8b046af1119b58e0b0e5b641 2024-09-13T16:41:18.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:18 smithi018 systemd[1]: Started Ceph mon.a for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:41:20.183 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:19 smithi018 ceph-mon[30612]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T16:41:20.183 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:19 smithi018 ceph-mon[30612]: monmap e1: 1 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:41:20.183 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:19 smithi018 ceph-mon[30612]: fsmap 2024-09-13T16:41:20.183 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:19 smithi018 ceph-mon[30612]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T16:41:20.184 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:19 smithi018 ceph-mon[30612]: mgrmap e1: no daemons active 2024-09-13T16:41:20.184 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:19 smithi018 ceph-mon[30612]: from='client.? 172.21.15.18:0/2933860064' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T16:41:20.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T16:41:20.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout id: d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:20.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T16:41:20.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:20.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout services: 2024-09-13T16:41:20.256 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.649969s) 2024-09-13T16:41:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T16:41:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T16:41:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout data: 2024-09-13T16:41:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T16:41:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T16:41:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T16:41:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T16:41:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.325+0000 7f17c3400640 1 Processor -- start 2024-09-13T16:41:20.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.325+0000 7f17c3400640 1 -- start start 2024-09-13T16:41:20.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.325+0000 7f17c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:20.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.325+0000 7f17c3400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc108210 con 0x7f17bc107840 2024-09-13T16:41:20.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.326+0000 7f17c0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:20.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.326+0000 7f17c0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48512/0 (socket says 172.21.15.18:48512) 2024-09-13T16:41:20.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.326+0000 7f17c0a00640 1 -- 172.21.15.18:0/1111199759 learned_addr learned my addr 172.21.15.18:0/1111199759 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:20.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.327+0000 7f17c0a00640 1 -- 172.21.15.18:0/1111199759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc108900 con 0x7f17bc107840 2024-09-13T16:41:20.258 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.329+0000 7f17c0a00640 1 --2- 172.21.15.18:0/1111199759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc107c40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009820 tx=0x7f17b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c1b36a6ad072e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:20.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.330+0000 7f17bb400640 1 -- 172.21.15.18:0/1111199759 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17b002ae70 con 0x7f17bc107840 2024-09-13T16:41:20.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.330+0000 7f17bb400640 1 -- 172.21.15.18:0/1111199759 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0032440 con 0x7f17bc107840 2024-09-13T16:41:20.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.330+0000 7f17bb400640 1 -- 172.21.15.18:0/1111199759 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17b0032700 con 0x7f17bc107840 2024-09-13T16:41:20.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.330+0000 7f17c3400640 1 -- 172.21.15.18:0/1111199759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 msgr2=0x7f17bc107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:20.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.330+0000 7f17c3400640 1 --2- 172.21.15.18:0/1111199759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc107c40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009820 tx=0x7f17b002a270 comp rx=0 tx=0).stop 2024-09-13T16:41:20.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.331+0000 7f17c3400640 1 -- 172.21.15.18:0/1111199759 shutdown_connections 2024-09-13T16:41:20.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.331+0000 7f17c3400640 1 --2- 172.21.15.18:0/1111199759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc107c40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:20.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.331+0000 7f17c3400640 1 -- 172.21.15.18:0/1111199759 >> 172.21.15.18:0/1111199759 conn(0x7f17bc07ad00 msgr2=0x7f17bc07b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:20.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.331+0000 7f17c3400640 1 -- 172.21.15.18:0/1111199759 shutdown_connections 2024-09-13T16:41:20.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.331+0000 7f17c3400640 1 -- 172.21.15.18:0/1111199759 wait complete. 2024-09-13T16:41:20.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.332+0000 7f17c3400640 1 Processor -- start 2024-09-13T16:41:20.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.332+0000 7f17c3400640 1 -- start start 2024-09-13T16:41:20.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.332+0000 7f17c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:20.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.332+0000 7f17c3400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc19b1b0 con 0x7f17bc107840 2024-09-13T16:41:20.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.332+0000 7f17c0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:20.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.332+0000 7f17c0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc19ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48516/0 (socket says 172.21.15.18:48516) 2024-09-13T16:41:20.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.332+0000 7f17c0a00640 1 -- 172.21.15.18:0/2933860064 learned_addr learned my addr 172.21.15.18:0/2933860064 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:20.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.333+0000 7f17c0a00640 1 -- 172.21.15.18:0/2933860064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b00094d0 con 0x7f17bc107840 2024-09-13T16:41:20.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.333+0000 7f17c0a00640 1 --2- 172.21.15.18:0/2933860064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc19ac70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f17b00090b0 tx=0x7f17b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:20.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.333+0000 7f17b9600640 1 -- 172.21.15.18:0/2933860064 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17b00308d0 con 0x7f17bc107840 2024-09-13T16:41:20.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.333+0000 7f17b9600640 1 -- 172.21.15.18:0/2933860064 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0030a30 con 0x7f17bc107840 2024-09-13T16:41:20.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.333+0000 7f17b9600640 1 -- 172.21.15.18:0/2933860064 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17b0030cf0 con 0x7f17bc107840 2024-09-13T16:41:20.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.333+0000 7f17c3400640 1 -- 172.21.15.18:0/2933860064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17bc19b3b0 con 0x7f17bc107840 2024-09-13T16:41:20.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.334+0000 7f17c3400640 1 -- 172.21.15.18:0/2933860064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17bc19b850 con 0x7f17bc107840 2024-09-13T16:41:20.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.334+0000 7f17b9600640 1 -- 172.21.15.18:0/2933860064 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f17b0039040 con 0x7f17bc107840 2024-09-13T16:41:20.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.334+0000 7f17b9600640 1 -- 172.21.15.18:0/2933860064 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f17b00468c0 con 0x7f17bc107840 2024-09-13T16:41:20.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.335+0000 7f17c3400640 1 -- 172.21.15.18:0/2933860064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17bc1094b0 con 0x7f17bc107840 2024-09-13T16:41:20.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.338+0000 7f17b9600640 1 -- 172.21.15.18:0/2933860064 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f17b0037070 con 0x7f17bc107840 2024-09-13T16:41:20.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.402+0000 7f17c3400640 1 -- 172.21.15.18:0/2933860064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f17bc19e130 con 0x7f17bc107840 2024-09-13T16:41:20.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.402+0000 7f17b9600640 1 -- 172.21.15.18:0/2933860064 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f17b0046ad0 con 0x7f17bc107840 2024-09-13T16:41:20.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.403+0000 7f17c3400640 1 -- 172.21.15.18:0/2933860064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 msgr2=0x7f17bc19ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:20.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.403+0000 7f17c3400640 1 --2- 172.21.15.18:0/2933860064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc19ac70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f17b00090b0 tx=0x7f17b00046c0 comp rx=0 tx=0).stop 2024-09-13T16:41:20.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.403+0000 7f17c3400640 1 -- 172.21.15.18:0/2933860064 shutdown_connections 2024-09-13T16:41:20.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.403+0000 7f17c3400640 1 --2- 172.21.15.18:0/2933860064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc107840 0x7f17bc19ac70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:20.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.403+0000 7f17c3400640 1 -- 172.21.15.18:0/2933860064 >> 172.21.15.18:0/2933860064 conn(0x7f17bc07ad00 msgr2=0x7f17bc18f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:20.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.403+0000 7f17c3400640 1 -- 172.21.15.18:0/2933860064 shutdown_connections 2024-09-13T16:41:20.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:19.403+0000 7f17c3400640 1 -- 172.21.15.18:0/2933860064 wait complete. 2024-09-13T16:41:20.262 INFO:teuthology.orchestra.run.smithi018.stdout:mon is available 2024-09-13T16:41:20.262 INFO:teuthology.orchestra.run.smithi018.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T16:41:21.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:20 smithi018 ceph-mon[30612]: from='client.? 172.21.15.18:0/3676828973' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T16:41:21.176 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:20 smithi018 ceph-mon[30612]: from='client.? 172.21.15.18:0/3676828973' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T16:41:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T16:41:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout fsid = d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-13T16:41:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T16:41:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T16:41:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T16:41:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T16:41:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T16:41:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.774+0000 7f9117e00640 1 Processor -- start 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.774+0000 7f9117e00640 1 -- start start 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.775+0000 7f9117e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f9118107c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.775+0000 7f9117e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9118108250 con 0x7f9118107880 2024-09-13T16:41:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.775+0000 7f9116a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f9118107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.775+0000 7f9116a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f9118107c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48520/0 (socket says 172.21.15.18:48520) 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.775+0000 7f9116a00640 1 -- 172.21.15.18:0/1424635203 learned_addr learned my addr 172.21.15.18:0/1424635203 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.776+0000 7f9116a00640 1 -- 172.21.15.18:0/1424635203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118108770 con 0x7f9118107880 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.777+0000 7f9116a00640 1 --2- 172.21.15.18:0/1424635203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f9118107c80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9108009820 tx=0x7f910802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3f10f225e861cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.777+0000 7f9115600640 1 -- 172.21.15.18:0/1424635203 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f910802ae70 con 0x7f9118107880 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.777+0000 7f9115600640 1 -- 172.21.15.18:0/1424635203 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9108032440 con 0x7f9118107880 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.777+0000 7f9115600640 1 -- 172.21.15.18:0/1424635203 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9108032700 con 0x7f9118107880 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.778+0000 7f9117e00640 1 -- 172.21.15.18:0/1424635203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 msgr2=0x7f9118107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.778+0000 7f9117e00640 1 --2- 172.21.15.18:0/1424635203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f9118107c80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9108009820 tx=0x7f910802a270 comp rx=0 tx=0).stop 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.778+0000 7f9117e00640 1 -- 172.21.15.18:0/1424635203 shutdown_connections 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.778+0000 7f9117e00640 1 --2- 172.21.15.18:0/1424635203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f9118107c80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.778+0000 7f9117e00640 1 -- 172.21.15.18:0/1424635203 >> 172.21.15.18:0/1424635203 conn(0x7f911807ab90 msgr2=0x7f911807afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.778+0000 7f9117e00640 1 -- 172.21.15.18:0/1424635203 shutdown_connections 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.778+0000 7f9117e00640 1 -- 172.21.15.18:0/1424635203 wait complete. 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.779+0000 7f9117e00640 1 Processor -- start 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.779+0000 7f9117e00640 1 -- start start 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.780+0000 7f9117e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f911819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.780+0000 7f9117e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911819afc0 con 0x7f9118107880 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.780+0000 7f9116a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f911819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.780+0000 7f9116a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f911819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48524/0 (socket says 172.21.15.18:48524) 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.780+0000 7f9116a00640 1 -- 172.21.15.18:0/3676828973 learned_addr learned my addr 172.21.15.18:0/3676828973 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.780+0000 7f9116a00640 1 -- 172.21.15.18:0/3676828973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91080094d0 con 0x7f9118107880 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.781+0000 7f9116a00640 1 --2- 172.21.15.18:0/3676828973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f911819aa80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f91080090b0 tx=0x7f91080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.781+0000 7f910f400640 1 -- 172.21.15.18:0/3676828973 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91080308d0 con 0x7f9118107880 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.781+0000 7f910f400640 1 -- 172.21.15.18:0/3676828973 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9108030a30 con 0x7f9118107880 2024-09-13T16:41:21.485 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.781+0000 7f910f400640 1 -- 172.21.15.18:0/3676828973 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9108030cf0 con 0x7f9118107880 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.781+0000 7f9117e00640 1 -- 172.21.15.18:0/3676828973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911819b1c0 con 0x7f9118107880 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.781+0000 7f9117e00640 1 -- 172.21.15.18:0/3676828973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911819b660 con 0x7f9118107880 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.782+0000 7f910f400640 1 -- 172.21.15.18:0/3676828973 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9108039040 con 0x7f9118107880 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.782+0000 7f910f400640 1 -- 172.21.15.18:0/3676828973 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f91080468c0 con 0x7f9118107880 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.783+0000 7f9117e00640 1 -- 172.21.15.18:0/3676828973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91181093b0 con 0x7f9118107880 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.785+0000 7f910f400640 1 -- 172.21.15.18:0/3676828973 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f9108037070 con 0x7f9118107880 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.853+0000 7f9117e00640 1 -- 172.21.15.18:0/3676828973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f911819df40 con 0x7f9118107880 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.857+0000 7f910f400640 1 -- 172.21.15.18:0/3676828973 <== mon.0 v2:172.21.15.18:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f910804e820 con 0x7f9118107880 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.857+0000 7f910f400640 1 -- 172.21.15.18:0/3676828973 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f9108046bc0 con 0x7f9118107880 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.859+0000 7f9117e00640 1 -- 172.21.15.18:0/3676828973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 msgr2=0x7f911819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.859+0000 7f9117e00640 1 --2- 172.21.15.18:0/3676828973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f911819aa80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f91080090b0 tx=0x7f91080046c0 comp rx=0 tx=0).stop 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.859+0000 7f9117e00640 1 -- 172.21.15.18:0/3676828973 shutdown_connections 2024-09-13T16:41:21.486 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.859+0000 7f9117e00640 1 --2- 172.21.15.18:0/3676828973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9118107880 0x7f911819aa80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:21.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.859+0000 7f9117e00640 1 -- 172.21.15.18:0/3676828973 >> 172.21.15.18:0/3676828973 conn(0x7f911807ab90 msgr2=0x7f911818f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:21.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.859+0000 7f9117e00640 1 -- 172.21.15.18:0/3676828973 shutdown_connections 2024-09-13T16:41:21.487 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:20.859+0000 7f9117e00640 1 -- 172.21.15.18:0/3676828973 wait complete. 2024-09-13T16:41:21.487 INFO:teuthology.orchestra.run.smithi018.stdout:Generating new minimal ceph.conf... 2024-09-13T16:41:22.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:22 smithi018 ceph-mon[30612]: from='client.? 172.21.15.18:0/811274244' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:41:22.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.969+0000 7f15fee00640 1 Processor -- start 2024-09-13T16:41:22.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.970+0000 7f15fee00640 1 -- start start 2024-09-13T16:41:22.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.970+0000 7f15fee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f8107c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:22.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.970+0000 7f15fee00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8108250 con 0x7f15f8107880 2024-09-13T16:41:22.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.971+0000 7f15fda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f8107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:22.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.971+0000 7f15fda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f8107c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56402/0 (socket says 172.21.15.18:56402) 2024-09-13T16:41:22.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.971+0000 7f15fda00640 1 -- 172.21.15.18:0/2593645536 learned_addr learned my addr 172.21.15.18:0/2593645536 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:22.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.971+0000 7f15fda00640 1 -- 172.21.15.18:0/2593645536 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f8108770 con 0x7f15f8107880 2024-09-13T16:41:22.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.972+0000 7f15fda00640 1 --2- 172.21.15.18:0/2593645536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f8107c80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009820 tx=0x7f15ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb07c166486d5e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.972+0000 7f15f7e00640 1 -- 172.21.15.18:0/2593645536 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15ec02ae70 con 0x7f15f8107880 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.972+0000 7f15f7e00640 1 -- 172.21.15.18:0/2593645536 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15ec0328e0 con 0x7f15f8107880 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.972+0000 7f15f7e00640 1 -- 172.21.15.18:0/2593645536 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15ec0308c0 con 0x7f15f8107880 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.973+0000 7f15fee00640 1 -- 172.21.15.18:0/2593645536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 msgr2=0x7f15f8107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.973+0000 7f15fee00640 1 --2- 172.21.15.18:0/2593645536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f8107c80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009820 tx=0x7f15ec02a270 comp rx=0 tx=0).stop 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.973+0000 7f15fee00640 1 -- 172.21.15.18:0/2593645536 shutdown_connections 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.973+0000 7f15fee00640 1 --2- 172.21.15.18:0/2593645536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f8107c80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.973+0000 7f15fee00640 1 -- 172.21.15.18:0/2593645536 >> 172.21.15.18:0/2593645536 conn(0x7f15f807ab90 msgr2=0x7f15f807afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.973+0000 7f15fee00640 1 -- 172.21.15.18:0/2593645536 shutdown_connections 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.973+0000 7f15fee00640 1 -- 172.21.15.18:0/2593645536 wait complete. 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.974+0000 7f15fee00640 1 Processor -- start 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.974+0000 7f15fee00640 1 -- start start 2024-09-13T16:41:22.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.974+0000 7f15fee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.974+0000 7f15fee00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f819b840 con 0x7f15f8107880 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.975+0000 7f15fda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.975+0000 7f15fda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f819b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56418/0 (socket says 172.21.15.18:56418) 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.975+0000 7f15fda00640 1 -- 172.21.15.18:0/811274244 learned_addr learned my addr 172.21.15.18:0/811274244 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.975+0000 7f15fda00640 1 -- 172.21.15.18:0/811274244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec0094d0 con 0x7f15f8107880 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.975+0000 7f15fda00640 1 --2- 172.21.15.18:0/811274244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f819b300 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f15ec02a790 tx=0x7f15ec030e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.976+0000 7f15f6000640 1 -- 172.21.15.18:0/811274244 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15ec032d90 con 0x7f15f8107880 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.976+0000 7f15f6000640 1 -- 172.21.15.18:0/811274244 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15ec03b8d0 con 0x7f15f8107880 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.976+0000 7f15f6000640 1 -- 172.21.15.18:0/811274244 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15ec03a800 con 0x7f15f8107880 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.976+0000 7f15fee00640 1 -- 172.21.15.18:0/811274244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f819ba40 con 0x7f15f8107880 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.976+0000 7f15fee00640 1 -- 172.21.15.18:0/811274244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f819bee0 con 0x7f15f8107880 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.976+0000 7f15f6000640 1 -- 172.21.15.18:0/811274244 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f15ec039040 con 0x7f15f8107880 2024-09-13T16:41:22.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.976+0000 7f15f6000640 1 -- 172.21.15.18:0/811274244 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f15ec04c690 con 0x7f15f8107880 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.977+0000 7f15fee00640 1 -- 172.21.15.18:0/811274244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f810b9a0 con 0x7f15f8107880 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:21.980+0000 7f15f6000640 1 -- 172.21.15.18:0/811274244 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f15ec049060 con 0x7f15f8107880 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:22.041+0000 7f15fee00640 1 -- 172.21.15.18:0/811274244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f15f810bb60 con 0x7f15f8107880 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:22.042+0000 7f15f6000640 1 -- 172.21.15.18:0/811274244 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f15ec03f070 con 0x7f15f8107880 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:22.043+0000 7f15fee00640 1 -- 172.21.15.18:0/811274244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 msgr2=0x7f15f819b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:22.043+0000 7f15fee00640 1 --2- 172.21.15.18:0/811274244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f819b300 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f15ec02a790 tx=0x7f15ec030e20 comp rx=0 tx=0).stop 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:22.043+0000 7f15fee00640 1 -- 172.21.15.18:0/811274244 shutdown_connections 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:22.043+0000 7f15fee00640 1 --2- 172.21.15.18:0/811274244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8107880 0x7f15f819b300 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:22.043+0000 7f15fee00640 1 -- 172.21.15.18:0/811274244 >> 172.21.15.18:0/811274244 conn(0x7f15f807ab90 msgr2=0x7f15f8105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:22.043+0000 7f15fee00640 1 -- 172.21.15.18:0/811274244 shutdown_connections 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:22.043+0000 7f15fee00640 1 -- 172.21.15.18:0/811274244 wait complete. 2024-09-13T16:41:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:Restarting the monitor... 2024-09-13T16:41:22.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:22 smithi018 systemd[1]: Stopping Ceph mon.a for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:41:23.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:23 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a[30608]: 2024-09-13T16:41:23.113+0000 7f18cfc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:41:23.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:23 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a[30608]: 2024-09-13T16:41:23.113+0000 7f18cfc00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T16:41:23.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:23 smithi018 podman[30862]: 2024-09-13 16:41:23.257619135 +0000 UTC m=+0.315606996 container died 0b87c6bc847c88ca35920e60ed14ea1f7a1a453c8b046af1119b58e0b0e5b641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True) 2024-09-13T16:41:23.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:23 smithi018 podman[30862]: 2024-09-13 16:41:23.652877564 +0000 UTC m=+0.710865425 container cleanup 0b87c6bc847c88ca35920e60ed14ea1f7a1a453c8b046af1119b58e0b0e5b641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T16:41:23.930 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:23 smithi018 bash[30862]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a 2024-09-13T16:41:24.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:23 smithi018 podman[30876]: 2024-09-13 16:41:23.928755418 +0000 UTC m=+0.657807336 container remove 0b87c6bc847c88ca35920e60ed14ea1f7a1a453c8b046af1119b58e0b0e5b641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:41:24.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-13T16:41:24.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 systemd[1]: Stopped Ceph mon.a for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:41:24.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.a.service: Consumed 1.210s CPU time. 2024-09-13T16:41:24.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 systemd[1]: Starting Ceph mon.a for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:41:24.666 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 podman[30962]: 2024-09-13 16:41:24.311978758 +0000 UTC m=+0.027526989 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:41:24.666 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 podman[30962]: 2024-09-13 16:41:24.420904817 +0000 UTC m=+0.136453023 container create c24cf9be08e7bcf6005ae438f1ec5511125340a6bac1982c80134f412545839e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T16:41:24.666 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 podman[30962]: 2024-09-13 16:41:24.623263515 +0000 UTC m=+0.338811744 container init c24cf9be08e7bcf6005ae438f1ec5511125340a6bac1982c80134f412545839e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:41:24.666 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 podman[30962]: 2024-09-13 16:41:24.629967899 +0000 UTC m=+0.345516116 container start c24cf9be08e7bcf6005ae438f1ec5511125340a6bac1982c80134f412545839e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T16:41:24.749 INFO:teuthology.orchestra.run.smithi018.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T16:41:24.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T16:41:24.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable), process ceph-mon, pid 2 2024-09-13T16:41:24.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: pidfile_write: ignore empty --pid-file 2024-09-13T16:41:24.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: load: jerasure load: lrc 2024-09-13T16:41:24.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: RocksDB version: 7.9.2 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Git sha 0 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Compile date 2024-09-10 11:17:42 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: DB SUMMARY 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: DB Session ID: X1JTCQZX1ENAKNNALXTW 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: CURRENT file: CURRENT 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 98733 ; 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.error_if_exists: 0 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.create_if_missing: 0 2024-09-13T16:41:24.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.paranoid_checks: 1 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.env: 0x564ebd02bbc0 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.info_log: 0x564ec8636b40 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.statistics: (nil) 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.use_fsync: 0 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_log_file_size: 0 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T16:41:24.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.allow_fallocate: 1 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.use_direct_reads: 0 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.db_log_dir: 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.wal_dir: 2024-09-13T16:41:24.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T16:41:24.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T16:41:24.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T16:41:24.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T16:41:24.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T16:41:24.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T16:41:24.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T16:41:24.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T16:41:24.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.write_buffer_manager: 0x564ec8644320 2024-09-13T16:41:24.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T16:41:24.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.unordered_write: 0 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.row_cache: None 2024-09-13T16:41:24.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.wal_filter: None 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.two_write_queues: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.wal_compression: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.atomic_flush: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.log_readahead_size: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T16:41:24.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_background_jobs: 2 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_background_compactions: -1 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_subcompactions: 1 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T16:41:24.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_open_files: -1 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_background_flushes: -1 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Compression algorithms supported: 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: kZSTD supported: 0 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: kXpressCompression supported: 0 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: kBZip2Compression supported: 0 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T16:41:24.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: kLZ4Compression supported: 1 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: kZlibCompression supported: 1 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: kSnappyCompression supported: 1 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.merge_operator: 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_filter: None 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T16:41:24.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564ec8636760) 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: cache_index_and_filter_blocks: 1 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: pin_top_level_index_and_filter: 1 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_type: 0 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: data_block_index_type: 0 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_shortening: 1 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: checksum: 4 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: no_block_cache: 0 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache: 0x564ec862b1f0 2024-09-13T16:41:24.971 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_name: BinnedLRUCache 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_options: 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: capacity : 536870912 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: num_shard_bits : 4 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: strict_capacity_limit : 0 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: high_pri_pool_ratio: 0.000 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_compressed: (nil) 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: persistent_cache: (nil) 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_size: 4096 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_size_deviation: 10 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_restart_interval: 16 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_block_restart_interval: 1 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: metadata_block_size: 4096 2024-09-13T16:41:24.972 INFO:journalctl@ceph.mon.a.smithi018.stdout: partition_filters: 0 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: use_delta_encoding: 1 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: filter_policy: bloomfilter 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: whole_key_filtering: 1 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: verify_compression: 0 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: read_amp_bytes_per_bit: 0 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: format_version: 5 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: enable_index_compression: 1 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_align: 0 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: max_auto_readahead_size: 262144 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: prepopulate_block_cache: 0 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: initial_auto_readahead_size: 8192 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T16:41:24.973 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compression: NoCompression 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.num_levels: 7 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T16:41:24.974 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T16:41:24.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T16:41:24.976 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T16:41:24.977 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.inplace_update_support: 0 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.bloom_locality: 0 2024-09-13T16:41:24.978 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.max_successive_merges: 0 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.ttl: 2592000 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.enable_blob_files: false 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.min_blob_size: 0 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T16:41:24.979 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 86461697-06be-4ad6-bf89-d63baddcd8a0 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726245684672626, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726245684674707, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93996, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 314, "table_properties": {"data_size": 91975, "index_size": 277, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13626, "raw_average_key_size": 49, "raw_value_size": 84558, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 273, "num_filter_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726245684, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "86461697-06be-4ad6-bf89-d63baddcd8a0", "db_session_id": "X1JTCQZX1ENAKNNALXTW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726245684674886, "job": 1, "event": "recovery_finished"} 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T16:41:24.980 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564ec8658e00 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: DB pointer 0x564ec874c000 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** DB Stats ** 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T16:41:24.981 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** Compaction Stats [default] ** 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: L0 2/0 93.65 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 60.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: Sum 2/0 93.65 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 60.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 60.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** Compaction Stats [default] ** 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 60.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-13T16:41:24.982 INFO:journalctl@ceph.mon.a.smithi018.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative compaction: 0.00 GB write, 14.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval compaction: 0.00 GB write, 14.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: Block cache BinnedLRUCache@0x564ec862b1f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-13T16:41:24.983 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: starting mon.a rank 0 at public addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] at bind addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: mon.a@-1(???) e1 preinit fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: mon.a@-1(???).mds e1 new map 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: mon.a@-1(???).mds e1 print_map 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout: e1 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout: legacy client fscid: -1 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout: No filesystems configured 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:41:24.984 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:41:24.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:41:24.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T16:41:24.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T16:41:24.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: monmap e1: 1 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:41:24.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: fsmap 2024-09-13T16:41:24.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T16:41:24.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 ceph-mon[30981]: mgrmap e1: no daemons active 2024-09-13T16:41:24.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 bash[30962]: c24cf9be08e7bcf6005ae438f1ec5511125340a6bac1982c80134f412545839e 2024-09-13T16:41:24.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:24 smithi018 systemd[1]: Started Ceph mon.a for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:41:25.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.286+0000 7f4fee800640 1 Processor -- start 2024-09-13T16:41:25.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.286+0000 7f4fee800640 1 -- start start 2024-09-13T16:41:25.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.287+0000 7f4fee800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe8105720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:25.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.287+0000 7f4fee800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8105cf0 con 0x7f4fe8105320 2024-09-13T16:41:25.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.287+0000 7f4fed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe8105720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.288+0000 7f4fed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe8105720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56430/0 (socket says 172.21.15.18:56430) 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.288+0000 7f4fed400640 1 -- 172.21.15.18:0/801947514 learned_addr learned my addr 172.21.15.18:0/801947514 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.288+0000 7f4fed400640 1 -- 172.21.15.18:0/801947514 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe8106520 con 0x7f4fe8105320 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.290+0000 7f4fed400640 1 --2- 172.21.15.18:0/801947514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe8105720 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009820 tx=0x7f4fdc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f11496873906549 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.291+0000 7f4fe7e00640 1 -- 172.21.15.18:0/801947514 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fdc02ae70 con 0x7f4fe8105320 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.291+0000 7f4fe7e00640 1 -- 172.21.15.18:0/801947514 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4fdc0328e0 con 0x7f4fe8105320 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.291+0000 7f4fe7e00640 1 -- 172.21.15.18:0/801947514 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fdc0308c0 con 0x7f4fe8105320 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.291+0000 7f4fee800640 1 -- 172.21.15.18:0/801947514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 msgr2=0x7f4fe8105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.291+0000 7f4fee800640 1 --2- 172.21.15.18:0/801947514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe8105720 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009820 tx=0x7f4fdc02a270 comp rx=0 tx=0).stop 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.292+0000 7f4fee800640 1 -- 172.21.15.18:0/801947514 shutdown_connections 2024-09-13T16:41:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.292+0000 7f4fee800640 1 --2- 172.21.15.18:0/801947514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe8105720 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.292+0000 7f4fee800640 1 -- 172.21.15.18:0/801947514 >> 172.21.15.18:0/801947514 conn(0x7f4fe8100b10 msgr2=0x7f4fe8102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.292+0000 7f4fee800640 1 -- 172.21.15.18:0/801947514 shutdown_connections 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.292+0000 7f4fee800640 1 -- 172.21.15.18:0/801947514 wait complete. 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.293+0000 7f4fee800640 1 Processor -- start 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.293+0000 7f4fee800640 1 -- start start 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.293+0000 7f4fee800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe807baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.293+0000 7f4fee800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe807c030 con 0x7f4fe8105320 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.293+0000 7f4fed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe807baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.293+0000 7f4fed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe807baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56444/0 (socket says 172.21.15.18:56444) 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.293+0000 7f4fed400640 1 -- 172.21.15.18:0/2415050613 learned_addr learned my addr 172.21.15.18:0/2415050613 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.294+0000 7f4fed400640 1 -- 172.21.15.18:0/2415050613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc0094d0 con 0x7f4fe8105320 2024-09-13T16:41:26.001 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.294+0000 7f4fed400640 1 --2- 172.21.15.18:0/2415050613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe807baf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0305d0 tx=0x7f4fdc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.294+0000 7f4fe6000640 1 -- 172.21.15.18:0/2415050613 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fdc032c60 con 0x7f4fe8105320 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.294+0000 7f4fe6000640 1 -- 172.21.15.18:0/2415050613 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4fdc032dc0 con 0x7f4fe8105320 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.294+0000 7f4fee800640 1 -- 172.21.15.18:0/2415050613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe807a220 con 0x7f4fe8105320 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.294+0000 7f4fe6000640 1 -- 172.21.15.18:0/2415050613 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fdc03a770 con 0x7f4fe8105320 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.294+0000 7f4fee800640 1 -- 172.21.15.18:0/2415050613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe807a6c0 con 0x7f4fe8105320 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.295+0000 7f4fe6000640 1 -- 172.21.15.18:0/2415050613 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4fdc039040 con 0x7f4fe8105320 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.295+0000 7f4fe6000640 1 -- 172.21.15.18:0/2415050613 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4fdc0426a0 con 0x7f4fe8105320 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.296+0000 7f4fee800640 1 -- 172.21.15.18:0/2415050613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe8109750 con 0x7f4fe8105320 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.298+0000 7f4fe6000640 1 -- 172.21.15.18:0/2415050613 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4fdc049060 con 0x7f4fe8105320 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.359+0000 7f4fee800640 1 -- 172.21.15.18:0/2415050613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f4fe807ab80 con 0x7f4fe8105320 2024-09-13T16:41:26.002 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.362+0000 7f4fe6000640 1 -- 172.21.15.18:0/2415050613 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4fdc03f070 con 0x7f4fe8105320 2024-09-13T16:41:26.003 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.363+0000 7f4fee800640 1 -- 172.21.15.18:0/2415050613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 msgr2=0x7f4fe807baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:26.003 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.363+0000 7f4fee800640 1 --2- 172.21.15.18:0/2415050613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe807baf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0305d0 tx=0x7f4fdc032670 comp rx=0 tx=0).stop 2024-09-13T16:41:26.003 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.363+0000 7f4fee800640 1 -- 172.21.15.18:0/2415050613 shutdown_connections 2024-09-13T16:41:26.003 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.363+0000 7f4fee800640 1 --2- 172.21.15.18:0/2415050613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8105320 0x7f4fe807baf0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:26.003 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.363+0000 7f4fee800640 1 -- 172.21.15.18:0/2415050613 >> 172.21.15.18:0/2415050613 conn(0x7f4fe8100b10 msgr2=0x7f4fe8101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:26.003 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.363+0000 7f4fee800640 1 -- 172.21.15.18:0/2415050613 shutdown_connections 2024-09-13T16:41:26.003 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:25.363+0000 7f4fee800640 1 -- 172.21.15.18:0/2415050613 wait complete. 2024-09-13T16:41:26.003 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T16:41:26.021 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:41:26.022 INFO:teuthology.orchestra.run.smithi018.stdout:Creating mgr... 2024-09-13T16:41:26.022 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T16:41:26.022 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T16:41:26.377 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.x 2024-09-13T16:41:26.377 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-13T16:41:26.629 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968.target.wants/ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@.service. 2024-09-13T16:41:26.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:26 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2415050613' entity='client.admin' 2024-09-13T16:41:26.960 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:26 smithi018 systemd[1]: Starting Ceph mgr.x for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:41:27.276 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:26 smithi018 podman[31191]: 2024-09-13 16:41:26.874846788 +0000 UTC m=+0.027394587 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:41:27.276 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:26 smithi018 podman[31191]: 2024-09-13 16:41:26.985916519 +0000 UTC m=+0.138464306 container create 51593b5170330b9888f9de3027413f6411bc2030ed57b9210022d6460d3d991f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T16:41:27.277 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:27 smithi018 podman[31191]: 2024-09-13 16:41:27.209930142 +0000 UTC m=+0.362477948 container init 51593b5170330b9888f9de3027413f6411bc2030ed57b9210022d6460d3d991f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T16:41:27.277 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:27 smithi018 podman[31191]: 2024-09-13 16:41:27.216291045 +0000 UTC m=+0.368838833 container start 51593b5170330b9888f9de3027413f6411bc2030ed57b9210022d6460d3d991f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T16:41:27.277 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:27 smithi018 bash[31191]: 51593b5170330b9888f9de3027413f6411bc2030ed57b9210022d6460d3d991f 2024-09-13T16:41:27.306 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:41:27.306 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-13T16:41:27.322 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:41:27.322 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-13T16:41:27.322 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-13T16:41:27.322 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T16:41:27.341 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:41:27.341 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-13T16:41:27.357 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:41:27.357 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-13T16:41:27.357 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-13T16:41:27.357 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-13T16:41:27.357 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr to start... 2024-09-13T16:41:27.357 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr... 2024-09-13T16:41:27.561 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:27 smithi018 systemd[1]: Started Ceph mgr.x for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:41:27.561 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:27 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:27.409+0000 7fe133a9a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:41:27.561 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:27 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:27.487+0000 7fe133a9a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:41:27.813 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:27 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:27.687+0000 7fe133a9a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:41:27.813 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:27 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:27.769+0000 7fe133a9a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:41:28.126 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:28 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4106733492' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T16:41:28.127 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:27 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:27.949+0000 7fe133a9a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:41:28.127 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:28 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:28.124+0000 7fe133a9a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:41:28.691 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:28 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:28.507+0000 7fe133a9a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:41:28.691 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:28 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:28.581+0000 7fe133a9a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:41:28.699 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:28.701 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:41:28.701 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "d8ff35a0-71ee-11ef-bceb-c7b262605968", 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:41:28.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-13T16:41:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T16:41:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T16:41:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T16:41:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T16:41:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T16:41:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T16:41:28.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T16:41:28.711 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T16:41:28.711 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T16:41:28.711 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T16:41:28.711 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:28.711 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T16:41:28.711 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T16:41:28.712 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:28.713 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T16:41:18.754692+0000", 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.912+0000 7f3182a00640 1 Processor -- start 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.912+0000 7f3182a00640 1 -- start start 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.913+0000 7f3182a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.913+0000 7f3182a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c108210 con 0x7f317c107840 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.913+0000 7f317be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.913+0000 7f317be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56470/0 (socket says 172.21.15.18:56470) 2024-09-13T16:41:28.714 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.913+0000 7f317be00640 1 -- 172.21.15.18:0/1856395780 learned_addr learned my addr 172.21.15.18:0/1856395780 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.914+0000 7f317be00640 1 -- 172.21.15.18:0/1856395780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c108900 con 0x7f317c107840 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.915+0000 7f317be00640 1 --2- 172.21.15.18:0/1856395780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c107c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f316c009820 tx=0x7f316c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1e31015dd05ba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.915+0000 7f317aa00640 1 -- 172.21.15.18:0/1856395780 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c02ae70 con 0x7f317c107840 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.915+0000 7f317aa00640 1 -- 172.21.15.18:0/1856395780 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f316c0328e0 con 0x7f317c107840 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.915+0000 7f317aa00640 1 -- 172.21.15.18:0/1856395780 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c0308c0 con 0x7f317c107840 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.916+0000 7f3182a00640 1 -- 172.21.15.18:0/1856395780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 msgr2=0x7f317c107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.916+0000 7f3182a00640 1 --2- 172.21.15.18:0/1856395780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c107c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f316c009820 tx=0x7f316c02a270 comp rx=0 tx=0).stop 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.916+0000 7f3182a00640 1 -- 172.21.15.18:0/1856395780 shutdown_connections 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.916+0000 7f3182a00640 1 --2- 172.21.15.18:0/1856395780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c107c40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.916+0000 7f3182a00640 1 -- 172.21.15.18:0/1856395780 >> 172.21.15.18:0/1856395780 conn(0x7f317c07ad00 msgr2=0x7f317c07b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.916+0000 7f3182a00640 1 -- 172.21.15.18:0/1856395780 shutdown_connections 2024-09-13T16:41:28.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.916+0000 7f3182a00640 1 -- 172.21.15.18:0/1856395780 wait complete. 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.917+0000 7f3182a00640 1 Processor -- start 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.917+0000 7f3182a00640 1 -- start start 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.917+0000 7f3182a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c19b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.917+0000 7f3182a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c19b960 con 0x7f317c107840 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.918+0000 7f317be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c19b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.918+0000 7f317be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c19b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56478/0 (socket says 172.21.15.18:56478) 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.918+0000 7f317be00640 1 -- 172.21.15.18:0/4106733492 learned_addr learned my addr 172.21.15.18:0/4106733492 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.918+0000 7f317be00640 1 -- 172.21.15.18:0/4106733492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c0094d0 con 0x7f317c107840 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.918+0000 7f317be00640 1 --2- 172.21.15.18:0/4106733492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c19b420 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f316c0097f0 tx=0x7f316c030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.919+0000 7f3178c00640 1 -- 172.21.15.18:0/4106733492 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c032d90 con 0x7f317c107840 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.919+0000 7f3178c00640 1 -- 172.21.15.18:0/4106733492 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f316c03b8d0 con 0x7f317c107840 2024-09-13T16:41:28.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.919+0000 7f3178c00640 1 -- 172.21.15.18:0/4106733492 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c03a780 con 0x7f317c107840 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.919+0000 7f3182a00640 1 -- 172.21.15.18:0/4106733492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c19bb60 con 0x7f317c107840 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.919+0000 7f3182a00640 1 -- 172.21.15.18:0/4106733492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c19c000 con 0x7f317c107840 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.919+0000 7f3178c00640 1 -- 172.21.15.18:0/4106733492 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f316c039040 con 0x7f317c107840 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.919+0000 7f3178c00640 1 -- 172.21.15.18:0/4106733492 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f316c04c690 con 0x7f317c107840 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.920+0000 7f3182a00640 1 -- 172.21.15.18:0/4106733492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c10bb30 con 0x7f317c107840 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.923+0000 7f3178c00640 1 -- 172.21.15.18:0/4106733492 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f316c049060 con 0x7f317c107840 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.988+0000 7f3182a00640 1 -- 172.21.15.18:0/4106733492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f317c10bcf0 con 0x7f317c107840 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.989+0000 7f3178c00640 1 -- 172.21.15.18:0/4106733492 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f316c03f070 con 0x7f317c107840 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.990+0000 7f3182a00640 1 -- 172.21.15.18:0/4106733492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 msgr2=0x7f317c19b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.990+0000 7f3182a00640 1 --2- 172.21.15.18:0/4106733492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c19b420 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f316c0097f0 tx=0x7f316c030db0 comp rx=0 tx=0).stop 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.990+0000 7f3182a00640 1 -- 172.21.15.18:0/4106733492 shutdown_connections 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.990+0000 7f3182a00640 1 --2- 172.21.15.18:0/4106733492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317c107840 0x7f317c19b420 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.990+0000 7f3182a00640 1 -- 172.21.15.18:0/4106733492 >> 172.21.15.18:0/4106733492 conn(0x7f317c07ad00 msgr2=0x7f317c105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:28.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.990+0000 7f3182a00640 1 -- 172.21.15.18:0/4106733492 shutdown_connections 2024-09-13T16:41:28.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:27.990+0000 7f3182a00640 1 -- 172.21.15.18:0/4106733492 wait complete. 2024-09-13T16:41:28.718 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (1/15)... 2024-09-13T16:41:28.959 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:28 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:28.797+0000 7fe133a9a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:41:30.209 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:29 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:29.923+0000 7fe133a9a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:41:30.209 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:30 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:30.004+0000 7fe133a9a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:41:31.123 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:30 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:30.978+0000 7fe133a9a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:41:31.374 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:31.121+0000 7fe133a9a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:41:31.374 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:31.294+0000 7fe133a9a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:41:31.640 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:31 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3785131566' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T16:41:31.640 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:31.373+0000 7fe133a9a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:41:31.641 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:31.553+0000 7fe133a9a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:41:31.641 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:31.638+0000 7fe133a9a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:41:31.906 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:31.711+0000 7fe133a9a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:41:31.906 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:31.903+0000 7fe133a9a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:41:32.073 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:32.073 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:41:32.073 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "d8ff35a0-71ee-11ef-bceb-c7b262605968", 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T16:41:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:41:32.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-13T16:41:32.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T16:41:32.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:32.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T16:41:32.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T16:41:32.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:32.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T16:41:32.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:32.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T16:41:32.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T16:41:32.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T16:41:32.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T16:41:32.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T16:41:32.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T16:41:32.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T16:41:32.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T16:41:18.754692+0000", 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.283+0000 7f2801c00640 1 Processor -- start 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.283+0000 7f2801c00640 1 -- start start 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.284+0000 7f2801c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.284+0000 7f2801c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc07a890 con 0x7f27fc07be60 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.284+0000 7f27faa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.284+0000 7f27faa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35152/0 (socket says 172.21.15.18:35152) 2024-09-13T16:41:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.284+0000 7f27faa00640 1 -- 172.21.15.18:0/3748786308 learned_addr learned my addr 172.21.15.18:0/3748786308 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.284+0000 7f27faa00640 1 -- 172.21.15.18:0/3748786308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc07a9d0 con 0x7f27fc07be60 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.285+0000 7f27faa00640 1 --2- 172.21.15.18:0/3748786308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc07a2c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009820 tx=0x7f27ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338539c81114c3f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.286+0000 7f27f9600640 1 -- 172.21.15.18:0/3748786308 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27ec02ae70 con 0x7f27fc07be60 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.286+0000 7f27f9600640 1 -- 172.21.15.18:0/3748786308 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27ec0328e0 con 0x7f27fc07be60 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.286+0000 7f27f9600640 1 -- 172.21.15.18:0/3748786308 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27ec0308c0 con 0x7f27fc07be60 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.286+0000 7f2801c00640 1 -- 172.21.15.18:0/3748786308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 msgr2=0x7f27fc07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.286+0000 7f2801c00640 1 --2- 172.21.15.18:0/3748786308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc07a2c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009820 tx=0x7f27ec02a270 comp rx=0 tx=0).stop 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.286+0000 7f2801c00640 1 -- 172.21.15.18:0/3748786308 shutdown_connections 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.286+0000 7f2801c00640 1 --2- 172.21.15.18:0/3748786308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc07a2c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.286+0000 7f2801c00640 1 -- 172.21.15.18:0/3748786308 >> 172.21.15.18:0/3748786308 conn(0x7f27fc100c70 msgr2=0x7f27fc103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.287+0000 7f2801c00640 1 -- 172.21.15.18:0/3748786308 shutdown_connections 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.287+0000 7f2801c00640 1 -- 172.21.15.18:0/3748786308 wait complete. 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.287+0000 7f2801c00640 1 Processor -- start 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.288+0000 7f2801c00640 1 -- start start 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.288+0000 7f2801c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.288+0000 7f2801c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc19fd20 con 0x7f27fc07be60 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.288+0000 7f27faa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.288+0000 7f27faa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc19f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35162/0 (socket says 172.21.15.18:35162) 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.288+0000 7f27faa00640 1 -- 172.21.15.18:0/3785131566 learned_addr learned my addr 172.21.15.18:0/3785131566 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.289+0000 7f27faa00640 1 -- 172.21.15.18:0/3785131566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec0094d0 con 0x7f27fc07be60 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.289+0000 7f27faa00640 1 --2- 172.21.15.18:0/3785131566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc19f7e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0305d0 tx=0x7f27ec032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:32.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.289+0000 7f27f3400640 1 -- 172.21.15.18:0/3785131566 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27ec032c60 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.289+0000 7f27f3400640 1 -- 172.21.15.18:0/3785131566 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27ec032dc0 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.289+0000 7f2801c00640 1 -- 172.21.15.18:0/3785131566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27fc19ff20 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.289+0000 7f27f3400640 1 -- 172.21.15.18:0/3785131566 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27ec03a770 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.289+0000 7f2801c00640 1 -- 172.21.15.18:0/3785131566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc1a03c0 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.290+0000 7f27f3400640 1 -- 172.21.15.18:0/3785131566 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f27ec039040 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.290+0000 7f27f3400640 1 -- 172.21.15.18:0/3785131566 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f27ec044d40 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.290+0000 7f2801c00640 1 -- 172.21.15.18:0/3785131566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27fc198eb0 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.293+0000 7f27f3400640 1 -- 172.21.15.18:0/3785131566 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f27ec049060 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.358+0000 7f2801c00640 1 -- 172.21.15.18:0/3785131566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f27fc1076e0 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.358+0000 7f27f3400640 1 -- 172.21.15.18:0/3785131566 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f27ec03f070 con 0x7f27fc07be60 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.359+0000 7f2801c00640 1 -- 172.21.15.18:0/3785131566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 msgr2=0x7f27fc19f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.359+0000 7f2801c00640 1 --2- 172.21.15.18:0/3785131566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc19f7e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0305d0 tx=0x7f27ec032670 comp rx=0 tx=0).stop 2024-09-13T16:41:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.359+0000 7f2801c00640 1 -- 172.21.15.18:0/3785131566 shutdown_connections 2024-09-13T16:41:32.083 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.359+0000 7f2801c00640 1 --2- 172.21.15.18:0/3785131566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27fc07be60 0x7f27fc19f7e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:32.083 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.359+0000 7f2801c00640 1 -- 172.21.15.18:0/3785131566 >> 172.21.15.18:0/3785131566 conn(0x7f27fc100c70 msgr2=0x7f27fc103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:32.083 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.359+0000 7f2801c00640 1 -- 172.21.15.18:0/3785131566 shutdown_connections 2024-09-13T16:41:32.083 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:31.359+0000 7f2801c00640 1 -- 172.21.15.18:0/3785131566 wait complete. 2024-09-13T16:41:32.083 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (2/15)... 2024-09-13T16:41:32.168 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:31.983+0000 7fe133a9a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:41:32.168 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:32 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:32.065+0000 7fe133a9a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:41:32.168 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:32 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:32.165+0000 7fe133a9a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:41:32.459 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:32 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:32.238+0000 7fe133a9a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:41:32.460 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:32 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:32.309+0000 7fe133a9a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:41:33.709 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:33.241+0000 7fe133a9a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:41:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: Activating manager daemon x 2024-09-13T16:41:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: mgrmap e2: x(active, starting, since 0.00403006s) 2024-09-13T16:41:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: from='mgr.14100 172.21.15.18:0/3657621466' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T16:41:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: from='mgr.14100 172.21.15.18:0/3657621466' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T16:41:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: from='mgr.14100 172.21.15.18:0/3657621466' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T16:41:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: from='mgr.14100 172.21.15.18:0/3657621466' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:41:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: from='mgr.14100 172.21.15.18:0/3657621466' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T16:41:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: Manager daemon x is now available 2024-09-13T16:41:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: from='mgr.14100 172.21.15.18:0/3657621466' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T16:41:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: from='mgr.14100 172.21.15.18:0/3657621466' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T16:41:33.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: from='mgr.14100 172.21.15.18:0/3657621466' entity='mgr.x' 2024-09-13T16:41:33.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: from='mgr.14100 172.21.15.18:0/3657621466' entity='mgr.x' 2024-09-13T16:41:33.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:33 smithi018 ceph-mon[30981]: from='mgr.14100 172.21.15.18:0/3657621466' entity='mgr.x' 2024-09-13T16:41:35.529 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:35 smithi018 ceph-mon[30981]: mgrmap e3: x(active, since 1.00816s) 2024-09-13T16:41:35.529 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:35 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3449660191' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T16:41:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:41:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "d8ff35a0-71ee-11ef-bceb-c7b262605968", 2024-09-13T16:41:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T16:41:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T16:41:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T16:41:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T16:41:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T16:41:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:35.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T16:41:35.540 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T16:41:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T16:41:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T16:41:18.754692+0000", 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.614+0000 7f0f89c00640 1 Processor -- start 2024-09-13T16:41:35.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.614+0000 7f0f89c00640 1 -- start start 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.615+0000 7f0f89c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f84107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.615+0000 7f0f89c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f841081c0 con 0x7f0f841077f0 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.615+0000 7f0f82a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f84107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.615+0000 7f0f82a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f84107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35216/0 (socket says 172.21.15.18:35216) 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.615+0000 7f0f82a00640 1 -- 172.21.15.18:0/1021485420 learned_addr learned my addr 172.21.15.18:0/1021485420 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.615+0000 7f0f82a00640 1 -- 172.21.15.18:0/1021485420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84108900 con 0x7f0f841077f0 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.616+0000 7f0f82a00640 1 --2- 172.21.15.18:0/1021485420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f84107bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009820 tx=0x7f0f7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf9e5dd6cdf9782 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.617+0000 7f0f81600640 1 -- 172.21.15.18:0/1021485420 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f7402ae70 con 0x7f0f841077f0 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.617+0000 7f0f81600640 1 -- 172.21.15.18:0/1021485420 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f740328e0 con 0x7f0f841077f0 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.617+0000 7f0f81600640 1 -- 172.21.15.18:0/1021485420 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f740308c0 con 0x7f0f841077f0 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.617+0000 7f0f89c00640 1 -- 172.21.15.18:0/1021485420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 msgr2=0x7f0f84107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:35.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.617+0000 7f0f89c00640 1 --2- 172.21.15.18:0/1021485420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f84107bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009820 tx=0x7f0f7402a270 comp rx=0 tx=0).stop 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.617+0000 7f0f89c00640 1 -- 172.21.15.18:0/1021485420 shutdown_connections 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.617+0000 7f0f89c00640 1 --2- 172.21.15.18:0/1021485420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f84107bf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.618+0000 7f0f89c00640 1 -- 172.21.15.18:0/1021485420 >> 172.21.15.18:0/1021485420 conn(0x7f0f8407ace0 msgr2=0x7f0f8407b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.618+0000 7f0f89c00640 1 -- 172.21.15.18:0/1021485420 shutdown_connections 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.618+0000 7f0f89c00640 1 -- 172.21.15.18:0/1021485420 wait complete. 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.618+0000 7f0f89c00640 1 Processor -- start 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.619+0000 7f0f89c00640 1 -- start start 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.619+0000 7f0f89c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f8419b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.619+0000 7f0f89c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8419b950 con 0x7f0f841077f0 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.619+0000 7f0f82a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f8419b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.619+0000 7f0f82a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f8419b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35218/0 (socket says 172.21.15.18:35218) 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.619+0000 7f0f82a00640 1 -- 172.21.15.18:0/3449660191 learned_addr learned my addr 172.21.15.18:0/3449660191 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.620+0000 7f0f82a00640 1 -- 172.21.15.18:0/3449660191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f740094d0 con 0x7f0f841077f0 2024-09-13T16:41:35.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.620+0000 7f0f82a00640 1 --2- 172.21.15.18:0/3449660191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f8419b410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0f740305d0 tx=0x7f0f74032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:35.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.620+0000 7f0f7b400640 1 -- 172.21.15.18:0/3449660191 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f74032c60 con 0x7f0f841077f0 2024-09-13T16:41:35.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.620+0000 7f0f7b400640 1 -- 172.21.15.18:0/3449660191 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f74032dc0 con 0x7f0f841077f0 2024-09-13T16:41:35.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.620+0000 7f0f7b400640 1 -- 172.21.15.18:0/3449660191 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f7403a740 con 0x7f0f841077f0 2024-09-13T16:41:35.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.620+0000 7f0f89c00640 1 -- 172.21.15.18:0/3449660191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8419bb50 con 0x7f0f841077f0 2024-09-13T16:41:35.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.620+0000 7f0f89c00640 1 -- 172.21.15.18:0/3449660191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8419bff0 con 0x7f0f841077f0 2024-09-13T16:41:35.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.621+0000 7f0f89c00640 1 -- 172.21.15.18:0/3449660191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8410bb30 con 0x7f0f841077f0 2024-09-13T16:41:35.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.622+0000 7f0f7b400640 1 -- 172.21.15.18:0/3449660191 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7f0f74039040 con 0x7f0f841077f0 2024-09-13T16:41:35.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.623+0000 7f0f7b400640 1 --2- 172.21.15.18:0/3449660191 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f0f68038550 0x7f0f6803aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:35.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.623+0000 7f0f7b400640 1 -- 172.21.15.18:0/3449660191 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0f7406b8c0 con 0x7f0f841077f0 2024-09-13T16:41:35.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.623+0000 7f0f82000640 1 --2- 172.21.15.18:0/3449660191 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f0f68038550 0x7f0f6803aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:35.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.623+0000 7f0f82000640 1 --2- 172.21.15.18:0/3449660191 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f0f68038550 0x7f0f6803aa10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f700098c0 tx=0x7f0f70006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:35.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.628+0000 7f0f7b400640 1 -- 172.21.15.18:0/3449660191 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0f74042360 con 0x7f0f841077f0 2024-09-13T16:41:35.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.875+0000 7f0f89c00640 1 -- 172.21.15.18:0/3449660191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0f8410bd70 con 0x7f0f841077f0 2024-09-13T16:41:35.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.876+0000 7f0f7b400640 1 -- 172.21.15.18:0/3449660191 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f0f7403f030 con 0x7f0f841077f0 2024-09-13T16:41:35.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.878+0000 7f0f89c00640 1 -- 172.21.15.18:0/3449660191 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f0f68038550 msgr2=0x7f0f6803aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:35.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.878+0000 7f0f89c00640 1 --2- 172.21.15.18:0/3449660191 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f0f68038550 0x7f0f6803aa10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f700098c0 tx=0x7f0f70006db0 comp rx=0 tx=0).stop 2024-09-13T16:41:35.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.878+0000 7f0f89c00640 1 -- 172.21.15.18:0/3449660191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 msgr2=0x7f0f8419b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:35.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.878+0000 7f0f89c00640 1 --2- 172.21.15.18:0/3449660191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f8419b410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0f740305d0 tx=0x7f0f74032670 comp rx=0 tx=0).stop 2024-09-13T16:41:35.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.879+0000 7f0f89c00640 1 -- 172.21.15.18:0/3449660191 shutdown_connections 2024-09-13T16:41:35.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.879+0000 7f0f89c00640 1 --2- 172.21.15.18:0/3449660191 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f0f68038550 0x7f0f6803aa10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:35.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.879+0000 7f0f89c00640 1 --2- 172.21.15.18:0/3449660191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f841077f0 0x7f0f8419b410 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:35.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.879+0000 7f0f89c00640 1 -- 172.21.15.18:0/3449660191 >> 172.21.15.18:0/3449660191 conn(0x7f0f8407ace0 msgr2=0x7f0f841054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:35.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.879+0000 7f0f89c00640 1 -- 172.21.15.18:0/3449660191 shutdown_connections 2024-09-13T16:41:35.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:34.879+0000 7f0f89c00640 1 -- 172.21.15.18:0/3449660191 wait complete. 2024-09-13T16:41:35.555 INFO:teuthology.orchestra.run.smithi018.stdout:mgr is available 2024-09-13T16:41:36.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:36 smithi018 ceph-mon[30981]: mgrmap e4: x(active, since 2s) 2024-09-13T16:41:36.915 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:36.915 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T16:41:36.915 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout fsid = d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:36.915 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T16:41:36.915 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T16:41:36.916 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.062+0000 7f3759200640 1 Processor -- start 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.062+0000 7f3759200640 1 -- start start 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.062+0000 7f3759200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f3754107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.062+0000 7f3759200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754108210 con 0x7f3754107840 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.062+0000 7f3751e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f3754107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.063+0000 7f3751e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f3754107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35228/0 (socket says 172.21.15.18:35228) 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.063+0000 7f3751e00640 1 -- 172.21.15.18:0/2842055007 learned_addr learned my addr 172.21.15.18:0/2842055007 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.063+0000 7f3751e00640 1 -- 172.21.15.18:0/2842055007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37541088d0 con 0x7f3754107840 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.064+0000 7f3751e00640 1 --2- 172.21.15.18:0/2842055007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f3754107c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3744009820 tx=0x7f374402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9f8c3468df1f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.064+0000 7f3750a00640 1 -- 172.21.15.18:0/2842055007 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f374402ae70 con 0x7f3754107840 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.064+0000 7f3750a00640 1 -- 172.21.15.18:0/2842055007 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f37440328e0 con 0x7f3754107840 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.064+0000 7f3750a00640 1 -- 172.21.15.18:0/2842055007 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37440308c0 con 0x7f3754107840 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.065+0000 7f3759200640 1 -- 172.21.15.18:0/2842055007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 msgr2=0x7f3754107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.065+0000 7f3759200640 1 --2- 172.21.15.18:0/2842055007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f3754107c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3744009820 tx=0x7f374402a270 comp rx=0 tx=0).stop 2024-09-13T16:41:36.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.065+0000 7f3759200640 1 -- 172.21.15.18:0/2842055007 shutdown_connections 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.065+0000 7f3759200640 1 --2- 172.21.15.18:0/2842055007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f3754107c40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.065+0000 7f3759200640 1 -- 172.21.15.18:0/2842055007 >> 172.21.15.18:0/2842055007 conn(0x7f375407ac90 msgr2=0x7f375407b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.065+0000 7f3759200640 1 -- 172.21.15.18:0/2842055007 shutdown_connections 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.065+0000 7f3759200640 1 -- 172.21.15.18:0/2842055007 wait complete. 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.066+0000 7f3759200640 1 Processor -- start 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.066+0000 7f3759200640 1 -- start start 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.066+0000 7f3759200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f375419b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.066+0000 7f3759200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375419b960 con 0x7f3754107840 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.066+0000 7f3751e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f375419b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.066+0000 7f3751e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f375419b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35232/0 (socket says 172.21.15.18:35232) 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.066+0000 7f3751e00640 1 -- 172.21.15.18:0/4232701350 learned_addr learned my addr 172.21.15.18:0/4232701350 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.067+0000 7f3751e00640 1 -- 172.21.15.18:0/4232701350 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37440094d0 con 0x7f3754107840 2024-09-13T16:41:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.067+0000 7f3751e00640 1 --2- 172.21.15.18:0/4232701350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f375419b420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f37440097f0 tx=0x7f3744030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.067+0000 7f374aa00640 1 -- 172.21.15.18:0/4232701350 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3744032d90 con 0x7f3754107840 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.067+0000 7f374aa00640 1 -- 172.21.15.18:0/4232701350 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f374403b8d0 con 0x7f3754107840 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.067+0000 7f374aa00640 1 -- 172.21.15.18:0/4232701350 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f374403a780 con 0x7f3754107840 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.067+0000 7f3759200640 1 -- 172.21.15.18:0/4232701350 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375419bb60 con 0x7f3754107840 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.068+0000 7f3759200640 1 -- 172.21.15.18:0/4232701350 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375419c000 con 0x7f3754107840 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.069+0000 7f374aa00640 1 -- 172.21.15.18:0/4232701350 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f3744039040 con 0x7f3754107840 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.069+0000 7f3759200640 1 -- 172.21.15.18:0/4232701350 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375410bb00 con 0x7f3754107840 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.069+0000 7f374aa00640 1 --2- 172.21.15.18:0/4232701350 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f3738038620 0x7f373803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.069+0000 7f374aa00640 1 -- 172.21.15.18:0/4232701350 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f374406b6b0 con 0x7f3754107840 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.069+0000 7f3751400640 1 --2- 172.21.15.18:0/4232701350 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f3738038620 0x7f373803aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.070+0000 7f3751400640 1 --2- 172.21.15.18:0/4232701350 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f3738038620 0x7f373803aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f37400098c0 tx=0x7f3740006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.075+0000 7f374aa00640 1 -- 172.21.15.18:0/4232701350 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f374403ba40 con 0x7f3754107840 2024-09-13T16:41:36.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.255+0000 7f3759200640 1 -- 172.21.15.18:0/4232701350 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f375410bd40 con 0x7f3754107840 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.256+0000 7f374aa00640 1 -- 172.21.15.18:0/4232701350 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f374403f020 con 0x7f3754107840 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.258+0000 7f3759200640 1 -- 172.21.15.18:0/4232701350 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f3738038620 msgr2=0x7f373803aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.258+0000 7f3759200640 1 --2- 172.21.15.18:0/4232701350 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f3738038620 0x7f373803aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f37400098c0 tx=0x7f3740006db0 comp rx=0 tx=0).stop 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.258+0000 7f3759200640 1 -- 172.21.15.18:0/4232701350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 msgr2=0x7f375419b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.258+0000 7f3759200640 1 --2- 172.21.15.18:0/4232701350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f375419b420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f37440097f0 tx=0x7f3744030db0 comp rx=0 tx=0).stop 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.259+0000 7f3759200640 1 -- 172.21.15.18:0/4232701350 shutdown_connections 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.259+0000 7f3759200640 1 --2- 172.21.15.18:0/4232701350 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f3738038620 0x7f373803aae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.259+0000 7f3759200640 1 --2- 172.21.15.18:0/4232701350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3754107840 0x7f375419b420 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.259+0000 7f3759200640 1 -- 172.21.15.18:0/4232701350 >> 172.21.15.18:0/4232701350 conn(0x7f375407ac90 msgr2=0x7f3754105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.259+0000 7f3759200640 1 -- 172.21.15.18:0/4232701350 shutdown_connections 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:36.259+0000 7f3759200640 1 -- 172.21.15.18:0/4232701350 wait complete. 2024-09-13T16:41:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling cephadm module... 2024-09-13T16:41:37.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:37 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4232701350' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T16:41:38.558 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:38 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3427763845' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T16:41:38.558 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: ignoring --setuser ceph since I am not root 2024-09-13T16:41:38.558 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: ignoring --setgroup ceph since I am not root 2024-09-13T16:41:38.558 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:38.483+0000 7ff8daf73040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:41:38.559 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:38.555+0000 7ff8daf73040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:41:38.829 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:38.745+0000 7ff8daf73040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:41:38.829 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:38.827+0000 7ff8daf73040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:41:38.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.375+0000 7f9dbd000640 1 Processor -- start 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.375+0000 7f9dbd000640 1 -- start start 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.375+0000 7f9dbd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db8105720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.375+0000 7f9dbd000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8105cf0 con 0x7f9db8105320 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.375+0000 7f9db7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db8105720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.375+0000 7f9db7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db8105720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35240/0 (socket says 172.21.15.18:35240) 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.375+0000 7f9db7400640 1 -- 172.21.15.18:0/615949817 learned_addr learned my addr 172.21.15.18:0/615949817 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.376+0000 7f9db7400640 1 -- 172.21.15.18:0/615949817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8106520 con 0x7f9db8105320 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.377+0000 7f9db7400640 1 --2- 172.21.15.18:0/615949817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db8105720 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009e80 tx=0x7f9da802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8cdb23c0dd2e7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.377+0000 7f9db6a00640 1 -- 172.21.15.18:0/615949817 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9da8031400 con 0x7f9db8105320 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.377+0000 7f9db6a00640 1 -- 172.21.15.18:0/615949817 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9da802d050 con 0x7f9db8105320 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.377+0000 7f9db6a00640 1 -- 172.21.15.18:0/615949817 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9da8007960 con 0x7f9db8105320 2024-09-13T16:41:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.378+0000 7f9dbd000640 1 -- 172.21.15.18:0/615949817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 msgr2=0x7f9db8105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.378+0000 7f9dbd000640 1 --2- 172.21.15.18:0/615949817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db8105720 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009e80 tx=0x7f9da802a7a0 comp rx=0 tx=0).stop 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.378+0000 7f9dbd000640 1 -- 172.21.15.18:0/615949817 shutdown_connections 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.378+0000 7f9dbd000640 1 --2- 172.21.15.18:0/615949817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db8105720 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.378+0000 7f9dbd000640 1 -- 172.21.15.18:0/615949817 >> 172.21.15.18:0/615949817 conn(0x7f9db8100b10 msgr2=0x7f9db8102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.378+0000 7f9dbd000640 1 -- 172.21.15.18:0/615949817 shutdown_connections 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.378+0000 7f9dbd000640 1 -- 172.21.15.18:0/615949817 wait complete. 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.379+0000 7f9dbd000640 1 Processor -- start 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.379+0000 7f9dbd000640 1 -- start start 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.379+0000 7f9dbd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.379+0000 7f9dbd000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db819b720 con 0x7f9db8105320 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.379+0000 7f9db7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.380+0000 7f9db7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db819b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35254/0 (socket says 172.21.15.18:35254) 2024-09-13T16:41:38.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.380+0000 7f9db7400640 1 -- 172.21.15.18:0/3427763845 learned_addr learned my addr 172.21.15.18:0/3427763845 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.380+0000 7f9db7400640 1 -- 172.21.15.18:0/3427763845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8009b30 con 0x7f9db8105320 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.380+0000 7f9db7400640 1 --2- 172.21.15.18:0/3427763845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db819b1e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9da802acc0 tx=0x7f9da8007630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.380+0000 7f9db4c00640 1 -- 172.21.15.18:0/3427763845 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9da8031de0 con 0x7f9db8105320 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.380+0000 7f9db4c00640 1 -- 172.21.15.18:0/3427763845 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9da803b8b0 con 0x7f9db8105320 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.381+0000 7f9dbd000640 1 -- 172.21.15.18:0/3427763845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db819b920 con 0x7f9db8105320 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.381+0000 7f9db4c00640 1 -- 172.21.15.18:0/3427763845 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9da803a920 con 0x7f9db8105320 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.381+0000 7f9dbd000640 1 -- 172.21.15.18:0/3427763845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db819bdc0 con 0x7f9db8105320 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.382+0000 7f9db4c00640 1 -- 172.21.15.18:0/3427763845 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f9da8038050 con 0x7f9db8105320 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.382+0000 7f9dbd000640 1 -- 172.21.15.18:0/3427763845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db8109750 con 0x7f9db8105320 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.382+0000 7f9db4c00640 1 --2- 172.21.15.18:0/3427763845 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f9d9c038620 0x7f9d9c03aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.382+0000 7f9db4c00640 1 -- 172.21.15.18:0/3427763845 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9da806b560 con 0x7f9db8105320 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.382+0000 7f9daea00640 1 --2- 172.21.15.18:0/3427763845 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f9d9c038620 0x7f9d9c03aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.383+0000 7f9daea00640 1 --2- 172.21.15.18:0/3427763845 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f9d9c038620 0x7f9d9c03aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9da00098c0 tx=0x7f9da0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:38.958 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.387+0000 7f9db4c00640 1 -- 172.21.15.18:0/3427763845 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9da803bd90 con 0x7f9db8105320 2024-09-13T16:41:38.958 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:37.614+0000 7f9dbd000640 1 -- 172.21.15.18:0/3427763845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f9db8109990 con 0x7f9db8105320 2024-09-13T16:41:38.958 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.257+0000 7f9db4c00640 1 -- 172.21.15.18:0/3427763845 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f9da8037d20 con 0x7f9db8105320 2024-09-13T16:41:38.958 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.259+0000 7f9db4c00640 1 -- 172.21.15.18:0/3427763845 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f9da806b2c0 con 0x7f9db8105320 2024-09-13T16:41:38.958 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.262+0000 7f9dbd000640 1 -- 172.21.15.18:0/3427763845 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f9d9c038620 msgr2=0x7f9d9c03aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:38.958 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.262+0000 7f9dbd000640 1 --2- 172.21.15.18:0/3427763845 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f9d9c038620 0x7f9d9c03aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9da00098c0 tx=0x7f9da0006db0 comp rx=0 tx=0).stop 2024-09-13T16:41:38.958 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.262+0000 7f9dbd000640 1 -- 172.21.15.18:0/3427763845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 msgr2=0x7f9db819b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:38.958 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.262+0000 7f9dbd000640 1 --2- 172.21.15.18:0/3427763845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db819b1e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9da802acc0 tx=0x7f9da8007630 comp rx=0 tx=0).stop 2024-09-13T16:41:38.959 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.262+0000 7f9dbd000640 1 -- 172.21.15.18:0/3427763845 shutdown_connections 2024-09-13T16:41:38.959 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.262+0000 7f9dbd000640 1 --2- 172.21.15.18:0/3427763845 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f9d9c038620 0x7f9d9c03aae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:38.959 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.262+0000 7f9dbd000640 1 --2- 172.21.15.18:0/3427763845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db8105320 0x7f9db819b1e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:38.959 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.262+0000 7f9dbd000640 1 -- 172.21.15.18:0/3427763845 >> 172.21.15.18:0/3427763845 conn(0x7f9db8100b10 msgr2=0x7f9db8101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:38.959 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.262+0000 7f9dbd000640 1 -- 172.21.15.18:0/3427763845 shutdown_connections 2024-09-13T16:41:38.959 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:38.262+0000 7f9dbd000640 1 -- 172.21.15.18:0/3427763845 wait complete. 2024-09-13T16:41:39.094 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:39.008+0000 7ff8daf73040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:41:39.430 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:39.182+0000 7ff8daf73040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:41:39.430 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:39 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3427763845' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T16:41:39.430 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:39 smithi018 ceph-mon[30981]: mgrmap e5: x(active, since 5s) 2024-09-13T16:41:39.709 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:39.565+0000 7ff8daf73040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:41:39.709 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:39.639+0000 7ff8daf73040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:41:40.147 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:39.861+0000 7ff8daf73040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:41:40.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:40 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/877722883' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T16:41:40.495 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:41:40.495 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.536+0000 7f5fa6600640 1 Processor -- start 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.536+0000 7f5fa6600640 1 -- start start 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.536+0000 7f5fa6600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa0107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.536+0000 7f5fa6600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa0108210 con 0x7f5fa0107840 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.536+0000 7f5f9f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa0107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.536+0000 7f5f9f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa0107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35284/0 (socket says 172.21.15.18:35284) 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.536+0000 7f5f9f400640 1 -- 172.21.15.18:0/1950940304 learned_addr learned my addr 172.21.15.18:0/1950940304 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.537+0000 7f5f9f400640 1 -- 172.21.15.18:0/1950940304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa0108900 con 0x7f5fa0107840 2024-09-13T16:41:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.538+0000 7f5f9f400640 1 --2- 172.21.15.18:0/1950940304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa0107c40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009820 tx=0x7f5f9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23263b43396111b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.538+0000 7f5f9e000640 1 -- 172.21.15.18:0/1950940304 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f9002ae70 con 0x7f5fa0107840 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.538+0000 7f5f9e000640 1 -- 172.21.15.18:0/1950940304 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f900328e0 con 0x7f5fa0107840 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.538+0000 7f5f9e000640 1 -- 172.21.15.18:0/1950940304 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f900308c0 con 0x7f5fa0107840 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.539+0000 7f5fa6600640 1 -- 172.21.15.18:0/1950940304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 msgr2=0x7f5fa0107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.539+0000 7f5fa6600640 1 --2- 172.21.15.18:0/1950940304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa0107c40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009820 tx=0x7f5f9002a270 comp rx=0 tx=0).stop 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.539+0000 7f5fa6600640 1 -- 172.21.15.18:0/1950940304 shutdown_connections 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.539+0000 7f5fa6600640 1 --2- 172.21.15.18:0/1950940304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa0107c40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.539+0000 7f5fa6600640 1 -- 172.21.15.18:0/1950940304 >> 172.21.15.18:0/1950940304 conn(0x7f5fa007ad00 msgr2=0x7f5fa007b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.539+0000 7f5fa6600640 1 -- 172.21.15.18:0/1950940304 shutdown_connections 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.539+0000 7f5fa6600640 1 -- 172.21.15.18:0/1950940304 wait complete. 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.540+0000 7f5fa6600640 1 Processor -- start 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.540+0000 7f5fa6600640 1 -- start start 2024-09-13T16:41:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.540+0000 7f5fa6600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa019b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.540+0000 7f5fa6600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa019b960 con 0x7f5fa0107840 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.541+0000 7f5f9f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa019b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.541+0000 7f5f9f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa019b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35298/0 (socket says 172.21.15.18:35298) 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.541+0000 7f5f9f400640 1 -- 172.21.15.18:0/877722883 learned_addr learned my addr 172.21.15.18:0/877722883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.541+0000 7f5f9f400640 1 -- 172.21.15.18:0/877722883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f900094d0 con 0x7f5fa0107840 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.541+0000 7f5f9f400640 1 --2- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa019b420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5f900097f0 tx=0x7f5f90030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.542+0000 7f5f97e00640 1 -- 172.21.15.18:0/877722883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f90032d90 con 0x7f5fa0107840 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.542+0000 7f5f97e00640 1 -- 172.21.15.18:0/877722883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f9003b8d0 con 0x7f5fa0107840 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.542+0000 7f5fa6600640 1 -- 172.21.15.18:0/877722883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa019bb60 con 0x7f5fa0107840 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.542+0000 7f5f97e00640 1 -- 172.21.15.18:0/877722883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f9003a780 con 0x7f5fa0107840 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.542+0000 7f5fa6600640 1 -- 172.21.15.18:0/877722883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa019c000 con 0x7f5fa0107840 2024-09-13T16:41:40.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.543+0000 7f5f97e00640 1 -- 172.21.15.18:0/877722883 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f5f90039040 con 0x7f5fa0107840 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.543+0000 7f5fa6600640 1 -- 172.21.15.18:0/877722883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa010bb30 con 0x7f5fa0107840 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.544+0000 7f5f97e00640 1 --2- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5f840386c0 0x7f5f8403ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.544+0000 7f5f97e00640 1 -- 172.21.15.18:0/877722883 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5f9006b6c0 con 0x7f5fa0107840 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.544+0000 7f5f9ea00640 1 -- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5f840386c0 msgr2=0x7f5f8403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1236399643 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.544+0000 7f5f9ea00640 1 --2- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5f840386c0 0x7f5f8403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.548+0000 7f5f97e00640 1 -- 172.21.15.18:0/877722883 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5f9004b710 con 0x7f5fa0107840 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.745+0000 7f5f9ea00640 1 -- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5f840386c0 msgr2=0x7f5f8403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1236399643 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.745+0000 7f5f9ea00640 1 --2- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5f840386c0 0x7f5f8403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.775+0000 7f5fa6600640 1 -- 172.21.15.18:0/877722883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f5fa019ece0 con 0x7f5fa0107840 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.776+0000 7f5f97e00640 1 -- 172.21.15.18:0/877722883 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f5f90037070 con 0x7f5fa0107840 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.778+0000 7f5fa6600640 1 -- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5f840386c0 msgr2=0x7f5f8403ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.778+0000 7f5fa6600640 1 --2- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5f840386c0 0x7f5f8403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:40.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.778+0000 7f5fa6600640 1 -- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 msgr2=0x7f5fa019b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:40.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.778+0000 7f5fa6600640 1 --2- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa019b420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5f900097f0 tx=0x7f5f90030db0 comp rx=0 tx=0).stop 2024-09-13T16:41:40.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.778+0000 7f5fa6600640 1 -- 172.21.15.18:0/877722883 shutdown_connections 2024-09-13T16:41:40.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.778+0000 7f5fa6600640 1 --2- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5f840386c0 0x7f5f8403ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:40.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.778+0000 7f5fa6600640 1 --2- 172.21.15.18:0/877722883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fa0107840 0x7f5fa019b420 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:40.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.778+0000 7f5fa6600640 1 -- 172.21.15.18:0/877722883 >> 172.21.15.18:0/877722883 conn(0x7f5fa007ad00 msgr2=0x7f5fa0105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:40.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.778+0000 7f5fa6600640 1 -- 172.21.15.18:0/877722883 shutdown_connections 2024-09-13T16:41:40.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:39.778+0000 7f5fa6600640 1 -- 172.21.15.18:0/877722883 wait complete. 2024-09-13T16:41:40.500 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for the mgr to restart... 2024-09-13T16:41:40.500 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr epoch 5... 2024-09-13T16:41:41.209 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:40 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:40.998+0000 7ff8daf73040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:41:41.209 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:41 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:41.082+0000 7ff8daf73040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:41:42.338 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:42.028+0000 7ff8daf73040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:41:42.338 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:42.167+0000 7ff8daf73040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:41:42.338 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:42.335+0000 7ff8daf73040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:41:42.669 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:42.409+0000 7ff8daf73040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:41:42.669 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:42.583+0000 7ff8daf73040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:41:42.669 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:42.667+0000 7ff8daf73040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:41:42.928 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:42.740+0000 7ff8daf73040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:41:43.187 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:42.924+0000 7ff8daf73040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:41:43.187 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:43.004+0000 7ff8daf73040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:41:43.187 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:43.085+0000 7ff8daf73040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:41:43.187 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:43.184+0000 7ff8daf73040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:41:43.459 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:43.257+0000 7ff8daf73040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:41:43.459 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:43.328+0000 7ff8daf73040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:41:44.459 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:44.256+0000 7ff8daf73040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:41:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: Active manager daemon x restarted 2024-09-13T16:41:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: Activating manager daemon x 2024-09-13T16:41:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T16:41:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: mgrmap e6: x(active, starting, since 0.00372678s) 2024-09-13T16:41:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:41:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T16:41:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T16:41:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T16:41:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T16:41:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: Manager daemon x is now available 2024-09-13T16:41:44.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:41:44.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:41:44.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:41:44.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:41:44.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:44 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T16:41:45.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:45 smithi018 ceph-mon[30981]: Found migration_current of "None". Setting to last migration. 2024-09-13T16:41:45.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:45 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T16:41:45.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:45 smithi018 ceph-mon[30981]: mgrmap e7: x(active, since 1.00704s) 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.159+0000 7f5c97c00640 1 Processor -- start 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.159+0000 7f5c97c00640 1 -- start start 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.159+0000 7f5c97c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c90107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.159+0000 7f5c97c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90108210 con 0x7f5c90107840 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.159+0000 7f5c95200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c90107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.160+0000 7f5c95200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c90107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45256/0 (socket says 172.21.15.18:45256) 2024-09-13T16:41:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.160+0000 7f5c95200640 1 -- 172.21.15.18:0/886870779 learned_addr learned my addr 172.21.15.18:0/886870779 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.160+0000 7f5c95200640 1 -- 172.21.15.18:0/886870779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c90108900 con 0x7f5c90107840 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.161+0000 7f5c95200640 1 --2- 172.21.15.18:0/886870779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c90107c40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c84009820 tx=0x7f5c8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef2a9169eac070c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.161+0000 7f5c8f400640 1 -- 172.21.15.18:0/886870779 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c8402ae70 con 0x7f5c90107840 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.161+0000 7f5c8f400640 1 -- 172.21.15.18:0/886870779 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5c840328e0 con 0x7f5c90107840 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.161+0000 7f5c8f400640 1 -- 172.21.15.18:0/886870779 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c840308c0 con 0x7f5c90107840 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.162+0000 7f5c97c00640 1 -- 172.21.15.18:0/886870779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 msgr2=0x7f5c90107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.162+0000 7f5c97c00640 1 --2- 172.21.15.18:0/886870779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c90107c40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c84009820 tx=0x7f5c8402a270 comp rx=0 tx=0).stop 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.162+0000 7f5c97c00640 1 -- 172.21.15.18:0/886870779 shutdown_connections 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.162+0000 7f5c97c00640 1 --2- 172.21.15.18:0/886870779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c90107c40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.162+0000 7f5c97c00640 1 -- 172.21.15.18:0/886870779 >> 172.21.15.18:0/886870779 conn(0x7f5c9007ad00 msgr2=0x7f5c9007b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.162+0000 7f5c97c00640 1 -- 172.21.15.18:0/886870779 shutdown_connections 2024-09-13T16:41:45.951 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.162+0000 7f5c97c00640 1 -- 172.21.15.18:0/886870779 wait complete. 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.163+0000 7f5c97c00640 1 Processor -- start 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.163+0000 7f5c97c00640 1 -- start start 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.164+0000 7f5c97c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c9019b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.164+0000 7f5c97c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9019b960 con 0x7f5c90107840 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.164+0000 7f5c95200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c9019b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.164+0000 7f5c95200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c9019b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45264/0 (socket says 172.21.15.18:45264) 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.164+0000 7f5c95200640 1 -- 172.21.15.18:0/3029384611 learned_addr learned my addr 172.21.15.18:0/3029384611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.164+0000 7f5c95200640 1 -- 172.21.15.18:0/3029384611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c840094d0 con 0x7f5c90107840 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.165+0000 7f5c95200640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c9019b420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c840097f0 tx=0x7f5c84030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.165+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c84032d90 con 0x7f5c90107840 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.165+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5c8403b8d0 con 0x7f5c90107840 2024-09-13T16:41:45.952 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.165+0000 7f5c97c00640 1 -- 172.21.15.18:0/3029384611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9019bb60 con 0x7f5c90107840 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.165+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c8403a780 con 0x7f5c90107840 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.165+0000 7f5c97c00640 1 -- 172.21.15.18:0/3029384611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9019c000 con 0x7f5c90107840 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.167+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f5c84039040 con 0x7f5c90107840 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.167+0000 7f5c8d600640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 0x7f5c7803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.167+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 --> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c7803b1f0 con 0x7f5c78038620 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.167+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5c8406b730 con 0x7f5c90107840 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.168+0000 7f5c8fe00640 1 -- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 msgr2=0x7f5c7803aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1236399643 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.168+0000 7f5c8fe00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 0x7f5c7803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.369+0000 7f5c8fe00640 1 -- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 msgr2=0x7f5c7803aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1236399643 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.369+0000 7f5c8fe00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 0x7f5c7803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.770+0000 7f5c8fe00640 1 -- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 msgr2=0x7f5c7803aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1236399643 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:41.770+0000 7f5c8fe00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 0x7f5c7803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T16:41:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:42.571+0000 7f5c8fe00640 1 -- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 msgr2=0x7f5c7803aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1236399643 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:42.571+0000 7f5c8fe00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 0x7f5c7803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:44.172+0000 7f5c8fe00640 1 -- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 msgr2=0x7f5c7803aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1236399643 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:44.173+0000 7f5c8fe00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 0x7f5c7803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:44.260+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7f5c84049c40 con 0x7f5c90107840 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:44.260+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 msgr2=0x7f5c7803aae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:44.260+0000 7f5c8d600640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 0x7f5c7803aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.262+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f5c8406cd40 con 0x7f5c90107840 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.262+0000 7f5c8d600640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f5c7803bf50 0x7f5c7803e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.262+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 --> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c7803b1f0 con 0x7f5c7803bf50 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.263+0000 7f5c8fe00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f5c7803bf50 0x7f5c7803e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.264+0000 7f5c8fe00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f5c7803bf50 0x7f5c7803e340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c003980 tx=0x7f5c7c009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.265+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 <== mgr.14118 v2:172.21.15.18:6800/920683112 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f5c7803b1f0 con 0x7f5c7803bf50 2024-09-13T16:41:45.954 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.271+0000 7f5c97c00640 1 -- 172.21.15.18:0/3029384611 --> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f5c9010bb30 con 0x7f5c7803bf50 2024-09-13T16:41:45.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.271+0000 7f5c8d600640 1 -- 172.21.15.18:0/3029384611 <== mgr.14118 v2:172.21.15.18:6800/920683112 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f5c9010bb30 con 0x7f5c7803bf50 2024-09-13T16:41:45.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.271+0000 7f5c97c00640 1 -- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f5c7803bf50 msgr2=0x7f5c7803e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:45.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.271+0000 7f5c97c00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f5c7803bf50 0x7f5c7803e340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c003980 tx=0x7f5c7c009290 comp rx=0 tx=0).stop 2024-09-13T16:41:45.955 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.271+0000 7f5c97c00640 1 -- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 msgr2=0x7f5c9019b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:45.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.271+0000 7f5c97c00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c9019b420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c840097f0 tx=0x7f5c84030db0 comp rx=0 tx=0).stop 2024-09-13T16:41:45.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.272+0000 7f5c97c00640 1 -- 172.21.15.18:0/3029384611 shutdown_connections 2024-09-13T16:41:45.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.272+0000 7f5c97c00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f5c7803bf50 0x7f5c7803e340 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:45.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.272+0000 7f5c97c00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:6800/1236399643,v1:172.21.15.18:6801/1236399643] conn(0x7f5c78038620 0x7f5c7803aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:45.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.272+0000 7f5c97c00640 1 --2- 172.21.15.18:0/3029384611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c90107840 0x7f5c9019b420 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:45.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.272+0000 7f5c97c00640 1 -- 172.21.15.18:0/3029384611 >> 172.21.15.18:0/3029384611 conn(0x7f5c9007ad00 msgr2=0x7f5c90105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:45.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.272+0000 7f5c97c00640 1 -- 172.21.15.18:0/3029384611 shutdown_connections 2024-09-13T16:41:45.956 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:45.272+0000 7f5c97c00640 1 -- 172.21.15.18:0/3029384611 wait complete. 2024-09-13T16:41:45.957 INFO:teuthology.orchestra.run.smithi018.stdout:mgr epoch 5 is available 2024-09-13T16:41:45.957 INFO:teuthology.orchestra.run.smithi018.stdout:Setting orchestrator backend to cephadm... 2024-09-13T16:41:46.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:46 smithi018 ceph-mon[30981]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T16:41:46.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:46 smithi018 ceph-mon[30981]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T16:41:46.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:46 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:41:46.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:46 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:41:47.373 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.420+0000 7f9320e00640 1 Processor -- start 2024-09-13T16:41:47.374 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.420+0000 7f9320e00640 1 -- start start 2024-09-13T16:41:47.374 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.420+0000 7f9320e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:47.374 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.420+0000 7f9320e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c108180 con 0x7f931c1077b0 2024-09-13T16:41:47.374 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.421+0000 7f9319e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:47.374 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.421+0000 7f9319e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45324/0 (socket says 172.21.15.18:45324) 2024-09-13T16:41:47.374 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.421+0000 7f9319e00640 1 -- 172.21.15.18:0/3180709802 learned_addr learned my addr 172.21.15.18:0/3180709802 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:47.374 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.421+0000 7f9319e00640 1 -- 172.21.15.18:0/3180709802 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c1082c0 con 0x7f931c1077b0 2024-09-13T16:41:47.374 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.422+0000 7f9319e00640 1 --2- 172.21.15.18:0/3180709802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c107bb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f930c009820 tx=0x7f930c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95f3aba7097c875 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:47.374 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.422+0000 7f9318a00640 1 -- 172.21.15.18:0/3180709802 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f930c02ae70 con 0x7f931c1077b0 2024-09-13T16:41:47.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.422+0000 7f9318a00640 1 -- 172.21.15.18:0/3180709802 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f930c0328e0 con 0x7f931c1077b0 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.422+0000 7f9318a00640 1 -- 172.21.15.18:0/3180709802 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f930c0308c0 con 0x7f931c1077b0 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.423+0000 7f9320e00640 1 -- 172.21.15.18:0/3180709802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 msgr2=0x7f931c107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.423+0000 7f9320e00640 1 --2- 172.21.15.18:0/3180709802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c107bb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f930c009820 tx=0x7f930c02a270 comp rx=0 tx=0).stop 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.423+0000 7f9320e00640 1 -- 172.21.15.18:0/3180709802 shutdown_connections 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.423+0000 7f9320e00640 1 --2- 172.21.15.18:0/3180709802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c107bb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.423+0000 7f9320e00640 1 -- 172.21.15.18:0/3180709802 >> 172.21.15.18:0/3180709802 conn(0x7f931c07ad00 msgr2=0x7f931c07b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.423+0000 7f9320e00640 1 -- 172.21.15.18:0/3180709802 shutdown_connections 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.423+0000 7f9320e00640 1 -- 172.21.15.18:0/3180709802 wait complete. 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.424+0000 7f9320e00640 1 Processor -- start 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.424+0000 7f9320e00640 1 -- start start 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.425+0000 7f9320e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:47.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.425+0000 7f9320e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c19ba00 con 0x7f931c1077b0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.425+0000 7f9319e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.425+0000 7f9319e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c19b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45334/0 (socket says 172.21.15.18:45334) 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.425+0000 7f9319e00640 1 -- 172.21.15.18:0/1056512774 learned_addr learned my addr 172.21.15.18:0/1056512774 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.425+0000 7f9319e00640 1 -- 172.21.15.18:0/1056512774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c0094d0 con 0x7f931c1077b0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.425+0000 7f9319e00640 1 --2- 172.21.15.18:0/1056512774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c19b4c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f930c02a790 tx=0x7f930c030e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.426+0000 7f9312a00640 1 -- 172.21.15.18:0/1056512774 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f930c032d90 con 0x7f931c1077b0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.426+0000 7f9312a00640 1 -- 172.21.15.18:0/1056512774 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f930c03b8d0 con 0x7f931c1077b0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.426+0000 7f9312a00640 1 -- 172.21.15.18:0/1056512774 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f930c03a800 con 0x7f931c1077b0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.426+0000 7f9320e00640 1 -- 172.21.15.18:0/1056512774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c19bc00 con 0x7f931c1077b0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.426+0000 7f9320e00640 1 -- 172.21.15.18:0/1056512774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c19c0a0 con 0x7f931c1077b0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.427+0000 7f9312a00640 1 -- 172.21.15.18:0/1056512774 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f930c039040 con 0x7f931c1077b0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.427+0000 7f9320e00640 1 -- 172.21.15.18:0/1056512774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c10bb80 con 0x7f931c1077b0 2024-09-13T16:41:47.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.427+0000 7f9312a00640 1 --2- 172.21.15.18:0/1056512774 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f93000385a0 0x7f930003aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.427+0000 7f9312a00640 1 -- 172.21.15.18:0/1056512774 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f930c06b670 con 0x7f931c1077b0 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.428+0000 7f9319400640 1 --2- 172.21.15.18:0/1056512774 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f93000385a0 0x7f930003aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.428+0000 7f9319400640 1 --2- 172.21.15.18:0/1056512774 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f93000385a0 0x7f930003aa60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f93080098c0 tx=0x7f9308006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.433+0000 7f9312a00640 1 -- 172.21.15.18:0/1056512774 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f930c03bd90 con 0x7f931c1077b0 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.629+0000 7f9320e00640 1 -- 172.21.15.18:0/1056512774 --> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f931c19e990 con 0x7f93000385a0 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.639+0000 7f9312a00640 1 -- 172.21.15.18:0/1056512774 <== mgr.14118 v2:172.21.15.18:6800/920683112 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f931c19e990 con 0x7f93000385a0 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.642+0000 7f9320e00640 1 -- 172.21.15.18:0/1056512774 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f93000385a0 msgr2=0x7f930003aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.642+0000 7f9320e00640 1 --2- 172.21.15.18:0/1056512774 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f93000385a0 0x7f930003aa60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f93080098c0 tx=0x7f9308006db0 comp rx=0 tx=0).stop 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.642+0000 7f9320e00640 1 -- 172.21.15.18:0/1056512774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 msgr2=0x7f931c19b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.642+0000 7f9320e00640 1 --2- 172.21.15.18:0/1056512774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c19b4c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f930c02a790 tx=0x7f930c030e20 comp rx=0 tx=0).stop 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.642+0000 7f9320e00640 1 -- 172.21.15.18:0/1056512774 shutdown_connections 2024-09-13T16:41:47.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.642+0000 7f9320e00640 1 --2- 172.21.15.18:0/1056512774 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f93000385a0 0x7f930003aa60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:47.382 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.642+0000 7f9320e00640 1 --2- 172.21.15.18:0/1056512774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f931c1077b0 0x7f931c19b4c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:47.382 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.642+0000 7f9320e00640 1 -- 172.21.15.18:0/1056512774 >> 172.21.15.18:0/1056512774 conn(0x7f931c07ad00 msgr2=0x7f931c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:47.382 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.642+0000 7f9320e00640 1 -- 172.21.15.18:0/1056512774 shutdown_connections 2024-09-13T16:41:47.382 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:46.642+0000 7f9320e00640 1 -- 172.21.15.18:0/1056512774 wait complete. 2024-09-13T16:41:47.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-mon[30981]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:41:47.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:41:47.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:41:47.912 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-mon[30981]: mgrmap e8: x(active, since 2s) 2024-09-13T16:41:48.210 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:47.961+0000 7ff833600640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:16:41:47] ENGINE Error in HTTPServer.serve 2024-09-13T16:41:48.210 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: Traceback (most recent call last): 2024-09-13T16:41:48.210 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:41:48.210 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: self._connections.run(self.expiration_interval) 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: self._run(expiration_interval) 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: s = self.context.wrap_socket( 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: return self.sslsocket_class._create( 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: self.do_handshake() 2024-09-13T16:41:48.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:41:48.212 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: self._sslobj.do_handshake() 2024-09-13T16:41:48.212 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:41:48.212 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:41:48.816 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:48 smithi018 ceph-mon[30981]: [13/Sep/2024:16:41:47] ENGINE Bus STARTING 2024-09-13T16:41:48.816 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:48 smithi018 ceph-mon[30981]: [13/Sep/2024:16:41:47] ENGINE Serving on http://172.21.15.18:8765 2024-09-13T16:41:48.816 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:48 smithi018 ceph-mon[30981]: [13/Sep/2024:16:41:47] ENGINE Serving on https://172.21.15.18:7150 2024-09-13T16:41:48.817 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:48 smithi018 ceph-mon[30981]: [13/Sep/2024:16:41:47] ENGINE Bus STARTED 2024-09-13T16:41:48.817 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:48 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:41:48.817 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:48 smithi018 ceph-mon[30981]: [13/Sep/2024:16:41:47] ENGINE Error in HTTPServer.serve 2024-09-13T16:41:48.817 INFO:journalctl@ceph.mon.a.smithi018.stdout: Traceback (most recent call last): 2024-09-13T16:41:48.817 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:41:48.817 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-13T16:41:48.817 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:41:48.817 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._run(expiration_interval) 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: s = self.context.wrap_socket( 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: return self.sslsocket_class._create( 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: self.do_handshake() 2024-09-13T16:41:48.818 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:41:48.819 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._sslobj.do_handshake() 2024-09-13T16:41:48.819 INFO:journalctl@ceph.mon.a.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:41:48.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:48 smithi018 ceph-mon[30981]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.918+0000 7f976fe00640 1 Processor -- start 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.918+0000 7f976fe00640 1 -- start start 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.918+0000 7f976fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f9770107c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.918+0000 7f976fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770108250 con 0x7f9770107880 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.918+0000 7f976ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f9770107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.918+0000 7f976ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f9770107c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45338/0 (socket says 172.21.15.18:45338) 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.918+0000 7f976ea00640 1 -- 172.21.15.18:0/4125604620 learned_addr learned my addr 172.21.15.18:0/4125604620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.919+0000 7f976ea00640 1 -- 172.21.15.18:0/4125604620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770108770 con 0x7f9770107880 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976ea00640 1 --2- 172.21.15.18:0/4125604620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f9770107c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9760009820 tx=0x7f976002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490aaa72924f2e1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:48.827 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976e000640 1 -- 172.21.15.18:0/4125604620 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f976002ae70 con 0x7f9770107880 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976e000640 1 -- 172.21.15.18:0/4125604620 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97600328e0 con 0x7f9770107880 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976e000640 1 -- 172.21.15.18:0/4125604620 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97600308c0 con 0x7f9770107880 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976fe00640 1 -- 172.21.15.18:0/4125604620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 msgr2=0x7f9770107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976fe00640 1 --2- 172.21.15.18:0/4125604620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f9770107c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9760009820 tx=0x7f976002a270 comp rx=0 tx=0).stop 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976fe00640 1 -- 172.21.15.18:0/4125604620 shutdown_connections 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976fe00640 1 --2- 172.21.15.18:0/4125604620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f9770107c80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976fe00640 1 -- 172.21.15.18:0/4125604620 >> 172.21.15.18:0/4125604620 conn(0x7f977007ab90 msgr2=0x7f977007afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976fe00640 1 -- 172.21.15.18:0/4125604620 shutdown_connections 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.921+0000 7f976fe00640 1 -- 172.21.15.18:0/4125604620 wait complete. 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.922+0000 7f976fe00640 1 Processor -- start 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.922+0000 7f976fe00640 1 -- start start 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.922+0000 7f976fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f977019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:48.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.922+0000 7f976fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977019b840 con 0x7f9770107880 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.922+0000 7f976ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f977019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.922+0000 7f976ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f977019b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45340/0 (socket says 172.21.15.18:45340) 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.922+0000 7f976ea00640 1 -- 172.21.15.18:0/4125774012 learned_addr learned my addr 172.21.15.18:0/4125774012 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.923+0000 7f976ea00640 1 -- 172.21.15.18:0/4125774012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600094d0 con 0x7f9770107880 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.923+0000 7f976ea00640 1 --2- 172.21.15.18:0/4125774012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f977019b300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f976002a790 tx=0x7f9760030e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.923+0000 7f9767400640 1 -- 172.21.15.18:0/4125774012 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9760032d90 con 0x7f9770107880 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.923+0000 7f9767400640 1 -- 172.21.15.18:0/4125774012 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f976003b8d0 con 0x7f9770107880 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.923+0000 7f9767400640 1 -- 172.21.15.18:0/4125774012 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f976003a800 con 0x7f9770107880 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.923+0000 7f976fe00640 1 -- 172.21.15.18:0/4125774012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977019ba40 con 0x7f9770107880 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.924+0000 7f976fe00640 1 -- 172.21.15.18:0/4125774012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977019bee0 con 0x7f9770107880 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.925+0000 7f9767400640 1 -- 172.21.15.18:0/4125774012 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f9760039040 con 0x7f9770107880 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.925+0000 7f976fe00640 1 -- 172.21.15.18:0/4125774012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977010b9a0 con 0x7f9770107880 2024-09-13T16:41:48.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.925+0000 7f9767400640 1 --2- 172.21.15.18:0/4125774012 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f9754038670 0x7f975403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.925+0000 7f9767400640 1 -- 172.21.15.18:0/4125774012 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f976006b880 con 0x7f9770107880 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.925+0000 7f9767e00640 1 --2- 172.21.15.18:0/4125774012 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f9754038670 0x7f975403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.926+0000 7f9767e00640 1 --2- 172.21.15.18:0/4125774012 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f9754038670 0x7f975403ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f97580098c0 tx=0x7f9758006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:47.930+0000 7f9767400640 1 -- 172.21.15.18:0/4125774012 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f976003bd90 con 0x7f9770107880 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.114+0000 7f976fe00640 1 -- 172.21.15.18:0/4125774012 --> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f9770105c50 con 0x7f9754038670 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.115+0000 7f9767400640 1 -- 172.21.15.18:0/4125774012 <== mgr.14118 v2:172.21.15.18:6800/920683112 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f9770105c50 con 0x7f9754038670 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.118+0000 7f976fe00640 1 -- 172.21.15.18:0/4125774012 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f9754038670 msgr2=0x7f975403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.118+0000 7f976fe00640 1 --2- 172.21.15.18:0/4125774012 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f9754038670 0x7f975403ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f97580098c0 tx=0x7f9758006db0 comp rx=0 tx=0).stop 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.118+0000 7f976fe00640 1 -- 172.21.15.18:0/4125774012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 msgr2=0x7f977019b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.118+0000 7f976fe00640 1 --2- 172.21.15.18:0/4125774012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f977019b300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f976002a790 tx=0x7f9760030e20 comp rx=0 tx=0).stop 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.118+0000 7f976fe00640 1 -- 172.21.15.18:0/4125774012 shutdown_connections 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.118+0000 7f976fe00640 1 --2- 172.21.15.18:0/4125774012 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f9754038670 0x7f975403ab30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.118+0000 7f976fe00640 1 --2- 172.21.15.18:0/4125774012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9770107880 0x7f977019b300 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:48.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.118+0000 7f976fe00640 1 -- 172.21.15.18:0/4125774012 >> 172.21.15.18:0/4125774012 conn(0x7f977007ab90 msgr2=0x7f9770105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:48.831 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.118+0000 7f976fe00640 1 -- 172.21.15.18:0/4125774012 shutdown_connections 2024-09-13T16:41:48.831 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:48.118+0000 7f976fe00640 1 -- 172.21.15.18:0/4125774012 wait complete. 2024-09-13T16:41:48.831 INFO:teuthology.orchestra.run.smithi018.stdout:Generating ssh key... 2024-09-13T16:41:50.081 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: Generating public/private rsa key pair. 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: Your identification has been saved in /tmp/tmp9t72i3xv/key 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: Your public key has been saved in /tmp/tmp9t72i3xv/key.pub 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: The key fingerprint is: 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: SHA256:GCM/R4ui85rRaRjjQ0839iwflvszYzjYKbQbsEn69PQ ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: The key's randomart image is: 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: +---[RSA 3072]----+ 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: | | 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: | | 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: | . o . | 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: | o * . | 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: | + = O S | 2024-09-13T16:41:50.082 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: | o @ O.* . | 2024-09-13T16:41:50.083 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: | O O.++*o | 2024-09-13T16:41:50.083 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: | X o+*=o= | 2024-09-13T16:41:50.083 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: | o.o ooE+.+ | 2024-09-13T16:41:50.083 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:41:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: +----[SHA256]-----+ 2024-09-13T16:41:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.334+0000 7febe5800640 1 Processor -- start 2024-09-13T16:41:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.334+0000 7febe5800640 1 -- start start 2024-09-13T16:41:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.334+0000 7febe5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe01058f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.334+0000 7febe5800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe0105ec0 con 0x7febe01054f0 2024-09-13T16:41:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.335+0000 7febdea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe01058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.335+0000 7febdea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe01058f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45352/0 (socket says 172.21.15.18:45352) 2024-09-13T16:41:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.335+0000 7febdea00640 1 -- 172.21.15.18:0/3945165102 learned_addr learned my addr 172.21.15.18:0/3945165102 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.335+0000 7febdea00640 1 -- 172.21.15.18:0/3945165102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe01066f0 con 0x7febe01054f0 2024-09-13T16:41:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.336+0000 7febdea00640 1 --2- 172.21.15.18:0/3945165102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe01058f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7febd0009820 tx=0x7febd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6af47fee084c33b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.336+0000 7febde000640 1 -- 172.21.15.18:0/3945165102 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febd002ae70 con 0x7febe01054f0 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.336+0000 7febde000640 1 -- 172.21.15.18:0/3945165102 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7febd00328e0 con 0x7febe01054f0 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.336+0000 7febde000640 1 -- 172.21.15.18:0/3945165102 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febd00308c0 con 0x7febe01054f0 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.337+0000 7febe5800640 1 -- 172.21.15.18:0/3945165102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 msgr2=0x7febe01058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.337+0000 7febe5800640 1 --2- 172.21.15.18:0/3945165102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe01058f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7febd0009820 tx=0x7febd002a270 comp rx=0 tx=0).stop 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.337+0000 7febe5800640 1 -- 172.21.15.18:0/3945165102 shutdown_connections 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.337+0000 7febe5800640 1 --2- 172.21.15.18:0/3945165102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe01058f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.337+0000 7febe5800640 1 -- 172.21.15.18:0/3945165102 >> 172.21.15.18:0/3945165102 conn(0x7febe0100ce0 msgr2=0x7febe0103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.338+0000 7febe5800640 1 -- 172.21.15.18:0/3945165102 shutdown_connections 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.338+0000 7febe5800640 1 -- 172.21.15.18:0/3945165102 wait complete. 2024-09-13T16:41:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.339+0000 7febe5800640 1 Processor -- start 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.339+0000 7febe5800640 1 -- start start 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.339+0000 7febe5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe0199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.339+0000 7febe5800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe0199780 con 0x7febe01054f0 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.339+0000 7febdea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe0199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.339+0000 7febdea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe0199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45354/0 (socket says 172.21.15.18:45354) 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.339+0000 7febdea00640 1 -- 172.21.15.18:0/1974881743 learned_addr learned my addr 172.21.15.18:0/1974881743 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.340+0000 7febdea00640 1 -- 172.21.15.18:0/1974881743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd00094d0 con 0x7febe01054f0 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.340+0000 7febdea00640 1 --2- 172.21.15.18:0/1974881743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe0199240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7febd00097f0 tx=0x7febd0030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.340+0000 7febd7400640 1 -- 172.21.15.18:0/1974881743 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febd0032d90 con 0x7febe01054f0 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.340+0000 7febd7400640 1 -- 172.21.15.18:0/1974881743 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7febd003b8d0 con 0x7febe01054f0 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.340+0000 7febd7400640 1 -- 172.21.15.18:0/1974881743 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febd003a780 con 0x7febe01054f0 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.340+0000 7febe5800640 1 -- 172.21.15.18:0/1974881743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe0199980 con 0x7febe01054f0 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.341+0000 7febe5800640 1 -- 172.21.15.18:0/1974881743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe0199e20 con 0x7febe01054f0 2024-09-13T16:41:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.342+0000 7febd7400640 1 -- 172.21.15.18:0/1974881743 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7febd0039040 con 0x7febe01054f0 2024-09-13T16:41:50.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.342+0000 7febe5800640 1 -- 172.21.15.18:0/1974881743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe0109920 con 0x7febe01054f0 2024-09-13T16:41:50.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.342+0000 7febd7400640 1 --2- 172.21.15.18:0/1974881743 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 0x7febc403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:50.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.342+0000 7febd7400640 1 -- 172.21.15.18:0/1974881743 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7febd006b7c0 con 0x7febe01054f0 2024-09-13T16:41:50.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.343+0000 7febd7e00640 1 --2- 172.21.15.18:0/1974881743 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 0x7febc403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:50.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.343+0000 7febd7e00640 1 --2- 172.21.15.18:0/1974881743 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 0x7febc403ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7febc80098c0 tx=0x7febc8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:50.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.347+0000 7febd7400640 1 -- 172.21.15.18:0/1974881743 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7febd003ba40 con 0x7febe01054f0 2024-09-13T16:41:50.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.527+0000 7febe5800640 1 -- 172.21.15.18:0/1974881743 --> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7febe0101f20 con 0x7febc4038670 2024-09-13T16:41:50.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.755+0000 7febd7400640 1 -- 172.21.15.18:0/1974881743 <== mgr.14118 v2:172.21.15.18:6800/920683112 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7febe0101f20 con 0x7febc4038670 2024-09-13T16:41:50.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.757+0000 7febe5800640 1 -- 172.21.15.18:0/1974881743 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 msgr2=0x7febc403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:50.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.757+0000 7febe5800640 1 --2- 172.21.15.18:0/1974881743 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 0x7febc403ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7febc80098c0 tx=0x7febc8006db0 comp rx=0 tx=0).stop 2024-09-13T16:41:50.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.757+0000 7febe5800640 1 -- 172.21.15.18:0/1974881743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 msgr2=0x7febe0199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:50.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.757+0000 7febe5800640 1 --2- 172.21.15.18:0/1974881743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe0199240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7febd00097f0 tx=0x7febd0030db0 comp rx=0 tx=0).stop 2024-09-13T16:41:50.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.757+0000 7febe5800640 1 -- 172.21.15.18:0/1974881743 shutdown_connections 2024-09-13T16:41:50.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.757+0000 7febe5800640 1 --2- 172.21.15.18:0/1974881743 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 0x7febc403ab30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:50.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.757+0000 7febe5800640 1 --2- 172.21.15.18:0/1974881743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe01054f0 0x7febe0199240 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:50.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.757+0000 7febe5800640 1 -- 172.21.15.18:0/1974881743 >> 172.21.15.18:0/1974881743 conn(0x7febe0100ce0 msgr2=0x7febe0101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:50.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.757+0000 7febe5800640 1 -- 172.21.15.18:0/1974881743 shutdown_connections 2024-09-13T16:41:50.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:49.757+0000 7febe5800640 1 -- 172.21.15.18:0/1974881743 wait complete. 2024-09-13T16:41:50.908 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:50 smithi018 ceph-mon[30981]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:41:50.909 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:50 smithi018 ceph-mon[30981]: Generating ssh key... 2024-09-13T16:41:50.909 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:50 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:41:50.909 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:50 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:41:51.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCT76eZCCQ0SSUjIVsJk9Ls334X2CgXXGNzpkZbLAVONWOdm3yrYtEnX8KcvoTQNTt/gaR+9a/NkmLi6+wJy7Ain02Vr/SFSkBHNqsatI2DfQup0roXMcGWiVwXXM9UN8T/eR5HG5HnAzYJXmDz98EFkimzMIM+1iXGF5BmDSac+3ox4NhOXJBIrx8Zlw1RmoVJNAkpB9lbAn1bpIy1CwBd4o2InV4+fh7oQGBR24+2DdYxOSXpYkjuXu/M8OD1VtPLbdHYNOgb0EVkKQZRRQ4hYrkRy2ipqd57NbzNu8NqLqQp8Awin9ZjnkX+Kt8174Vset/Wng2hPZlLnXM4WjWGJMBJri6TFvC/OFToO7dFQ8A9oL/XvS+QW7fdhPmdScEzB4G5e9aj6RdKXpurgKlKvMiMqlr4Oy1vDYTMCB17AWGQGidVRkn6j7iiNrHxBvdz4oxigZTvDA8Lo9WcOIwJHVJalMbgRMWHSE/KOEVOjThrIlvkigZwp4MhId9xnmU= ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:41:51.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.907+0000 7febdf200640 1 Processor -- start 2024-09-13T16:41:51.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.907+0000 7febdf200640 1 -- start start 2024-09-13T16:41:51.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.907+0000 7febdf200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0105720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:51.812 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.907+0000 7febdf200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe0105cf0 con 0x7febe0105320 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.908+0000 7febdde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0105720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.908+0000 7febdde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0105720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49850/0 (socket says 172.21.15.18:49850) 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.908+0000 7febdde00640 1 -- 172.21.15.18:0/4145320015 learned_addr learned my addr 172.21.15.18:0/4145320015 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.908+0000 7febdde00640 1 -- 172.21.15.18:0/4145320015 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0106520 con 0x7febe0105320 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.909+0000 7febdde00640 1 --2- 172.21.15.18:0/4145320015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0105720 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7febd0009820 tx=0x7febd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7fa3bc4db29f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.909+0000 7febdca00640 1 -- 172.21.15.18:0/4145320015 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febd002ae70 con 0x7febe0105320 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.909+0000 7febdca00640 1 -- 172.21.15.18:0/4145320015 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7febd00328e0 con 0x7febe0105320 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.909+0000 7febdca00640 1 -- 172.21.15.18:0/4145320015 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febd00308c0 con 0x7febe0105320 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.910+0000 7febdf200640 1 -- 172.21.15.18:0/4145320015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 msgr2=0x7febe0105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.910+0000 7febdf200640 1 --2- 172.21.15.18:0/4145320015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0105720 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7febd0009820 tx=0x7febd002a270 comp rx=0 tx=0).stop 2024-09-13T16:41:51.813 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.910+0000 7febdf200640 1 -- 172.21.15.18:0/4145320015 shutdown_connections 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.910+0000 7febdf200640 1 --2- 172.21.15.18:0/4145320015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0105720 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.910+0000 7febdf200640 1 -- 172.21.15.18:0/4145320015 >> 172.21.15.18:0/4145320015 conn(0x7febe0100b10 msgr2=0x7febe0102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.910+0000 7febdf200640 1 -- 172.21.15.18:0/4145320015 shutdown_connections 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.910+0000 7febdf200640 1 -- 172.21.15.18:0/4145320015 wait complete. 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.911+0000 7febdf200640 1 Processor -- start 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.911+0000 7febdf200640 1 -- start start 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.911+0000 7febdf200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.911+0000 7febdf200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe0199580 con 0x7febe0105320 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.912+0000 7febdde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.912+0000 7febdde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49858/0 (socket says 172.21.15.18:49858) 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.912+0000 7febdde00640 1 -- 172.21.15.18:0/3105067697 learned_addr learned my addr 172.21.15.18:0/3105067697 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.912+0000 7febdde00640 1 -- 172.21.15.18:0/3105067697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd00094d0 con 0x7febe0105320 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.912+0000 7febdde00640 1 --2- 172.21.15.18:0/3105067697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0199040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febd00305d0 tx=0x7febd0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:51.814 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.913+0000 7febd6a00640 1 -- 172.21.15.18:0/3105067697 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febd0032c60 con 0x7febe0105320 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.913+0000 7febd6a00640 1 -- 172.21.15.18:0/3105067697 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7febd0032dc0 con 0x7febe0105320 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.913+0000 7febd6a00640 1 -- 172.21.15.18:0/3105067697 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febd003a770 con 0x7febe0105320 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.913+0000 7febdf200640 1 -- 172.21.15.18:0/3105067697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe0199780 con 0x7febe0105320 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.913+0000 7febdf200640 1 -- 172.21.15.18:0/3105067697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe0199c20 con 0x7febe0105320 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.914+0000 7febd6a00640 1 -- 172.21.15.18:0/3105067697 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7febd0039040 con 0x7febe0105320 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.914+0000 7febdf200640 1 -- 172.21.15.18:0/3105067697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe0109750 con 0x7febe0105320 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.914+0000 7febd6a00640 1 --2- 172.21.15.18:0/3105067697 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 0x7febc403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.914+0000 7febd6a00640 1 -- 172.21.15.18:0/3105067697 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7febd006b7c0 con 0x7febe0105320 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.915+0000 7febdd400640 1 --2- 172.21.15.18:0/3105067697 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 0x7febc403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.916+0000 7febdd400640 1 --2- 172.21.15.18:0/3105067697 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 0x7febc403ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7febcc0098c0 tx=0x7febcc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:51.815 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:50.920+0000 7febd6a00640 1 -- 172.21.15.18:0/3105067697 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7febd003bbd0 con 0x7febe0105320 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.104+0000 7febdf200640 1 -- 172.21.15.18:0/3105067697 --> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7febe0101d90 con 0x7febc4038670 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.105+0000 7febd6a00640 1 -- 172.21.15.18:0/3105067697 <== mgr.14118 v2:172.21.15.18:6800/920683112 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7febe0101d90 con 0x7febc4038670 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.107+0000 7febdf200640 1 -- 172.21.15.18:0/3105067697 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 msgr2=0x7febc403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.107+0000 7febdf200640 1 --2- 172.21.15.18:0/3105067697 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 0x7febc403ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7febcc0098c0 tx=0x7febcc006db0 comp rx=0 tx=0).stop 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.107+0000 7febdf200640 1 -- 172.21.15.18:0/3105067697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 msgr2=0x7febe0199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.107+0000 7febdf200640 1 --2- 172.21.15.18:0/3105067697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0199040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febd00305d0 tx=0x7febd0032670 comp rx=0 tx=0).stop 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.107+0000 7febdf200640 1 -- 172.21.15.18:0/3105067697 shutdown_connections 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.107+0000 7febdf200640 1 --2- 172.21.15.18:0/3105067697 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7febc4038670 0x7febc403ab30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.107+0000 7febdf200640 1 --2- 172.21.15.18:0/3105067697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0105320 0x7febe0199040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.107+0000 7febdf200640 1 -- 172.21.15.18:0/3105067697 >> 172.21.15.18:0/3105067697 conn(0x7febe0100b10 msgr2=0x7febe0101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.108+0000 7febdf200640 1 -- 172.21.15.18:0/3105067697 shutdown_connections 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:51.108+0000 7febdf200640 1 -- 172.21.15.18:0/3105067697 wait complete. 2024-09-13T16:41:51.816 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T16:41:51.817 INFO:teuthology.orchestra.run.smithi018.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T16:41:51.821 INFO:teuthology.orchestra.run.smithi018.stdout:Adding host smithi018... 2024-09-13T16:41:51.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:51 smithi018 ceph-mon[30981]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:41:53.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:53 smithi018 ceph-mon[30981]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:41:54.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:54 smithi018 ceph-mon[30981]: Deploying cephadm binary to smithi018 2024-09-13T16:41:57.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Added host 'smithi018' with addr '172.21.15.18' 2024-09-13T16:41:57.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.338+0000 7f6480200640 1 Processor -- start 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.338+0000 7f6480200640 1 -- start start 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.338+0000 7f6480200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647807f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.338+0000 7f6480200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647807fe60 con 0x7f647807f490 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.338+0000 7f647d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647807f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.339+0000 7f647d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647807f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49862/0 (socket says 172.21.15.18:49862) 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.339+0000 7f647d800640 1 -- 172.21.15.18:0/2255614771 learned_addr learned my addr 172.21.15.18:0/2255614771 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.339+0000 7f647d800640 1 -- 172.21.15.18:0/2255614771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647810ccf0 con 0x7f647807f490 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.340+0000 7f647d800640 1 --2- 172.21.15.18:0/2255614771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647807f890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f646c009820 tx=0x7f646c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4daed94eee25a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.340+0000 7f6477e00640 1 -- 172.21.15.18:0/2255614771 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c02ae70 con 0x7f647807f490 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.340+0000 7f6477e00640 1 -- 172.21.15.18:0/2255614771 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f646c0328e0 con 0x7f647807f490 2024-09-13T16:41:57.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.340+0000 7f6477e00640 1 -- 172.21.15.18:0/2255614771 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c0308c0 con 0x7f647807f490 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.341+0000 7f6480200640 1 -- 172.21.15.18:0/2255614771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 msgr2=0x7f647807f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.341+0000 7f6480200640 1 --2- 172.21.15.18:0/2255614771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647807f890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f646c009820 tx=0x7f646c02a270 comp rx=0 tx=0).stop 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.341+0000 7f6480200640 1 -- 172.21.15.18:0/2255614771 shutdown_connections 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.341+0000 7f6480200640 1 --2- 172.21.15.18:0/2255614771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647807f890 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.341+0000 7f6480200640 1 -- 172.21.15.18:0/2255614771 >> 172.21.15.18:0/2255614771 conn(0x7f647807ac90 msgr2=0x7f647807d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.341+0000 7f6480200640 1 -- 172.21.15.18:0/2255614771 shutdown_connections 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.341+0000 7f6480200640 1 -- 172.21.15.18:0/2255614771 wait complete. 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.342+0000 7f6480200640 1 Processor -- start 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.342+0000 7f6480200640 1 -- start start 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.342+0000 7f6480200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647819f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.342+0000 7f6480200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647819fe60 con 0x7f647807f490 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.342+0000 7f647d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647819f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:57.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.342+0000 7f647d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647819f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49878/0 (socket says 172.21.15.18:49878) 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.342+0000 7f647d800640 1 -- 172.21.15.18:0/500960420 learned_addr learned my addr 172.21.15.18:0/500960420 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.343+0000 7f647d800640 1 -- 172.21.15.18:0/500960420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0094d0 con 0x7f647807f490 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.343+0000 7f647d800640 1 --2- 172.21.15.18:0/500960420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647819f920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f646c0305d0 tx=0x7f646c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.343+0000 7f6476000640 1 -- 172.21.15.18:0/500960420 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c032c60 con 0x7f647807f490 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.343+0000 7f6476000640 1 -- 172.21.15.18:0/500960420 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f646c032dc0 con 0x7f647807f490 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.343+0000 7f6476000640 1 -- 172.21.15.18:0/500960420 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c03a770 con 0x7f647807f490 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.343+0000 7f6480200640 1 -- 172.21.15.18:0/500960420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647810db70 con 0x7f647807f490 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.344+0000 7f6480200640 1 -- 172.21.15.18:0/500960420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64781a0370 con 0x7f647807f490 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.344+0000 7f6476000640 1 -- 172.21.15.18:0/500960420 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f646c039040 con 0x7f647807f490 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.345+0000 7f6480200640 1 -- 172.21.15.18:0/500960420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647807f890 con 0x7f647807f490 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.345+0000 7f6476000640 1 --2- 172.21.15.18:0/500960420 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f6460038670 0x7f646003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:57.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.345+0000 7f6476000640 1 -- 172.21.15.18:0/500960420 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f646c06b7c0 con 0x7f647807f490 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.345+0000 7f647ce00640 1 --2- 172.21.15.18:0/500960420 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f6460038670 0x7f646003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.346+0000 7f647ce00640 1 --2- 172.21.15.18:0/500960420 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f6460038670 0x7f646003ab30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f64640098c0 tx=0x7f6464006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.350+0000 7f6476000640 1 -- 172.21.15.18:0/500960420 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f646c031580 con 0x7f647807f490 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:52.535+0000 7f6480200640 1 -- 172.21.15.18:0/500960420 --> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}) v1 -- 0x7f647807beb0 con 0x7f6460038670 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.491+0000 7f6476000640 1 -- 172.21.15.18:0/500960420 <== mgr.14118 v2:172.21.15.18:6800/920683112 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f647807beb0 con 0x7f6460038670 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.494+0000 7f6480200640 1 -- 172.21.15.18:0/500960420 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f6460038670 msgr2=0x7f646003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.494+0000 7f6480200640 1 --2- 172.21.15.18:0/500960420 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f6460038670 0x7f646003ab30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f64640098c0 tx=0x7f6464006db0 comp rx=0 tx=0).stop 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.494+0000 7f6480200640 1 -- 172.21.15.18:0/500960420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 msgr2=0x7f647819f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.494+0000 7f6480200640 1 --2- 172.21.15.18:0/500960420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647819f920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f646c0305d0 tx=0x7f646c032670 comp rx=0 tx=0).stop 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.494+0000 7f6480200640 1 -- 172.21.15.18:0/500960420 shutdown_connections 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.494+0000 7f6480200640 1 --2- 172.21.15.18:0/500960420 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f6460038670 0x7f646003ab30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.494+0000 7f6480200640 1 --2- 172.21.15.18:0/500960420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f647807f490 0x7f647819f920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:57.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.494+0000 7f6480200640 1 -- 172.21.15.18:0/500960420 >> 172.21.15.18:0/500960420 conn(0x7f647807ac90 msgr2=0x7f647807b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:57.169 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.494+0000 7f6480200640 1 -- 172.21.15.18:0/500960420 shutdown_connections 2024-09-13T16:41:57.169 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:56.494+0000 7f6480200640 1 -- 172.21.15.18:0/500960420 wait complete. 2024-09-13T16:41:57.169 INFO:teuthology.orchestra.run.smithi018.stdout:Deploying unmanaged mon service... 2024-09-13T16:41:57.698 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:57 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:41:57.698 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:57 smithi018 ceph-mon[30981]: Added host smithi018 2024-09-13T16:41:57.698 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:57 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:41:58.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:58 smithi018 ceph-mon[30981]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:41:58.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:58 smithi018 ceph-mon[30981]: Saving service mon spec with placement count:5 2024-09-13T16:41:58.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:41:58 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:41:59.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.707+0000 7fe95ac00640 1 Processor -- start 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.707+0000 7fe95ac00640 1 -- start start 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.708+0000 7fe95ac00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe954107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.708+0000 7fe95ac00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe954108210 con 0x7fe954107840 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.708+0000 7fe953e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe954107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.708+0000 7fe953e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe954107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49894/0 (socket says 172.21.15.18:49894) 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.708+0000 7fe953e00640 1 -- 172.21.15.18:0/2566377726 learned_addr learned my addr 172.21.15.18:0/2566377726 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.709+0000 7fe953e00640 1 -- 172.21.15.18:0/2566377726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954108890 con 0x7fe954107840 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.710+0000 7fe953e00640 1 --2- 172.21.15.18:0/2566377726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe954107c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe944009820 tx=0x7fe94402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a937c552759a5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.710+0000 7fe953400640 1 -- 172.21.15.18:0/2566377726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe94402ae70 con 0x7fe954107840 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.710+0000 7fe953400640 1 -- 172.21.15.18:0/2566377726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe9440328e0 con 0x7fe954107840 2024-09-13T16:41:59.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.710+0000 7fe953400640 1 -- 172.21.15.18:0/2566377726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9440308c0 con 0x7fe954107840 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.710+0000 7fe95ac00640 1 -- 172.21.15.18:0/2566377726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 msgr2=0x7fe954107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.710+0000 7fe95ac00640 1 --2- 172.21.15.18:0/2566377726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe954107c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe944009820 tx=0x7fe94402a270 comp rx=0 tx=0).stop 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.711+0000 7fe95ac00640 1 -- 172.21.15.18:0/2566377726 shutdown_connections 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.711+0000 7fe95ac00640 1 --2- 172.21.15.18:0/2566377726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe954107c40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.711+0000 7fe95ac00640 1 -- 172.21.15.18:0/2566377726 >> 172.21.15.18:0/2566377726 conn(0x7fe95407aca0 msgr2=0x7fe95407b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.711+0000 7fe95ac00640 1 -- 172.21.15.18:0/2566377726 shutdown_connections 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.711+0000 7fe95ac00640 1 -- 172.21.15.18:0/2566377726 wait complete. 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.712+0000 7fe95ac00640 1 Processor -- start 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.712+0000 7fe95ac00640 1 -- start start 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.712+0000 7fe95ac00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe95419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.712+0000 7fe95ac00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95419b9b0 con 0x7fe954107840 2024-09-13T16:41:59.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.712+0000 7fe953e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe95419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.712+0000 7fe953e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe95419b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49904/0 (socket says 172.21.15.18:49904) 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.712+0000 7fe953e00640 1 -- 172.21.15.18:0/2234545953 learned_addr learned my addr 172.21.15.18:0/2234545953 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.713+0000 7fe953e00640 1 -- 172.21.15.18:0/2234545953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440094d0 con 0x7fe954107840 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.713+0000 7fe953e00640 1 --2- 172.21.15.18:0/2234545953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe95419b470 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe9440305d0 tx=0x7fe944032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.713+0000 7fe951600640 1 -- 172.21.15.18:0/2234545953 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe944032d90 con 0x7fe954107840 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.713+0000 7fe951600640 1 -- 172.21.15.18:0/2234545953 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe94403b8d0 con 0x7fe954107840 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.713+0000 7fe951600640 1 -- 172.21.15.18:0/2234545953 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe94403a800 con 0x7fe954107840 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.713+0000 7fe95ac00640 1 -- 172.21.15.18:0/2234545953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95419bbb0 con 0x7fe954107840 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.713+0000 7fe95ac00640 1 -- 172.21.15.18:0/2234545953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95419c050 con 0x7fe954107840 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.714+0000 7fe951600640 1 -- 172.21.15.18:0/2234545953 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fe944039040 con 0x7fe954107840 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.714+0000 7fe95ac00640 1 -- 172.21.15.18:0/2234545953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95410bac0 con 0x7fe954107840 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.715+0000 7fe951600640 1 --2- 172.21.15.18:0/2234545953 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fe938038620 0x7fe93803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:41:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.715+0000 7fe951600640 1 -- 172.21.15.18:0/2234545953 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe94406b8e0 con 0x7fe954107840 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.715+0000 7fe94be00640 1 --2- 172.21.15.18:0/2234545953 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fe938038620 0x7fe93803aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.716+0000 7fe94be00640 1 --2- 172.21.15.18:0/2234545953 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fe938038620 0x7fe93803aae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0098c0 tx=0x7fe93c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.720+0000 7fe951600640 1 -- 172.21.15.18:0/2234545953 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe94403bdb0 con 0x7fe954107840 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.921+0000 7fe95ac00640 1 -- 172.21.15.18:0/2234545953 --> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe954105c40 con 0x7fe938038620 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.927+0000 7fe951600640 1 -- 172.21.15.18:0/2234545953 <== mgr.14118 v2:172.21.15.18:6800/920683112 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe954105c40 con 0x7fe938038620 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.929+0000 7fe95ac00640 1 -- 172.21.15.18:0/2234545953 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fe938038620 msgr2=0x7fe93803aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.929+0000 7fe95ac00640 1 --2- 172.21.15.18:0/2234545953 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fe938038620 0x7fe93803aae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0098c0 tx=0x7fe93c006db0 comp rx=0 tx=0).stop 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.929+0000 7fe95ac00640 1 -- 172.21.15.18:0/2234545953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 msgr2=0x7fe95419b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.929+0000 7fe95ac00640 1 --2- 172.21.15.18:0/2234545953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe95419b470 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe9440305d0 tx=0x7fe944032670 comp rx=0 tx=0).stop 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.930+0000 7fe95ac00640 1 -- 172.21.15.18:0/2234545953 shutdown_connections 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.930+0000 7fe95ac00640 1 --2- 172.21.15.18:0/2234545953 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fe938038620 0x7fe93803aae0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:59.599 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.930+0000 7fe95ac00640 1 --2- 172.21.15.18:0/2234545953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe954107840 0x7fe95419b470 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:41:59.600 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.930+0000 7fe95ac00640 1 -- 172.21.15.18:0/2234545953 >> 172.21.15.18:0/2234545953 conn(0x7fe95407aca0 msgr2=0x7fe954105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:41:59.600 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.930+0000 7fe95ac00640 1 -- 172.21.15.18:0/2234545953 shutdown_connections 2024-09-13T16:41:59.600 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:41:57.930+0000 7fe95ac00640 1 -- 172.21.15.18:0/2234545953 wait complete. 2024-09-13T16:41:59.600 INFO:teuthology.orchestra.run.smithi018.stdout:Deploying unmanaged mgr service... 2024-09-13T16:42:00.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:00 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:42:00.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:00 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:42:00.959 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.079+0000 7ffb5f000640 1 Processor -- start 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.079+0000 7ffb5f000640 1 -- start start 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.080+0000 7ffb5f000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581058d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.080+0000 7ffb5f000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb58105ea0 con 0x7ffb581054d0 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.080+0000 7ffb57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.080+0000 7ffb57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581058d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49912/0 (socket says 172.21.15.18:49912) 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.080+0000 7ffb57e00640 1 -- 172.21.15.18:0/1474918454 learned_addr learned my addr 172.21.15.18:0/1474918454 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.080+0000 7ffb57e00640 1 -- 172.21.15.18:0/1474918454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb581066d0 con 0x7ffb581054d0 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.081+0000 7ffb57e00640 1 --2- 172.21.15.18:0/1474918454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581058d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009820 tx=0x7ffb4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41de20feb5190f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.082+0000 7ffb56a00640 1 -- 172.21.15.18:0/1474918454 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb4802ae70 con 0x7ffb581054d0 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.082+0000 7ffb56a00640 1 -- 172.21.15.18:0/1474918454 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb48032900 con 0x7ffb581054d0 2024-09-13T16:42:00.960 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.082+0000 7ffb56a00640 1 -- 172.21.15.18:0/1474918454 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb48030880 con 0x7ffb581054d0 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.082+0000 7ffb5f000640 1 -- 172.21.15.18:0/1474918454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 msgr2=0x7ffb581058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.082+0000 7ffb5f000640 1 --2- 172.21.15.18:0/1474918454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581058d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009820 tx=0x7ffb4802a270 comp rx=0 tx=0).stop 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.082+0000 7ffb5f000640 1 -- 172.21.15.18:0/1474918454 shutdown_connections 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.082+0000 7ffb5f000640 1 --2- 172.21.15.18:0/1474918454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581058d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.082+0000 7ffb5f000640 1 -- 172.21.15.18:0/1474918454 >> 172.21.15.18:0/1474918454 conn(0x7ffb58100c40 msgr2=0x7ffb581030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.083+0000 7ffb5f000640 1 -- 172.21.15.18:0/1474918454 shutdown_connections 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.083+0000 7ffb5f000640 1 -- 172.21.15.18:0/1474918454 wait complete. 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.084+0000 7ffb5f000640 1 Processor -- start 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.084+0000 7ffb5f000640 1 -- start start 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.084+0000 7ffb5f000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.084+0000 7ffb5f000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb58199710 con 0x7ffb581054d0 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.084+0000 7ffb57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:00.961 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.084+0000 7ffb57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49920/0 (socket says 172.21.15.18:49920) 2024-09-13T16:42:00.962 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.084+0000 7ffb57e00640 1 -- 172.21.15.18:0/193310203 learned_addr learned my addr 172.21.15.18:0/193310203 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:00.962 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.085+0000 7ffb57e00640 1 -- 172.21.15.18:0/193310203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb480094d0 con 0x7ffb581054d0 2024-09-13T16:42:00.962 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.085+0000 7ffb57e00640 1 --2- 172.21.15.18:0/193310203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581991d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb48030410 tx=0x7ffb48032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:00.962 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.085+0000 7ffb54c00640 1 -- 172.21.15.18:0/193310203 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb48032c80 con 0x7ffb581054d0 2024-09-13T16:42:00.962 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.085+0000 7ffb54c00640 1 -- 172.21.15.18:0/193310203 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb48032de0 con 0x7ffb581054d0 2024-09-13T16:42:00.962 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.085+0000 7ffb5f000640 1 -- 172.21.15.18:0/193310203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb58199910 con 0x7ffb581054d0 2024-09-13T16:42:00.962 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.085+0000 7ffb54c00640 1 -- 172.21.15.18:0/193310203 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb4803a780 con 0x7ffb581054d0 2024-09-13T16:42:00.963 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.085+0000 7ffb5f000640 1 -- 172.21.15.18:0/193310203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb58199db0 con 0x7ffb581054d0 2024-09-13T16:42:00.963 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.087+0000 7ffb54c00640 1 -- 172.21.15.18:0/193310203 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7ffb48039040 con 0x7ffb581054d0 2024-09-13T16:42:00.963 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.087+0000 7ffb5f000640 1 -- 172.21.15.18:0/193310203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb58109900 con 0x7ffb581054d0 2024-09-13T16:42:00.963 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.087+0000 7ffb54c00640 1 --2- 172.21.15.18:0/193310203 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7ffb3c038620 0x7ffb3c03aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:00.963 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.088+0000 7ffb57400640 1 --2- 172.21.15.18:0/193310203 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7ffb3c038620 0x7ffb3c03aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:00.963 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.089+0000 7ffb57400640 1 --2- 172.21.15.18:0/193310203 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7ffb3c038620 0x7ffb3c03aae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb440098c0 tx=0x7ffb44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:00.963 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.089+0000 7ffb54c00640 1 -- 172.21.15.18:0/193310203 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ffb48031580 con 0x7ffb581054d0 2024-09-13T16:42:00.963 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.094+0000 7ffb54c00640 1 -- 172.21.15.18:0/193310203 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffb4803bbb0 con 0x7ffb581054d0 2024-09-13T16:42:00.964 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.298+0000 7ffb5f000640 1 -- 172.21.15.18:0/193310203 --> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ffb58101e70 con 0x7ffb3c038620 2024-09-13T16:42:00.964 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.303+0000 7ffb54c00640 1 -- 172.21.15.18:0/193310203 <== mgr.14118 v2:172.21.15.18:6800/920683112 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ffb58101e70 con 0x7ffb3c038620 2024-09-13T16:42:00.964 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.305+0000 7ffb5f000640 1 -- 172.21.15.18:0/193310203 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7ffb3c038620 msgr2=0x7ffb3c03aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:00.964 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.305+0000 7ffb5f000640 1 --2- 172.21.15.18:0/193310203 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7ffb3c038620 0x7ffb3c03aae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb440098c0 tx=0x7ffb44006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:00.964 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.305+0000 7ffb5f000640 1 -- 172.21.15.18:0/193310203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 msgr2=0x7ffb581991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:00.964 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.305+0000 7ffb5f000640 1 --2- 172.21.15.18:0/193310203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581991d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb48030410 tx=0x7ffb48032670 comp rx=0 tx=0).stop 2024-09-13T16:42:00.964 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.305+0000 7ffb5f000640 1 -- 172.21.15.18:0/193310203 shutdown_connections 2024-09-13T16:42:00.965 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.305+0000 7ffb5f000640 1 --2- 172.21.15.18:0/193310203 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7ffb3c038620 0x7ffb3c03aae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:00.965 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.305+0000 7ffb5f000640 1 --2- 172.21.15.18:0/193310203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb581054d0 0x7ffb581991d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:00.965 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.305+0000 7ffb5f000640 1 -- 172.21.15.18:0/193310203 >> 172.21.15.18:0/193310203 conn(0x7ffb58100c40 msgr2=0x7ffb58101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:00.965 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.306+0000 7ffb5f000640 1 -- 172.21.15.18:0/193310203 shutdown_connections 2024-09-13T16:42:00.965 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:00.306+0000 7ffb5f000640 1 -- 172.21.15.18:0/193310203 wait complete. 2024-09-13T16:42:01.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:01 smithi018 ceph-mon[30981]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:42:01.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:01 smithi018 ceph-mon[30981]: Saving service mgr spec with placement count:2 2024-09-13T16:42:01.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:01 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:42:02.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:02 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4260759704' entity='client.admin' 2024-09-13T16:42:02.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:02 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:42:02.865 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.504+0000 7f813d200640 1 Processor -- start 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.504+0000 7f813d200640 1 -- start start 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.504+0000 7f813d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813807f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.504+0000 7f813d200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813807fe80 con 0x7f813807f4b0 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.505+0000 7f8135e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813807f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.505+0000 7f8135e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813807f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53574/0 (socket says 172.21.15.18:53574) 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.505+0000 7f8135e00640 1 -- 172.21.15.18:0/860427038 learned_addr learned my addr 172.21.15.18:0/860427038 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.505+0000 7f8135e00640 1 -- 172.21.15.18:0/860427038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813810ccf0 con 0x7f813807f4b0 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.506+0000 7f8135e00640 1 --2- 172.21.15.18:0/860427038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813807f8b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8128009820 tx=0x7f812802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd322ec1fe9ecbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.506+0000 7f8134a00640 1 -- 172.21.15.18:0/860427038 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f812802ae70 con 0x7f813807f4b0 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.506+0000 7f8134a00640 1 -- 172.21.15.18:0/860427038 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8128032900 con 0x7f813807f4b0 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.506+0000 7f8134a00640 1 -- 172.21.15.18:0/860427038 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8128030880 con 0x7f813807f4b0 2024-09-13T16:42:02.866 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.507+0000 7f813d200640 1 -- 172.21.15.18:0/860427038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 msgr2=0x7f813807f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.507+0000 7f813d200640 1 --2- 172.21.15.18:0/860427038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813807f8b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8128009820 tx=0x7f812802a270 comp rx=0 tx=0).stop 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.507+0000 7f813d200640 1 -- 172.21.15.18:0/860427038 shutdown_connections 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.507+0000 7f813d200640 1 --2- 172.21.15.18:0/860427038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813807f8b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.507+0000 7f813d200640 1 -- 172.21.15.18:0/860427038 >> 172.21.15.18:0/860427038 conn(0x7f813807ac90 msgr2=0x7f813807d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.507+0000 7f813d200640 1 -- 172.21.15.18:0/860427038 shutdown_connections 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.507+0000 7f813d200640 1 -- 172.21.15.18:0/860427038 wait complete. 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.508+0000 7f813d200640 1 Processor -- start 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.508+0000 7f813d200640 1 -- start start 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.508+0000 7f813d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813819f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.508+0000 7f813d200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813819fcc0 con 0x7f813807f4b0 2024-09-13T16:42:02.867 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.509+0000 7f8135e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813819f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.509+0000 7f8135e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813819f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53590/0 (socket says 172.21.15.18:53590) 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.509+0000 7f8135e00640 1 -- 172.21.15.18:0/4260759704 learned_addr learned my addr 172.21.15.18:0/4260759704 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.509+0000 7f8135e00640 1 -- 172.21.15.18:0/4260759704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280094d0 con 0x7f813807f4b0 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.509+0000 7f8135e00640 1 --2- 172.21.15.18:0/4260759704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813819f780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81280097f0 tx=0x7f8128030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.510+0000 7f812ea00640 1 -- 172.21.15.18:0/4260759704 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8128032c80 con 0x7f813807f4b0 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.510+0000 7f813d200640 1 -- 172.21.15.18:0/4260759704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813819fec0 con 0x7f813807f4b0 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.510+0000 7f812ea00640 1 -- 172.21.15.18:0/4260759704 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8128032de0 con 0x7f813807f4b0 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.510+0000 7f812ea00640 1 -- 172.21.15.18:0/4260759704 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f812803a760 con 0x7f813807f4b0 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.510+0000 7f813d200640 1 -- 172.21.15.18:0/4260759704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81381a0360 con 0x7f813807f4b0 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.511+0000 7f812ea00640 1 -- 172.21.15.18:0/4260759704 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f8128039040 con 0x7f813807f4b0 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.511+0000 7f813d200640 1 -- 172.21.15.18:0/4260759704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813810ff20 con 0x7f813807f4b0 2024-09-13T16:42:02.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.512+0000 7f812ea00640 1 --2- 172.21.15.18:0/4260759704 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f811c038670 0x7f811c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.512+0000 7f812ea00640 1 -- 172.21.15.18:0/4260759704 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f812806b730 con 0x7f813807f4b0 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.512+0000 7f8135400640 1 --2- 172.21.15.18:0/4260759704 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f811c038670 0x7f811c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.513+0000 7f8135400640 1 --2- 172.21.15.18:0/4260759704 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f811c038670 0x7f811c03ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f81240098c0 tx=0x7f8124006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.517+0000 7f812ea00640 1 -- 172.21.15.18:0/4260759704 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f81280313a0 con 0x7f813807f4b0 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.703+0000 7f813d200640 1 -- 172.21.15.18:0/4260759704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f8138110160 con 0x7f813807f4b0 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.707+0000 7f812ea00640 1 -- 172.21.15.18:0/4260759704 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f812803f0d0 con 0x7f813807f4b0 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.709+0000 7f813d200640 1 -- 172.21.15.18:0/4260759704 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f811c038670 msgr2=0x7f811c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.709+0000 7f813d200640 1 --2- 172.21.15.18:0/4260759704 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f811c038670 0x7f811c03ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f81240098c0 tx=0x7f8124006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.709+0000 7f813d200640 1 -- 172.21.15.18:0/4260759704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 msgr2=0x7f813819f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.709+0000 7f813d200640 1 --2- 172.21.15.18:0/4260759704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813819f780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81280097f0 tx=0x7f8128030d70 comp rx=0 tx=0).stop 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.710+0000 7f813d200640 1 -- 172.21.15.18:0/4260759704 shutdown_connections 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.710+0000 7f813d200640 1 --2- 172.21.15.18:0/4260759704 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f811c038670 0x7f811c03ab30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:02.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.710+0000 7f813d200640 1 --2- 172.21.15.18:0/4260759704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f813807f4b0 0x7f813819f780 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:02.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.710+0000 7f813d200640 1 -- 172.21.15.18:0/4260759704 >> 172.21.15.18:0/4260759704 conn(0x7f813807ac90 msgr2=0x7f813807b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:02.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.710+0000 7f813d200640 1 -- 172.21.15.18:0/4260759704 shutdown_connections 2024-09-13T16:42:02.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:01.710+0000 7f813d200640 1 -- 172.21.15.18:0/4260759704 wait complete. 2024-09-13T16:42:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.407+0000 7fc1ee600640 1 Processor -- start 2024-09-13T16:42:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.407+0000 7fc1ee600640 1 -- start start 2024-09-13T16:42:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.408+0000 7fc1ee600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e8107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.408+0000 7fc1ee600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8108180 con 0x7fc1e81077b0 2024-09-13T16:42:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.408+0000 7fc1e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e8107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.408+0000 7fc1e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e8107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53598/0 (socket says 172.21.15.18:53598) 2024-09-13T16:42:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.408+0000 7fc1e7400640 1 -- 172.21.15.18:0/1234746888 learned_addr learned my addr 172.21.15.18:0/1234746888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.409+0000 7fc1e7400640 1 -- 172.21.15.18:0/1234746888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e81082c0 con 0x7fc1e81077b0 2024-09-13T16:42:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.410+0000 7fc1e7400640 1 --2- 172.21.15.18:0/1234746888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e8107bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009820 tx=0x7fc1d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816519dd2377e127 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.410+0000 7fc1e6000640 1 -- 172.21.15.18:0/1234746888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d802ae70 con 0x7fc1e81077b0 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.410+0000 7fc1e6000640 1 -- 172.21.15.18:0/1234746888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1d8032900 con 0x7fc1e81077b0 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.410+0000 7fc1e6000640 1 -- 172.21.15.18:0/1234746888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8030880 con 0x7fc1e81077b0 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.411+0000 7fc1ee600640 1 -- 172.21.15.18:0/1234746888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 msgr2=0x7fc1e8107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.411+0000 7fc1ee600640 1 --2- 172.21.15.18:0/1234746888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e8107bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009820 tx=0x7fc1d802a270 comp rx=0 tx=0).stop 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.411+0000 7fc1ee600640 1 -- 172.21.15.18:0/1234746888 shutdown_connections 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.411+0000 7fc1ee600640 1 --2- 172.21.15.18:0/1234746888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e8107bb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.411+0000 7fc1ee600640 1 -- 172.21.15.18:0/1234746888 >> 172.21.15.18:0/1234746888 conn(0x7fc1e807ad00 msgr2=0x7fc1e807b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.411+0000 7fc1ee600640 1 -- 172.21.15.18:0/1234746888 shutdown_connections 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.411+0000 7fc1ee600640 1 -- 172.21.15.18:0/1234746888 wait complete. 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.413+0000 7fc1ee600640 1 Processor -- start 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.413+0000 7fc1ee600640 1 -- start start 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.413+0000 7fc1ee600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e819b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:04.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.413+0000 7fc1ee600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e819b950 con 0x7fc1e81077b0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.413+0000 7fc1e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e819b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.414+0000 7fc1e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e819b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53612/0 (socket says 172.21.15.18:53612) 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.414+0000 7fc1e7400640 1 -- 172.21.15.18:0/3442250240 learned_addr learned my addr 172.21.15.18:0/3442250240 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.414+0000 7fc1e7400640 1 -- 172.21.15.18:0/3442250240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80094d0 con 0x7fc1e81077b0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.414+0000 7fc1e7400640 1 --2- 172.21.15.18:0/3442250240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e819b410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8030590 tx=0x7fc1d8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.414+0000 7fc1dfe00640 1 -- 172.21.15.18:0/3442250240 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8032db0 con 0x7fc1e81077b0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.414+0000 7fc1dfe00640 1 -- 172.21.15.18:0/3442250240 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1d803b8f0 con 0x7fc1e81077b0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.414+0000 7fc1dfe00640 1 -- 172.21.15.18:0/3442250240 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d803a820 con 0x7fc1e81077b0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.415+0000 7fc1ee600640 1 -- 172.21.15.18:0/3442250240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e819bb50 con 0x7fc1e81077b0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.415+0000 7fc1ee600640 1 -- 172.21.15.18:0/3442250240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e819bff0 con 0x7fc1e81077b0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.416+0000 7fc1dfe00640 1 -- 172.21.15.18:0/3442250240 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fc1d8039040 con 0x7fc1e81077b0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.416+0000 7fc1ee600640 1 -- 172.21.15.18:0/3442250240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e810bb80 con 0x7fc1e81077b0 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.416+0000 7fc1dfe00640 1 --2- 172.21.15.18:0/3442250240 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fc1cc038670 0x7fc1cc03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:04.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.417+0000 7fc1dfe00640 1 -- 172.21.15.18:0/3442250240 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc1d806b910 con 0x7fc1e81077b0 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.417+0000 7fc1e6a00640 1 --2- 172.21.15.18:0/3442250240 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fc1cc038670 0x7fc1cc03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.418+0000 7fc1e6a00640 1 --2- 172.21.15.18:0/3442250240 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fc1cc038670 0x7fc1cc03ab30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40098c0 tx=0x7fc1d4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.421+0000 7fc1dfe00640 1 -- 172.21.15.18:0/3442250240 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc1d80313a0 con 0x7fc1e81077b0 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.610+0000 7fc1ee600640 1 -- 172.21.15.18:0/3442250240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fc1e819e8d0 con 0x7fc1e81077b0 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.613+0000 7fc1dfe00640 1 -- 172.21.15.18:0/3442250240 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc1d803f0c0 con 0x7fc1e81077b0 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.615+0000 7fc1ee600640 1 -- 172.21.15.18:0/3442250240 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fc1cc038670 msgr2=0x7fc1cc03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.615+0000 7fc1ee600640 1 --2- 172.21.15.18:0/3442250240 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fc1cc038670 0x7fc1cc03ab30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40098c0 tx=0x7fc1d4006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.615+0000 7fc1ee600640 1 -- 172.21.15.18:0/3442250240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 msgr2=0x7fc1e819b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.615+0000 7fc1ee600640 1 --2- 172.21.15.18:0/3442250240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e819b410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8030590 tx=0x7fc1d8032670 comp rx=0 tx=0).stop 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.615+0000 7fc1ee600640 1 -- 172.21.15.18:0/3442250240 shutdown_connections 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.615+0000 7fc1ee600640 1 --2- 172.21.15.18:0/3442250240 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7fc1cc038670 0x7fc1cc03ab30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.615+0000 7fc1ee600640 1 --2- 172.21.15.18:0/3442250240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e81077b0 0x7fc1e819b410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.615+0000 7fc1ee600640 1 -- 172.21.15.18:0/3442250240 >> 172.21.15.18:0/3442250240 conn(0x7fc1e807ad00 msgr2=0x7fc1e8105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:04.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.616+0000 7fc1ee600640 1 -- 172.21.15.18:0/3442250240 shutdown_connections 2024-09-13T16:42:04.307 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:03.616+0000 7fc1ee600640 1 -- 172.21.15.18:0/3442250240 wait complete. 2024-09-13T16:42:04.307 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling the dashboard module... 2024-09-13T16:42:04.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:04 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3442250240' entity='client.admin' 2024-09-13T16:42:04.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:04 smithi018 ceph-mon[30981]: from='mgr.14118 172.21.15.18:0/435614935' entity='mgr.x' 2024-09-13T16:42:04.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:04 smithi018 ceph-mon[30981]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:05.868 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:05 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/421211316' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T16:42:05.868 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:05 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: ignoring --setuser ceph since I am not root 2024-09-13T16:42:05.868 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:05 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: ignoring --setgroup ceph since I am not root 2024-09-13T16:42:05.869 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:05 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:05.866+0000 7f3578e1d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:42:06.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:05 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:05.940+0000 7f3578e1d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:42:06.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:06.134+0000 7f3578e1d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:42:06.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.827+0000 7f4254c00640 1 Processor -- start 2024-09-13T16:42:06.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.827+0000 7f4254c00640 1 -- start start 2024-09-13T16:42:06.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.827+0000 7f4254c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f4250107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:06.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.827+0000 7f4254c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42501081c0 con 0x7f42501077f0 2024-09-13T16:42:06.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.828+0000 7f424de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f4250107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:06.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.828+0000 7f424de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f4250107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53614/0 (socket says 172.21.15.18:53614) 2024-09-13T16:42:06.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.828+0000 7f424de00640 1 -- 172.21.15.18:0/1122447963 learned_addr learned my addr 172.21.15.18:0/1122447963 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:06.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.828+0000 7f424de00640 1 -- 172.21.15.18:0/1122447963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4250108900 con 0x7f42501077f0 2024-09-13T16:42:06.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.829+0000 7f424de00640 1 --2- 172.21.15.18:0/1122447963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f4250107bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4240009820 tx=0x7f424002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e2f156091a259b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.830+0000 7f424ca00640 1 -- 172.21.15.18:0/1122447963 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f424002ae70 con 0x7f42501077f0 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.830+0000 7f424ca00640 1 -- 172.21.15.18:0/1122447963 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4240032900 con 0x7f42501077f0 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.830+0000 7f424ca00640 1 -- 172.21.15.18:0/1122447963 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4240030880 con 0x7f42501077f0 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.830+0000 7f4254c00640 1 -- 172.21.15.18:0/1122447963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 msgr2=0x7f4250107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.830+0000 7f4254c00640 1 --2- 172.21.15.18:0/1122447963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f4250107bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4240009820 tx=0x7f424002a270 comp rx=0 tx=0).stop 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.830+0000 7f4254c00640 1 -- 172.21.15.18:0/1122447963 shutdown_connections 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.830+0000 7f4254c00640 1 --2- 172.21.15.18:0/1122447963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f4250107bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.830+0000 7f4254c00640 1 -- 172.21.15.18:0/1122447963 >> 172.21.15.18:0/1122447963 conn(0x7f425007acc0 msgr2=0x7f425007b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.830+0000 7f4254c00640 1 -- 172.21.15.18:0/1122447963 shutdown_connections 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.831+0000 7f4254c00640 1 -- 172.21.15.18:0/1122447963 wait complete. 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.831+0000 7f4254c00640 1 Processor -- start 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.832+0000 7f4254c00640 1 -- start start 2024-09-13T16:42:06.291 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.832+0000 7f4254c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f425019b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.832+0000 7f4254c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425019b900 con 0x7f42501077f0 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.832+0000 7f424de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f425019b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.832+0000 7f424de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f425019b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53622/0 (socket says 172.21.15.18:53622) 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.832+0000 7f424de00640 1 -- 172.21.15.18:0/421211316 learned_addr learned my addr 172.21.15.18:0/421211316 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.832+0000 7f424de00640 1 -- 172.21.15.18:0/421211316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42400094d0 con 0x7f42501077f0 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.833+0000 7f424de00640 1 --2- 172.21.15.18:0/421211316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f425019b3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4240030380 tx=0x7f4240030de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.833+0000 7f4246a00640 1 -- 172.21.15.18:0/421211316 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4240032db0 con 0x7f42501077f0 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.833+0000 7f4246a00640 1 -- 172.21.15.18:0/421211316 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f424003b8f0 con 0x7f42501077f0 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.833+0000 7f4254c00640 1 -- 172.21.15.18:0/421211316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425019bb00 con 0x7f42501077f0 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.833+0000 7f4246a00640 1 -- 172.21.15.18:0/421211316 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f424003a760 con 0x7f42501077f0 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.833+0000 7f4254c00640 1 -- 172.21.15.18:0/421211316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425019bfa0 con 0x7f42501077f0 2024-09-13T16:42:06.292 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.834+0000 7f4246a00640 1 -- 172.21.15.18:0/421211316 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f4240039040 con 0x7f42501077f0 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.834+0000 7f4254c00640 1 -- 172.21.15.18:0/421211316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425010bb30 con 0x7f42501077f0 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.835+0000 7f4246a00640 1 --2- 172.21.15.18:0/421211316 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f4234038620 0x7f423403aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.835+0000 7f4246a00640 1 -- 172.21.15.18:0/421211316 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f424006b8d0 con 0x7f42501077f0 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.835+0000 7f424d400640 1 --2- 172.21.15.18:0/421211316 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f4234038620 0x7f423403aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.836+0000 7f424d400640 1 --2- 172.21.15.18:0/421211316 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f4234038620 0x7f423403aae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f423c0098c0 tx=0x7f423c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:04.840+0000 7f4246a00640 1 -- 172.21.15.18:0/421211316 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f424003ba60 con 0x7f42501077f0 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.077+0000 7f4254c00640 1 -- 172.21.15.18:0/421211316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f425010bd70 con 0x7f42501077f0 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.616+0000 7f4246a00640 1 -- 172.21.15.18:0/421211316 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f424003bcd0 con 0x7f42501077f0 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.618+0000 7f4246a00640 1 -- 172.21.15.18:0/421211316 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f424006b220 con 0x7f42501077f0 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.620+0000 7f4254c00640 1 -- 172.21.15.18:0/421211316 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f4234038620 msgr2=0x7f423403aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.620+0000 7f4254c00640 1 --2- 172.21.15.18:0/421211316 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f4234038620 0x7f423403aae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f423c0098c0 tx=0x7f423c006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.620+0000 7f4254c00640 1 -- 172.21.15.18:0/421211316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 msgr2=0x7f425019b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:06.293 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.620+0000 7f4254c00640 1 --2- 172.21.15.18:0/421211316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f425019b3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4240030380 tx=0x7f4240030de0 comp rx=0 tx=0).stop 2024-09-13T16:42:06.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.620+0000 7f4254c00640 1 -- 172.21.15.18:0/421211316 shutdown_connections 2024-09-13T16:42:06.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.620+0000 7f4254c00640 1 --2- 172.21.15.18:0/421211316 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f4234038620 0x7f423403aae0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:06.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.620+0000 7f4254c00640 1 --2- 172.21.15.18:0/421211316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42501077f0 0x7f425019b3c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:06.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.620+0000 7f4254c00640 1 -- 172.21.15.18:0/421211316 >> 172.21.15.18:0/421211316 conn(0x7f425007acc0 msgr2=0x7f42501054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:06.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.621+0000 7f4254c00640 1 -- 172.21.15.18:0/421211316 shutdown_connections 2024-09-13T16:42:06.294 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:05.621+0000 7f4254c00640 1 -- 172.21.15.18:0/421211316 wait complete. 2024-09-13T16:42:06.401 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:06.217+0000 7f3578e1d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:42:06.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:06 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/421211316' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T16:42:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:06 smithi018 ceph-mon[30981]: mgrmap e9: x(active, since 21s) 2024-09-13T16:42:06.710 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:06.396+0000 7f3578e1d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:42:06.710 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:06.569+0000 7f3578e1d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:42:07.024 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:06.946+0000 7f3578e1d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:42:07.024 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:07 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:07.023+0000 7f3578e1d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:42:07.276 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:07 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:07.241+0000 7f3578e1d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:42:07.876 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:07 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2992267357' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T16:42:08.184 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:42:08.184 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T16:42:08.184 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T16:42:08.184 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T16:42:08.184 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T16:42:08.184 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:42:08.184 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.275+0000 7f62d9a00640 1 Processor -- start 2024-09-13T16:42:08.184 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.275+0000 7f62d9a00640 1 -- start start 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.275+0000 7f62d9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d4107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.275+0000 7f62d9a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d4108210 con 0x7f62d4107840 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.276+0000 7f62d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d4107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.276+0000 7f62d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d4107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53650/0 (socket says 172.21.15.18:53650) 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.276+0000 7f62d2a00640 1 -- 172.21.15.18:0/3163168822 learned_addr learned my addr 172.21.15.18:0/3163168822 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.276+0000 7f62d2a00640 1 -- 172.21.15.18:0/3163168822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4108900 con 0x7f62d4107840 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.277+0000 7f62d2a00640 1 --2- 172.21.15.18:0/3163168822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d4107c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009820 tx=0x7f62c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf615f6425f8d20d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.278+0000 7f62d1600640 1 -- 172.21.15.18:0/3163168822 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62c402ae70 con 0x7f62d4107840 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.278+0000 7f62d1600640 1 -- 172.21.15.18:0/3163168822 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62c4032900 con 0x7f62d4107840 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.278+0000 7f62d1600640 1 -- 172.21.15.18:0/3163168822 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62c4030880 con 0x7f62d4107840 2024-09-13T16:42:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.278+0000 7f62d9a00640 1 -- 172.21.15.18:0/3163168822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 msgr2=0x7f62d4107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:08.186 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.278+0000 7f62d9a00640 1 --2- 172.21.15.18:0/3163168822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d4107c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009820 tx=0x7f62c402a270 comp rx=0 tx=0).stop 2024-09-13T16:42:08.186 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.278+0000 7f62d9a00640 1 -- 172.21.15.18:0/3163168822 shutdown_connections 2024-09-13T16:42:08.186 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.278+0000 7f62d9a00640 1 --2- 172.21.15.18:0/3163168822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d4107c40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:08.186 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.278+0000 7f62d9a00640 1 -- 172.21.15.18:0/3163168822 >> 172.21.15.18:0/3163168822 conn(0x7f62d407ad00 msgr2=0x7f62d407b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:08.186 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.279+0000 7f62d9a00640 1 -- 172.21.15.18:0/3163168822 shutdown_connections 2024-09-13T16:42:08.186 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.279+0000 7f62d9a00640 1 -- 172.21.15.18:0/3163168822 wait complete. 2024-09-13T16:42:08.186 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.280+0000 7f62d9a00640 1 Processor -- start 2024-09-13T16:42:08.186 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.280+0000 7f62d9a00640 1 -- start start 2024-09-13T16:42:08.186 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.280+0000 7f62d9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:08.186 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.280+0000 7f62d9a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d419b910 con 0x7f62d4107840 2024-09-13T16:42:08.187 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.280+0000 7f62d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:08.187 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.280+0000 7f62d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d419b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53660/0 (socket says 172.21.15.18:53660) 2024-09-13T16:42:08.187 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.280+0000 7f62d2a00640 1 -- 172.21.15.18:0/2992267357 learned_addr learned my addr 172.21.15.18:0/2992267357 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:08.187 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.281+0000 7f62d2a00640 1 -- 172.21.15.18:0/2992267357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40094d0 con 0x7f62d4107840 2024-09-13T16:42:08.187 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.281+0000 7f62d2a00640 1 --2- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d419b3d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f62c40097f0 tx=0x7f62c4030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:08.187 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.281+0000 7f62cb400640 1 -- 172.21.15.18:0/2992267357 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62c4032c80 con 0x7f62d4107840 2024-09-13T16:42:08.187 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.281+0000 7f62cb400640 1 -- 172.21.15.18:0/2992267357 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62c4032de0 con 0x7f62d4107840 2024-09-13T16:42:08.187 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.281+0000 7f62cb400640 1 -- 172.21.15.18:0/2992267357 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62c403a690 con 0x7f62d4107840 2024-09-13T16:42:08.187 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.281+0000 7f62d9a00640 1 -- 172.21.15.18:0/2992267357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d419bb10 con 0x7f62d4107840 2024-09-13T16:42:08.187 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.281+0000 7f62d9a00640 1 -- 172.21.15.18:0/2992267357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d419bfb0 con 0x7f62d4107840 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.282+0000 7f62cb400640 1 -- 172.21.15.18:0/2992267357 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f62c4039040 con 0x7f62d4107840 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.283+0000 7f62d9a00640 1 -- 172.21.15.18:0/2992267357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d410bb30 con 0x7f62d4107840 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.283+0000 7f62cb400640 1 --2- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f62b80386c0 0x7f62b803ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.283+0000 7f62cb400640 1 -- 172.21.15.18:0/2992267357 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f62c406b760 con 0x7f62d4107840 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.283+0000 7f62d2000640 1 -- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f62b80386c0 msgr2=0x7f62b803ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/920683112 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.283+0000 7f62d2000640 1 --2- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f62b80386c0 0x7f62b803ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.288+0000 7f62cb400640 1 -- 172.21.15.18:0/2992267357 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f62c4031580 con 0x7f62d4107840 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.484+0000 7f62d2000640 1 -- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f62b80386c0 msgr2=0x7f62b803ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/920683112 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.484+0000 7f62d2000640 1 --2- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f62b80386c0 0x7f62b803ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.519+0000 7f62d9a00640 1 -- 172.21.15.18:0/2992267357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f62d419e890 con 0x7f62d4107840 2024-09-13T16:42:08.188 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.519+0000 7f62cb400640 1 -- 172.21.15.18:0/2992267357 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f62c403f070 con 0x7f62d4107840 2024-09-13T16:42:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.521+0000 7f62d9a00640 1 -- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f62b80386c0 msgr2=0x7f62b803ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:42:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.521+0000 7f62d9a00640 1 --2- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f62b80386c0 0x7f62b803ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.521+0000 7f62d9a00640 1 -- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 msgr2=0x7f62d419b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.521+0000 7f62d9a00640 1 --2- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d419b3d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f62c40097f0 tx=0x7f62c4030d70 comp rx=0 tx=0).stop 2024-09-13T16:42:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.521+0000 7f62d9a00640 1 -- 172.21.15.18:0/2992267357 shutdown_connections 2024-09-13T16:42:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.522+0000 7f62d9a00640 1 --2- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f62b80386c0 0x7f62b803ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.522+0000 7f62d9a00640 1 --2- 172.21.15.18:0/2992267357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d4107840 0x7f62d419b3d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.522+0000 7f62d9a00640 1 -- 172.21.15.18:0/2992267357 >> 172.21.15.18:0/2992267357 conn(0x7f62d407ad00 msgr2=0x7f62d4105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.522+0000 7f62d9a00640 1 -- 172.21.15.18:0/2992267357 shutdown_connections 2024-09-13T16:42:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:07.522+0000 7f62d9a00640 1 -- 172.21.15.18:0/2992267357 wait complete. 2024-09-13T16:42:08.190 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for the mgr to restart... 2024-09-13T16:42:08.190 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr epoch 9... 2024-09-13T16:42:08.459 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:08 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:08.380+0000 7f3578e1d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:42:08.767 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:08 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:08.463+0000 7f3578e1d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:42:09.709 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:09 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:09.426+0000 7f3578e1d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:42:09.709 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:09 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:09.566+0000 7f3578e1d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:42:10.070 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:09 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:09.735+0000 7f3578e1d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:42:10.071 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:09 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:09.810+0000 7f3578e1d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:42:10.071 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:09 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:09.985+0000 7f3578e1d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:42:10.071 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:10 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:10.069+0000 7f3578e1d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:42:10.329 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:10 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:10.142+0000 7f3578e1d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:42:10.329 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:10 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:10.327+0000 7f3578e1d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:42:10.590 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:10 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:10.407+0000 7f3578e1d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:42:10.590 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:10 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:10.488+0000 7f3578e1d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:42:10.590 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:10 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:10.588+0000 7f3578e1d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:42:10.959 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:10 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:10.661+0000 7f3578e1d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:42:10.959 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:10 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:10.733+0000 7f3578e1d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:42:11.942 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:11.667+0000 7f3578e1d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:42:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: Active manager daemon x restarted 2024-09-13T16:42:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: Activating manager daemon x 2024-09-13T16:42:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T16:42:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: mgrmap e10: x(active, starting, since 0.0040393s) 2024-09-13T16:42:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:42:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T16:42:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T16:42:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T16:42:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T16:42:11.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: Manager daemon x is now available 2024-09-13T16:42:11.945 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:42:12.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T16:42:12.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T16:42:12.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:12 smithi018 ceph-mon[30981]: mgrmap e11: x(active, since 1.00763s) 2024-09-13T16:42:13.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:13 smithi018 ceph-mon[30981]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T16:42:13.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:13 smithi018 ceph-mon[30981]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T16:42:13.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:14.089 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:42:14.089 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T16:42:14.089 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T16:42:14.089 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.765+0000 7f2ca7800640 1 Processor -- start 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.765+0000 7f2ca7800640 1 -- start start 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.766+0000 7f2ca7800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca0107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.766+0000 7f2ca7800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0108210 con 0x7f2ca0107840 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.766+0000 7f2ca4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca0107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.766+0000 7f2ca4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca0107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53676/0 (socket says 172.21.15.18:53676) 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.766+0000 7f2ca4e00640 1 -- 172.21.15.18:0/1259267399 learned_addr learned my addr 172.21.15.18:0/1259267399 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.766+0000 7f2ca4e00640 1 -- 172.21.15.18:0/1259267399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0108900 con 0x7f2ca0107840 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.767+0000 7f2ca4e00640 1 --2- 172.21.15.18:0/1259267399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca0107c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009820 tx=0x7f2c9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae991528ce50cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.768+0000 7f2c9f400640 1 -- 172.21.15.18:0/1259267399 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c9402ae70 con 0x7f2ca0107840 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.768+0000 7f2c9f400640 1 -- 172.21.15.18:0/1259267399 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c94032900 con 0x7f2ca0107840 2024-09-13T16:42:14.090 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.768+0000 7f2c9f400640 1 -- 172.21.15.18:0/1259267399 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c94030880 con 0x7f2ca0107840 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.768+0000 7f2ca7800640 1 -- 172.21.15.18:0/1259267399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 msgr2=0x7f2ca0107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.768+0000 7f2ca7800640 1 --2- 172.21.15.18:0/1259267399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca0107c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009820 tx=0x7f2c9402a270 comp rx=0 tx=0).stop 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.769+0000 7f2ca7800640 1 -- 172.21.15.18:0/1259267399 shutdown_connections 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.769+0000 7f2ca7800640 1 --2- 172.21.15.18:0/1259267399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca0107c40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.769+0000 7f2ca7800640 1 -- 172.21.15.18:0/1259267399 >> 172.21.15.18:0/1259267399 conn(0x7f2ca007ad00 msgr2=0x7f2ca007b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.769+0000 7f2ca7800640 1 -- 172.21.15.18:0/1259267399 shutdown_connections 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.769+0000 7f2ca7800640 1 -- 172.21.15.18:0/1259267399 wait complete. 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.770+0000 7f2ca7800640 1 Processor -- start 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.770+0000 7f2ca7800640 1 -- start start 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.770+0000 7f2ca7800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.770+0000 7f2ca7800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca019b910 con 0x7f2ca0107840 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.770+0000 7f2ca4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:14.091 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.770+0000 7f2ca4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca019b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53690/0 (socket says 172.21.15.18:53690) 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.770+0000 7f2ca4e00640 1 -- 172.21.15.18:0/4285284600 learned_addr learned my addr 172.21.15.18:0/4285284600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.771+0000 7f2ca4e00640 1 -- 172.21.15.18:0/4285284600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940094d0 con 0x7f2ca0107840 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.771+0000 7f2ca4e00640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca019b3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2c94030410 tx=0x7f2c94032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.771+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c94032c80 con 0x7f2ca0107840 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.771+0000 7f2ca7800640 1 -- 172.21.15.18:0/4285284600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca019bb10 con 0x7f2ca0107840 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.771+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c94032de0 con 0x7f2ca0107840 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.771+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c9403a780 con 0x7f2ca0107840 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.772+0000 7f2ca7800640 1 -- 172.21.15.18:0/4285284600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca019bfb0 con 0x7f2ca0107840 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.772+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f2c94039040 con 0x7f2ca0107840 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.773+0000 7f2c9d600640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 0x7f2c8803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.773+0000 7f2ca7800640 1 -- 172.21.15.18:0/4285284600 --> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ca010bb30 con 0x7f2c88038670 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.773+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2c9406b8c0 con 0x7f2ca0107840 2024-09-13T16:42:14.092 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.773+0000 7f2c9fe00640 1 -- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 msgr2=0x7f2c8803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/920683112 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.773+0000 7f2c9fe00640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 0x7f2c8803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.974+0000 7f2c9fe00640 1 -- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 msgr2=0x7f2c8803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/920683112 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:08.974+0000 7f2c9fe00640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 0x7f2c8803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:09.375+0000 7f2c9fe00640 1 -- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 msgr2=0x7f2c8803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/920683112 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:09.375+0000 7f2c9fe00640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 0x7f2c8803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:10.176+0000 7f2c9fe00640 1 -- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 msgr2=0x7f2c8803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/920683112 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:10.176+0000 7f2c9fe00640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 0x7f2c8803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:11.671+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7f2c9403a970 con 0x7f2ca0107840 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:11.672+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 msgr2=0x7f2c8803ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:11.672+0000 7f2c9d600640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 0x7f2c8803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.673+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f2c9403bbb0 con 0x7f2ca0107840 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.674+0000 7f2c9d600640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2c8803bf30 0x7f2c8803e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:14.093 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.674+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ca010bb30 con 0x7f2c8803bf30 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.675+0000 7f2c9fe00640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2c8803bf30 0x7f2c8803e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.676+0000 7f2c9fe00640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2c8803bf30 0x7f2c8803e320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c003980 tx=0x7f2c8c006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.677+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f2ca010bb30 con 0x7f2c8803bf30 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.683+0000 7f2ca7800640 1 -- 172.21.15.18:0/4285284600 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2ca010bca0 con 0x7f2c8803bf30 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.683+0000 7f2c9d600640 1 -- 172.21.15.18:0/4285284600 <== mgr.14150 v2:172.21.15.18:6800/687548857 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f2ca010bca0 con 0x7f2c8803bf30 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 -- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2c8803bf30 msgr2=0x7f2c8803e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2c8803bf30 0x7f2c8803e320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c003980 tx=0x7f2c8c006e10 comp rx=0 tx=0).stop 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 -- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 msgr2=0x7f2ca019b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca019b3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2c94030410 tx=0x7f2c94032670 comp rx=0 tx=0).stop 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 -- 172.21.15.18:0/4285284600 shutdown_connections 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/920683112,v1:172.21.15.18:6801/920683112] conn(0x7f2c88038670 0x7f2c8803ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2c8803bf30 0x7f2c8803e320 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 --2- 172.21.15.18:0/4285284600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca0107840 0x7f2ca019b3d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:14.094 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 -- 172.21.15.18:0/4285284600 >> 172.21.15.18:0/4285284600 conn(0x7f2ca007ad00 msgr2=0x7f2ca0105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:14.095 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 -- 172.21.15.18:0/4285284600 shutdown_connections 2024-09-13T16:42:14.095 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:12.684+0000 7f2ca7800640 1 -- 172.21.15.18:0/4285284600 wait complete. 2024-09-13T16:42:14.095 INFO:teuthology.orchestra.run.smithi018.stdout:mgr epoch 9 is available 2024-09-13T16:42:14.095 INFO:teuthology.orchestra.run.smithi018.stdout:Generating a dashboard self-signed certificate... 2024-09-13T16:42:14.605 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:14.474+0000 7f34d0600640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:16:42:14] ENGINE Error in HTTPServer.serve 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: Traceback (most recent call last): 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: self._connections.run(self.expiration_interval) 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: self._run(expiration_interval) 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: s = self.context.wrap_socket( 2024-09-13T16:42:14.606 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:42:14.607 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: return self.sslsocket_class._create( 2024-09-13T16:42:14.607 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:42:14.607 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: self.do_handshake() 2024-09-13T16:42:14.607 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:42:14.607 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: self._sslobj.do_handshake() 2024-09-13T16:42:14.607 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:42:14.607 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:42:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:42:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T16:42:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.603+0000 7fec47e00640 1 Processor -- start 2024-09-13T16:42:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.603+0000 7fec47e00640 1 -- start start 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.604+0000 7fec47e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4807a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.604+0000 7fec47e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4807a850 con 0x7fec4807be20 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.604+0000 7fec46a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4807a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.604+0000 7fec46a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4807a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51614/0 (socket says 172.21.15.18:51614) 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.604+0000 7fec46a00640 1 -- 172.21.15.18:0/1897935358 learned_addr learned my addr 172.21.15.18:0/1897935358 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.605+0000 7fec46a00640 1 -- 172.21.15.18:0/1897935358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4807a990 con 0x7fec4807be20 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.605+0000 7fec46a00640 1 --2- 172.21.15.18:0/1897935358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4807a280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec38009820 tx=0x7fec3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa1798173de26be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.606+0000 7fec46000640 1 -- 172.21.15.18:0/1897935358 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec3802ae70 con 0x7fec4807be20 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.606+0000 7fec46000640 1 -- 172.21.15.18:0/1897935358 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec38032900 con 0x7fec4807be20 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.606+0000 7fec46000640 1 -- 172.21.15.18:0/1897935358 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec38030880 con 0x7fec4807be20 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.606+0000 7fec47e00640 1 -- 172.21.15.18:0/1897935358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 msgr2=0x7fec4807a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.606+0000 7fec47e00640 1 --2- 172.21.15.18:0/1897935358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4807a280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec38009820 tx=0x7fec3802a270 comp rx=0 tx=0).stop 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.607+0000 7fec47e00640 1 -- 172.21.15.18:0/1897935358 shutdown_connections 2024-09-13T16:42:15.597 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.607+0000 7fec47e00640 1 --2- 172.21.15.18:0/1897935358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4807a280 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:15.598 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.607+0000 7fec47e00640 1 -- 172.21.15.18:0/1897935358 >> 172.21.15.18:0/1897935358 conn(0x7fec48100b10 msgr2=0x7fec48102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:15.600 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.607+0000 7fec47e00640 1 -- 172.21.15.18:0/1897935358 shutdown_connections 2024-09-13T16:42:15.600 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.607+0000 7fec47e00640 1 -- 172.21.15.18:0/1897935358 wait complete. 2024-09-13T16:42:15.600 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.608+0000 7fec47e00640 1 Processor -- start 2024-09-13T16:42:15.600 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.608+0000 7fec47e00640 1 -- start start 2024-09-13T16:42:15.600 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.608+0000 7fec47e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:15.600 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.608+0000 7fec47e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4819b730 con 0x7fec4807be20 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.609+0000 7fec46a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.609+0000 7fec46a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4819b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51628/0 (socket says 172.21.15.18:51628) 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.609+0000 7fec46a00640 1 -- 172.21.15.18:0/854050993 learned_addr learned my addr 172.21.15.18:0/854050993 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.609+0000 7fec46a00640 1 -- 172.21.15.18:0/854050993 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380094d0 con 0x7fec4807be20 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.609+0000 7fec46a00640 1 --2- 172.21.15.18:0/854050993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4819b1f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec38030410 tx=0x7fec38030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.610+0000 7fec3fe00640 1 -- 172.21.15.18:0/854050993 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec38032db0 con 0x7fec4807be20 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.610+0000 7fec3fe00640 1 -- 172.21.15.18:0/854050993 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec3803b8e0 con 0x7fec4807be20 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.610+0000 7fec47e00640 1 -- 172.21.15.18:0/854050993 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4819b930 con 0x7fec4807be20 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.610+0000 7fec3fe00640 1 -- 172.21.15.18:0/854050993 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec3803a6d0 con 0x7fec4807be20 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.610+0000 7fec47e00640 1 -- 172.21.15.18:0/854050993 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4819bdd0 con 0x7fec4807be20 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.611+0000 7fec3fe00640 1 -- 172.21.15.18:0/854050993 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7fec38039070 con 0x7fec4807be20 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.611+0000 7fec47e00640 1 -- 172.21.15.18:0/854050993 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4810b7b0 con 0x7fec4807be20 2024-09-13T16:42:15.601 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.611+0000 7fec3fe00640 1 --2- 172.21.15.18:0/854050993 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec2c0385a0 0x7fec2c03aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.611+0000 7fec3fe00640 1 -- 172.21.15.18:0/854050993 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fec3806b890 con 0x7fec4807be20 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.612+0000 7fec3e000640 1 --2- 172.21.15.18:0/854050993 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec2c0385a0 0x7fec2c03aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.612+0000 7fec3e000640 1 --2- 172.21.15.18:0/854050993 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec2c0385a0 0x7fec2c03aa60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fec300098c0 tx=0x7fec30006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.616+0000 7fec3fe00640 1 -- 172.21.15.18:0/854050993 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fec38031580 con 0x7fec4807be20 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.654+0000 7fec3fe00640 1 -- 172.21.15.18:0/854050993 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fec3806dce0 con 0x7fec4807be20 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.818+0000 7fec47e00640 1 -- 172.21.15.18:0/854050993 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fec4819e710 con 0x7fec2c0385a0 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.926+0000 7fec3fe00640 1 -- 172.21.15.18:0/854050993 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fec4819e710 con 0x7fec2c0385a0 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.928+0000 7fec47e00640 1 -- 172.21.15.18:0/854050993 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec2c0385a0 msgr2=0x7fec2c03aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.928+0000 7fec47e00640 1 --2- 172.21.15.18:0/854050993 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec2c0385a0 0x7fec2c03aa60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fec300098c0 tx=0x7fec30006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.928+0000 7fec47e00640 1 -- 172.21.15.18:0/854050993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 msgr2=0x7fec4819b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.928+0000 7fec47e00640 1 --2- 172.21.15.18:0/854050993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4819b1f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec38030410 tx=0x7fec38030d70 comp rx=0 tx=0).stop 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.929+0000 7fec47e00640 1 -- 172.21.15.18:0/854050993 shutdown_connections 2024-09-13T16:42:15.602 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.929+0000 7fec47e00640 1 --2- 172.21.15.18:0/854050993 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec2c0385a0 0x7fec2c03aa60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:15.603 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.929+0000 7fec47e00640 1 --2- 172.21.15.18:0/854050993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec4807be20 0x7fec4819b1f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:15.603 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.929+0000 7fec47e00640 1 -- 172.21.15.18:0/854050993 >> 172.21.15.18:0/854050993 conn(0x7fec48100b10 msgr2=0x7fec48101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:15.603 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.929+0000 7fec47e00640 1 -- 172.21.15.18:0/854050993 shutdown_connections 2024-09-13T16:42:15.603 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:14.929+0000 7fec47e00640 1 -- 172.21.15.18:0/854050993 wait complete. 2024-09-13T16:42:15.603 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial admin user... 2024-09-13T16:42:15.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:15 smithi018 ceph-mon[30981]: [13/Sep/2024:16:42:14] ENGINE Bus STARTING 2024-09-13T16:42:15.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:15 smithi018 ceph-mon[30981]: [13/Sep/2024:16:42:14] ENGINE Serving on http://172.21.15.18:8765 2024-09-13T16:42:15.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:15 smithi018 ceph-mon[30981]: [13/Sep/2024:16:42:14] ENGINE Serving on https://172.21.15.18:7150 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:15 smithi018 ceph-mon[30981]: [13/Sep/2024:16:42:14] ENGINE Bus STARTED 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:15 smithi018 ceph-mon[30981]: [13/Sep/2024:16:42:14] ENGINE Error in HTTPServer.serve 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout: Traceback (most recent call last): 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._run(expiration_interval) 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:42:15.928 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout: s = self.context.wrap_socket( 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout: return self.sslsocket_class._create( 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout: self.do_handshake() 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._sslobj.do_handshake() 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:15 smithi018 ceph-mon[30981]: mgrmap e12: x(active, since 2s) 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:15.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:16.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:16 smithi018 ceph-mon[30981]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:42:16.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:16 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:17.633 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$4ckab3RYYMKm9pYxZQ624OQAZvtXcmcrIF8rIqiXk0BtCoLnt50du", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726245736, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T16:42:17.633 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.168+0000 7f345d200640 1 Processor -- start 2024-09-13T16:42:17.633 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.168+0000 7f345d200640 1 -- start start 2024-09-13T16:42:17.633 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.168+0000 7f345d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f3458105720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:17.633 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.168+0000 7f345d200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3458105cf0 con 0x7f3458105320 2024-09-13T16:42:17.633 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.168+0000 7f3457400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f3458105720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:17.633 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.168+0000 7f3457400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f3458105720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51642/0 (socket says 172.21.15.18:51642) 2024-09-13T16:42:17.633 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.168+0000 7f3457400640 1 -- 172.21.15.18:0/3432478586 learned_addr learned my addr 172.21.15.18:0/3432478586 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.169+0000 7f3457400640 1 -- 172.21.15.18:0/3432478586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458106520 con 0x7f3458105320 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.170+0000 7f3457400640 1 --2- 172.21.15.18:0/3432478586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f3458105720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3448009e80 tx=0x7f344802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93fa1e67c418185 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.170+0000 7f3456000640 1 -- 172.21.15.18:0/3432478586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3448031400 con 0x7f3458105320 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.170+0000 7f3456000640 1 -- 172.21.15.18:0/3432478586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f344802d050 con 0x7f3458105320 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.170+0000 7f3456000640 1 -- 172.21.15.18:0/3432478586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3448007960 con 0x7f3458105320 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.171+0000 7f345d200640 1 -- 172.21.15.18:0/3432478586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 msgr2=0x7f3458105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.171+0000 7f345d200640 1 --2- 172.21.15.18:0/3432478586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f3458105720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3448009e80 tx=0x7f344802a7a0 comp rx=0 tx=0).stop 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.171+0000 7f345d200640 1 -- 172.21.15.18:0/3432478586 shutdown_connections 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.171+0000 7f345d200640 1 --2- 172.21.15.18:0/3432478586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f3458105720 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.171+0000 7f345d200640 1 -- 172.21.15.18:0/3432478586 >> 172.21.15.18:0/3432478586 conn(0x7f3458100b10 msgr2=0x7f3458102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.171+0000 7f345d200640 1 -- 172.21.15.18:0/3432478586 shutdown_connections 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.171+0000 7f345d200640 1 -- 172.21.15.18:0/3432478586 wait complete. 2024-09-13T16:42:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.172+0000 7f345d200640 1 Processor -- start 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.172+0000 7f345d200640 1 -- start start 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.172+0000 7f345d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f345807baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.172+0000 7f345d200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345807c030 con 0x7f3458105320 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.173+0000 7f3457400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f345807baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.173+0000 7f3457400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f345807baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51650/0 (socket says 172.21.15.18:51650) 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.173+0000 7f3457400640 1 -- 172.21.15.18:0/3172930728 learned_addr learned my addr 172.21.15.18:0/3172930728 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.173+0000 7f3457400640 1 -- 172.21.15.18:0/3172930728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3448009b30 con 0x7f3458105320 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.173+0000 7f3457400640 1 --2- 172.21.15.18:0/3172930728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f345807baf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f344802acc0 tx=0x7f3448007630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.174+0000 7f344fe00640 1 -- 172.21.15.18:0/3172930728 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3448031e60 con 0x7f3458105320 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.174+0000 7f344fe00640 1 -- 172.21.15.18:0/3172930728 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f344803d910 con 0x7f3458105320 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.174+0000 7f345d200640 1 -- 172.21.15.18:0/3172930728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345807a220 con 0x7f3458105320 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.174+0000 7f344fe00640 1 -- 172.21.15.18:0/3172930728 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f344803b960 con 0x7f3458105320 2024-09-13T16:42:17.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.174+0000 7f345d200640 1 -- 172.21.15.18:0/3172930728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345807a720 con 0x7f3458105320 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.175+0000 7f344fe00640 1 -- 172.21.15.18:0/3172930728 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f344803da80 con 0x7f3458105320 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.175+0000 7f345d200640 1 -- 172.21.15.18:0/3172930728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3458109750 con 0x7f3458105320 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.175+0000 7f344fe00640 1 --2- 172.21.15.18:0/3172930728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f343c0386c0 0x7f343c03ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.175+0000 7f344fe00640 1 -- 172.21.15.18:0/3172930728 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f344806c460 con 0x7f3458105320 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.175+0000 7f3456a00640 1 --2- 172.21.15.18:0/3172930728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f343c0386c0 0x7f343c03ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.176+0000 7f3456a00640 1 --2- 172.21.15.18:0/3172930728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f343c0386c0 0x7f343c03ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f34440098c0 tx=0x7f3444006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.181+0000 7f344fe00640 1 -- 172.21.15.18:0/3172930728 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3448030540 con 0x7f3458105320 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.396+0000 7f345d200640 1 -- 172.21.15.18:0/3172930728 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3458061900 con 0x7f343c0386c0 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.646+0000 7f344fe00640 1 -- 172.21.15.18:0/3172930728 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f3458061900 con 0x7f343c0386c0 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.648+0000 7f345d200640 1 -- 172.21.15.18:0/3172930728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f343c0386c0 msgr2=0x7f343c03ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.648+0000 7f345d200640 1 --2- 172.21.15.18:0/3172930728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f343c0386c0 0x7f343c03ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f34440098c0 tx=0x7f3444006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.648+0000 7f345d200640 1 -- 172.21.15.18:0/3172930728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 msgr2=0x7f345807baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:17.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.648+0000 7f345d200640 1 --2- 172.21.15.18:0/3172930728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f345807baf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f344802acc0 tx=0x7f3448007630 comp rx=0 tx=0).stop 2024-09-13T16:42:17.637 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.649+0000 7f345d200640 1 -- 172.21.15.18:0/3172930728 shutdown_connections 2024-09-13T16:42:17.637 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.649+0000 7f345d200640 1 --2- 172.21.15.18:0/3172930728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f343c0386c0 0x7f343c03ab80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:17.637 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.649+0000 7f345d200640 1 --2- 172.21.15.18:0/3172930728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105320 0x7f345807baf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:17.637 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.649+0000 7f345d200640 1 -- 172.21.15.18:0/3172930728 >> 172.21.15.18:0/3172930728 conn(0x7f3458100b10 msgr2=0x7f34581016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:17.637 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.649+0000 7f345d200640 1 -- 172.21.15.18:0/3172930728 shutdown_connections 2024-09-13T16:42:17.637 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:16.649+0000 7f345d200640 1 -- 172.21.15.18:0/3172930728 wait complete. 2024-09-13T16:42:17.637 INFO:teuthology.orchestra.run.smithi018.stdout:Fetching dashboard port number... 2024-09-13T16:42:17.948 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:17 smithi018 ceph-mon[30981]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:42:19.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T16:42:19.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.671+0000 7f4b13e00640 1 Processor -- start 2024-09-13T16:42:19.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.672+0000 7f4b13e00640 1 -- start start 2024-09-13T16:42:19.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.672+0000 7f4b13e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b14105720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:19.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.672+0000 7f4b13e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b14105cf0 con 0x7f4b14105320 2024-09-13T16:42:19.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.672+0000 7f4b12a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b14105720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:19.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.673+0000 7f4b12a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b14105720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51662/0 (socket says 172.21.15.18:51662) 2024-09-13T16:42:19.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.673+0000 7f4b12a00640 1 -- 172.21.15.18:0/32953512 learned_addr learned my addr 172.21.15.18:0/32953512 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.673+0000 7f4b12a00640 1 -- 172.21.15.18:0/32953512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14106520 con 0x7f4b14105320 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.674+0000 7f4b12a00640 1 --2- 172.21.15.18:0/32953512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b14105720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009820 tx=0x7f4b0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ed0a6face023cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.674+0000 7f4b11600640 1 -- 172.21.15.18:0/32953512 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b0402ae70 con 0x7f4b14105320 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.674+0000 7f4b11600640 1 -- 172.21.15.18:0/32953512 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b04032900 con 0x7f4b14105320 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.674+0000 7f4b11600640 1 -- 172.21.15.18:0/32953512 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b04030880 con 0x7f4b14105320 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.675+0000 7f4b13e00640 1 -- 172.21.15.18:0/32953512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 msgr2=0x7f4b14105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.675+0000 7f4b13e00640 1 --2- 172.21.15.18:0/32953512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b14105720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009820 tx=0x7f4b0402a270 comp rx=0 tx=0).stop 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.675+0000 7f4b13e00640 1 -- 172.21.15.18:0/32953512 shutdown_connections 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.675+0000 7f4b13e00640 1 --2- 172.21.15.18:0/32953512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b14105720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.675+0000 7f4b13e00640 1 -- 172.21.15.18:0/32953512 >> 172.21.15.18:0/32953512 conn(0x7f4b14100b10 msgr2=0x7f4b14102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:19.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.675+0000 7f4b13e00640 1 -- 172.21.15.18:0/32953512 shutdown_connections 2024-09-13T16:42:19.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.675+0000 7f4b13e00640 1 -- 172.21.15.18:0/32953512 wait complete. 2024-09-13T16:42:19.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.676+0000 7f4b13e00640 1 Processor -- start 2024-09-13T16:42:19.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.676+0000 7f4b13e00640 1 -- start start 2024-09-13T16:42:19.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.677+0000 7f4b13e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b1419b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:19.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.677+0000 7f4b13e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1419b750 con 0x7f4b14105320 2024-09-13T16:42:19.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.677+0000 7f4b12a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b1419b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:19.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.677+0000 7f4b12a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b1419b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51666/0 (socket says 172.21.15.18:51666) 2024-09-13T16:42:19.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.677+0000 7f4b12a00640 1 -- 172.21.15.18:0/2643273698 learned_addr learned my addr 172.21.15.18:0/2643273698 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:19.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.677+0000 7f4b12a00640 1 -- 172.21.15.18:0/2643273698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b040094d0 con 0x7f4b14105320 2024-09-13T16:42:19.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.678+0000 7f4b12a00640 1 --2- 172.21.15.18:0/2643273698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b1419b210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b040097f0 tx=0x7f4b04030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:19.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.678+0000 7f4b18a00640 1 -- 172.21.15.18:0/2643273698 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b04032c80 con 0x7f4b14105320 2024-09-13T16:42:19.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.678+0000 7f4b18a00640 1 -- 172.21.15.18:0/2643273698 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b04032de0 con 0x7f4b14105320 2024-09-13T16:42:19.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.678+0000 7f4b18a00640 1 -- 172.21.15.18:0/2643273698 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b0403a690 con 0x7f4b14105320 2024-09-13T16:42:19.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.678+0000 7f4b13e00640 1 -- 172.21.15.18:0/2643273698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1419b950 con 0x7f4b14105320 2024-09-13T16:42:19.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.678+0000 7f4b13e00640 1 -- 172.21.15.18:0/2643273698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1419bdf0 con 0x7f4b14105320 2024-09-13T16:42:19.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.679+0000 7f4b18a00640 1 -- 172.21.15.18:0/2643273698 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f4b04039040 con 0x7f4b14105320 2024-09-13T16:42:19.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.679+0000 7f4b13e00640 1 -- 172.21.15.18:0/2643273698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b14109750 con 0x7f4b14105320 2024-09-13T16:42:19.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.680+0000 7f4b18a00640 1 --2- 172.21.15.18:0/2643273698 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4af80387b0 0x7f4af803ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:19.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.680+0000 7f4b18a00640 1 -- 172.21.15.18:0/2643273698 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4b0406b9f0 con 0x7f4b14105320 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.680+0000 7f4b12000640 1 --2- 172.21.15.18:0/2643273698 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4af80387b0 0x7f4af803ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.681+0000 7f4b12000640 1 --2- 172.21.15.18:0/2643273698 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4af80387b0 0x7f4af803ac70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b000098c0 tx=0x7f4b00006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.685+0000 7f4b18a00640 1 -- 172.21.15.18:0/2643273698 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4b040313a0 con 0x7f4b14105320 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.872+0000 7f4b13e00640 1 -- 172.21.15.18:0/2643273698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f4b14109990 con 0x7f4b14105320 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.872+0000 7f4b18a00640 1 -- 172.21.15.18:0/2643273698 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f4b0403f070 con 0x7f4b14105320 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.875+0000 7f4b13e00640 1 -- 172.21.15.18:0/2643273698 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4af80387b0 msgr2=0x7f4af803ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.875+0000 7f4b13e00640 1 --2- 172.21.15.18:0/2643273698 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4af80387b0 0x7f4af803ac70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b000098c0 tx=0x7f4b00006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.875+0000 7f4b13e00640 1 -- 172.21.15.18:0/2643273698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 msgr2=0x7f4b1419b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.875+0000 7f4b13e00640 1 --2- 172.21.15.18:0/2643273698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b1419b210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b040097f0 tx=0x7f4b04030d70 comp rx=0 tx=0).stop 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.875+0000 7f4b13e00640 1 -- 172.21.15.18:0/2643273698 shutdown_connections 2024-09-13T16:42:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.875+0000 7f4b13e00640 1 --2- 172.21.15.18:0/2643273698 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4af80387b0 0x7f4af803ac70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:19.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.875+0000 7f4b13e00640 1 --2- 172.21.15.18:0/2643273698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b14105320 0x7f4b1419b210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:19.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.875+0000 7f4b13e00640 1 -- 172.21.15.18:0/2643273698 >> 172.21.15.18:0/2643273698 conn(0x7f4b14100b10 msgr2=0x7f4b14101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:19.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.875+0000 7f4b13e00640 1 -- 172.21.15.18:0/2643273698 shutdown_connections 2024-09-13T16:42:19.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:18.875+0000 7f4b13e00640 1 -- 172.21.15.18:0/2643273698 wait complete. 2024-09-13T16:42:19.579 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:42:19.579 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-13T16:42:19.592 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:42:19.592 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-13T16:42:19.592 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-13T16:42:19.592 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T16:42:19.595 INFO:teuthology.orchestra.run.smithi018.stdout:Ceph Dashboard is now available at: 2024-09-13T16:42:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: URL: https://smithi018.front.sepia.ceph.com:8443/ 2024-09-13T16:42:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: User: admin 2024-09-13T16:42:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: Password: ppqvgd6esj 2024-09-13T16:42:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:19.596 INFO:teuthology.orchestra.run.smithi018.stdout:Saving cluster configuration to /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/config directory 2024-09-13T16:42:19.596 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling autotune for osd_memory_target 2024-09-13T16:42:19.799 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:19 smithi018 ceph-mon[30981]: mgrmap e13: x(active, since 6s) 2024-09-13T16:42:19.799 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:19 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2643273698' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T16:42:21.069 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.204+0000 7fd66d600640 1 Processor -- start 2024-09-13T16:42:21.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.204+0000 7fd66d600640 1 -- start start 2024-09-13T16:42:21.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.204+0000 7fd66d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd668107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:21.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.204+0000 7fd66d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd668108210 con 0x7fd668107840 2024-09-13T16:42:21.075 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.205+0000 7fd666a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd668107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.205+0000 7fd666a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd668107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51682/0 (socket says 172.21.15.18:51682) 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.205+0000 7fd666a00640 1 -- 172.21.15.18:0/764074321 learned_addr learned my addr 172.21.15.18:0/764074321 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.205+0000 7fd666a00640 1 -- 172.21.15.18:0/764074321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6681088b0 con 0x7fd668107840 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.206+0000 7fd666a00640 1 --2- 172.21.15.18:0/764074321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd668107c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd658009820 tx=0x7fd65802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be8f6a987939c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.206+0000 7fd665600640 1 -- 172.21.15.18:0/764074321 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd65802ae70 con 0x7fd668107840 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.206+0000 7fd665600640 1 -- 172.21.15.18:0/764074321 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd658032900 con 0x7fd668107840 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.206+0000 7fd665600640 1 -- 172.21.15.18:0/764074321 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd658030880 con 0x7fd668107840 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.207+0000 7fd66d600640 1 -- 172.21.15.18:0/764074321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 msgr2=0x7fd668107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.207+0000 7fd66d600640 1 --2- 172.21.15.18:0/764074321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd668107c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd658009820 tx=0x7fd65802a270 comp rx=0 tx=0).stop 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.207+0000 7fd66d600640 1 -- 172.21.15.18:0/764074321 shutdown_connections 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.207+0000 7fd66d600640 1 --2- 172.21.15.18:0/764074321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd668107c40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:21.076 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.207+0000 7fd66d600640 1 -- 172.21.15.18:0/764074321 >> 172.21.15.18:0/764074321 conn(0x7fd66807ac90 msgr2=0x7fd66807b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.207+0000 7fd66d600640 1 -- 172.21.15.18:0/764074321 shutdown_connections 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.207+0000 7fd66d600640 1 -- 172.21.15.18:0/764074321 wait complete. 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.208+0000 7fd66d600640 1 Processor -- start 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.208+0000 7fd66d600640 1 -- start start 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.208+0000 7fd66d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd66819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.208+0000 7fd66d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66819b8e0 con 0x7fd668107840 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.209+0000 7fd666a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd66819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.209+0000 7fd666a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd66819b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51692/0 (socket says 172.21.15.18:51692) 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.209+0000 7fd666a00640 1 -- 172.21.15.18:0/1979296454 learned_addr learned my addr 172.21.15.18:0/1979296454 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.209+0000 7fd666a00640 1 -- 172.21.15.18:0/1979296454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580094d0 con 0x7fd668107840 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.209+0000 7fd666a00640 1 --2- 172.21.15.18:0/1979296454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd66819b3a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd6580097f0 tx=0x7fd658030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.210+0000 7fd65f400640 1 -- 172.21.15.18:0/1979296454 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd658032c80 con 0x7fd668107840 2024-09-13T16:42:21.077 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.210+0000 7fd65f400640 1 -- 172.21.15.18:0/1979296454 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd658032de0 con 0x7fd668107840 2024-09-13T16:42:21.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.210+0000 7fd65f400640 1 -- 172.21.15.18:0/1979296454 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd65803a690 con 0x7fd668107840 2024-09-13T16:42:21.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.210+0000 7fd66d600640 1 -- 172.21.15.18:0/1979296454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66819bae0 con 0x7fd668107840 2024-09-13T16:42:21.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.210+0000 7fd66d600640 1 -- 172.21.15.18:0/1979296454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66819bf80 con 0x7fd668107840 2024-09-13T16:42:21.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.211+0000 7fd66d600640 1 -- 172.21.15.18:0/1979296454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66810bae0 con 0x7fd668107840 2024-09-13T16:42:21.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.211+0000 7fd65f400640 1 -- 172.21.15.18:0/1979296454 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fd658039040 con 0x7fd668107840 2024-09-13T16:42:21.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.211+0000 7fd65f400640 1 --2- 172.21.15.18:0/1979296454 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd64c038760 0x7fd64c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:21.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.212+0000 7fd65f400640 1 -- 172.21.15.18:0/1979296454 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd65806b9b0 con 0x7fd668107840 2024-09-13T16:42:21.078 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.212+0000 7fd666000640 1 --2- 172.21.15.18:0/1979296454 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd64c038760 0x7fd64c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:21.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.212+0000 7fd666000640 1 --2- 172.21.15.18:0/1979296454 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd64c038760 0x7fd64c03ac20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd6540098c0 tx=0x7fd654006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:21.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.216+0000 7fd65f400640 1 -- 172.21.15.18:0/1979296454 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd6580313a0 con 0x7fd668107840 2024-09-13T16:42:21.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.395+0000 7fd66d600640 1 -- 172.21.15.18:0/1979296454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fd66810bd20 con 0x7fd668107840 2024-09-13T16:42:21.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.396+0000 7fd65f400640 1 -- 172.21.15.18:0/1979296454 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fd65803f070 con 0x7fd668107840 2024-09-13T16:42:21.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.398+0000 7fd66d600640 1 -- 172.21.15.18:0/1979296454 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd64c038760 msgr2=0x7fd64c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:21.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.398+0000 7fd66d600640 1 --2- 172.21.15.18:0/1979296454 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd64c038760 0x7fd64c03ac20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd6540098c0 tx=0x7fd654006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:21.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.398+0000 7fd66d600640 1 -- 172.21.15.18:0/1979296454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 msgr2=0x7fd66819b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:21.079 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.398+0000 7fd66d600640 1 --2- 172.21.15.18:0/1979296454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd66819b3a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd6580097f0 tx=0x7fd658030d70 comp rx=0 tx=0).stop 2024-09-13T16:42:21.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.398+0000 7fd66d600640 1 -- 172.21.15.18:0/1979296454 shutdown_connections 2024-09-13T16:42:21.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.398+0000 7fd66d600640 1 --2- 172.21.15.18:0/1979296454 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd64c038760 0x7fd64c03ac20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:21.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.398+0000 7fd66d600640 1 --2- 172.21.15.18:0/1979296454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd668107840 0x7fd66819b3a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:21.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.398+0000 7fd66d600640 1 -- 172.21.15.18:0/1979296454 >> 172.21.15.18:0/1979296454 conn(0x7fd66807ac90 msgr2=0x7fd668105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:21.080 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.398+0000 7fd66d600640 1 -- 172.21.15.18:0/1979296454 shutdown_connections 2024-09-13T16:42:21.081 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:20.399+0000 7fd66d600640 1 -- 172.21.15.18:0/1979296454 wait complete. 2024-09-13T16:42:22.591 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.601+0000 7fb4ad200640 1 Processor -- start 2024-09-13T16:42:22.591 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.601+0000 7fb4ad200640 1 -- start start 2024-09-13T16:42:22.591 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.601+0000 7fb4ad200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a8107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:22.591 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.601+0000 7fb4ad200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a8108210 con 0x7fb4a8107840 2024-09-13T16:42:22.591 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.602+0000 7fb4a5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a8107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:22.591 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.602+0000 7fb4a5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a8107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41510/0 (socket says 172.21.15.18:41510) 2024-09-13T16:42:22.591 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.602+0000 7fb4a5e00640 1 -- 172.21.15.18:0/496743754 learned_addr learned my addr 172.21.15.18:0/496743754 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.602+0000 7fb4a5e00640 1 -- 172.21.15.18:0/496743754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a81088b0 con 0x7fb4a8107840 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.603+0000 7fb4a5e00640 1 --2- 172.21.15.18:0/496743754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a8107c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb498009820 tx=0x7fb49802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ff09bad5b3e594 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.604+0000 7fb4a4a00640 1 -- 172.21.15.18:0/496743754 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb49802ae70 con 0x7fb4a8107840 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.604+0000 7fb4a4a00640 1 -- 172.21.15.18:0/496743754 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb498032900 con 0x7fb4a8107840 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.604+0000 7fb4a4a00640 1 -- 172.21.15.18:0/496743754 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb498030880 con 0x7fb4a8107840 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.604+0000 7fb4ad200640 1 -- 172.21.15.18:0/496743754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 msgr2=0x7fb4a8107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.604+0000 7fb4ad200640 1 --2- 172.21.15.18:0/496743754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a8107c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb498009820 tx=0x7fb49802a270 comp rx=0 tx=0).stop 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.604+0000 7fb4ad200640 1 -- 172.21.15.18:0/496743754 shutdown_connections 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.604+0000 7fb4ad200640 1 --2- 172.21.15.18:0/496743754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a8107c40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.604+0000 7fb4ad200640 1 -- 172.21.15.18:0/496743754 >> 172.21.15.18:0/496743754 conn(0x7fb4a807ac90 msgr2=0x7fb4a807b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.604+0000 7fb4ad200640 1 -- 172.21.15.18:0/496743754 shutdown_connections 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.605+0000 7fb4ad200640 1 -- 172.21.15.18:0/496743754 wait complete. 2024-09-13T16:42:22.592 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.606+0000 7fb4ad200640 1 Processor -- start 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.606+0000 7fb4ad200640 1 -- start start 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.606+0000 7fb4ad200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.606+0000 7fb4ad200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a819b8e0 con 0x7fb4a8107840 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.606+0000 7fb4a5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.606+0000 7fb4a5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a819b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41512/0 (socket says 172.21.15.18:41512) 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.606+0000 7fb4a5e00640 1 -- 172.21.15.18:0/3674485863 learned_addr learned my addr 172.21.15.18:0/3674485863 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.607+0000 7fb4a5e00640 1 -- 172.21.15.18:0/3674485863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980094d0 con 0x7fb4a8107840 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.607+0000 7fb4a5e00640 1 --2- 172.21.15.18:0/3674485863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a819b3a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4980097f0 tx=0x7fb498030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.607+0000 7fb49ea00640 1 -- 172.21.15.18:0/3674485863 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb498032c80 con 0x7fb4a8107840 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.607+0000 7fb49ea00640 1 -- 172.21.15.18:0/3674485863 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb498032de0 con 0x7fb4a8107840 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.607+0000 7fb4ad200640 1 -- 172.21.15.18:0/3674485863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a819bae0 con 0x7fb4a8107840 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.607+0000 7fb49ea00640 1 -- 172.21.15.18:0/3674485863 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb49803a690 con 0x7fb4a8107840 2024-09-13T16:42:22.593 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.607+0000 7fb4ad200640 1 -- 172.21.15.18:0/3674485863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a819bf80 con 0x7fb4a8107840 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.608+0000 7fb49ea00640 1 -- 172.21.15.18:0/3674485863 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fb498039040 con 0x7fb4a8107840 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.608+0000 7fb4ad200640 1 -- 172.21.15.18:0/3674485863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a810bae0 con 0x7fb4a8107840 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.609+0000 7fb49ea00640 1 --2- 172.21.15.18:0/3674485863 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb48c038760 0x7fb48c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.609+0000 7fb49ea00640 1 -- 172.21.15.18:0/3674485863 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb49806ba40 con 0x7fb4a8107840 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.609+0000 7fb4a5400640 1 --2- 172.21.15.18:0/3674485863 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb48c038760 0x7fb48c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.610+0000 7fb4a5400640 1 --2- 172.21.15.18:0/3674485863 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb48c038760 0x7fb48c03ac20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4940098c0 tx=0x7fb494006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.614+0000 7fb49ea00640 1 -- 172.21.15.18:0/3674485863 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb4980313a0 con 0x7fb4a8107840 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.884+0000 7fb4ad200640 1 -- 172.21.15.18:0/3674485863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fb4a810bd20 con 0x7fb4a8107840 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.887+0000 7fb49ea00640 1 -- 172.21.15.18:0/3674485863 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7fb49803f070 con 0x7fb4a8107840 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.889+0000 7fb4ad200640 1 -- 172.21.15.18:0/3674485863 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb48c038760 msgr2=0x7fb48c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.889+0000 7fb4ad200640 1 --2- 172.21.15.18:0/3674485863 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb48c038760 0x7fb48c03ac20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4940098c0 tx=0x7fb494006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:22.594 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.889+0000 7fb4ad200640 1 -- 172.21.15.18:0/3674485863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 msgr2=0x7fb4a819b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.889+0000 7fb4ad200640 1 --2- 172.21.15.18:0/3674485863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a819b3a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4980097f0 tx=0x7fb498030d70 comp rx=0 tx=0).stop 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.889+0000 7fb4ad200640 1 -- 172.21.15.18:0/3674485863 shutdown_connections 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.889+0000 7fb4ad200640 1 --2- 172.21.15.18:0/3674485863 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb48c038760 0x7fb48c03ac20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.889+0000 7fb4ad200640 1 --2- 172.21.15.18:0/3674485863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a8107840 0x7fb4a819b3a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.889+0000 7fb4ad200640 1 -- 172.21.15.18:0/3674485863 >> 172.21.15.18:0/3674485863 conn(0x7fb4a807ac90 msgr2=0x7fb4a8105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.889+0000 7fb4ad200640 1 -- 172.21.15.18:0/3674485863 shutdown_connections 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-13T16:42:21.889+0000 7fb4ad200640 1 -- 172.21.15.18:0/3674485863 wait complete. 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T16:42:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:22.596 INFO:teuthology.orchestra.run.smithi018.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T16:42:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: ceph telemetry on 2024-09-13T16:42:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:22.596 INFO:teuthology.orchestra.run.smithi018.stdout:For more information see: 2024-09-13T16:42:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T16:42:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:22.596 INFO:teuthology.orchestra.run.smithi018.stdout:Bootstrap complete. 2024-09-13T16:42:22.647 INFO:tasks.cephadm:Fetching config... 2024-09-13T16:42:22.648 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:42:22.648 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T16:42:22.686 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T16:42:22.686 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:42:22.686 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T16:42:22.762 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T16:42:22.763 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:42:22.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-13T16:42:22.860 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T16:42:22.860 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:42:22.860 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T16:42:22.935 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T16:42:22.935 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCT76eZCCQ0SSUjIVsJk9Ls334X2CgXXGNzpkZbLAVONWOdm3yrYtEnX8KcvoTQNTt/gaR+9a/NkmLi6+wJy7Ain02Vr/SFSkBHNqsatI2DfQup0roXMcGWiVwXXM9UN8T/eR5HG5HnAzYJXmDz98EFkimzMIM+1iXGF5BmDSac+3ox4NhOXJBIrx8Zlw1RmoVJNAkpB9lbAn1bpIy1CwBd4o2InV4+fh7oQGBR24+2DdYxOSXpYkjuXu/M8OD1VtPLbdHYNOgb0EVkKQZRRQ4hYrkRy2ipqd57NbzNu8NqLqQp8Awin9ZjnkX+Kt8174Vset/Wng2hPZlLnXM4WjWGJMBJri6TFvC/OFToO7dFQ8A9oL/XvS+QW7fdhPmdScEzB4G5e9aj6RdKXpurgKlKvMiMqlr4Oy1vDYTMCB17AWGQGidVRkn6j7iiNrHxBvdz4oxigZTvDA8Lo9WcOIwJHVJalMbgRMWHSE/KOEVOjThrIlvkigZwp4MhId9xnmU= ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T16:42:23.069 INFO:teuthology.orchestra.run.smithi018.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCT76eZCCQ0SSUjIVsJk9Ls334X2CgXXGNzpkZbLAVONWOdm3yrYtEnX8KcvoTQNTt/gaR+9a/NkmLi6+wJy7Ain02Vr/SFSkBHNqsatI2DfQup0roXMcGWiVwXXM9UN8T/eR5HG5HnAzYJXmDz98EFkimzMIM+1iXGF5BmDSac+3ox4NhOXJBIrx8Zlw1RmoVJNAkpB9lbAn1bpIy1CwBd4o2InV4+fh7oQGBR24+2DdYxOSXpYkjuXu/M8OD1VtPLbdHYNOgb0EVkKQZRRQ4hYrkRy2ipqd57NbzNu8NqLqQp8Awin9ZjnkX+Kt8174Vset/Wng2hPZlLnXM4WjWGJMBJri6TFvC/OFToO7dFQ8A9oL/XvS+QW7fdhPmdScEzB4G5e9aj6RdKXpurgKlKvMiMqlr4Oy1vDYTMCB17AWGQGidVRkn6j7iiNrHxBvdz4oxigZTvDA8Lo9WcOIwJHVJalMbgRMWHSE/KOEVOjThrIlvkigZwp4MhId9xnmU= ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:42:23.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:22 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3674485863' entity='client.admin' 2024-09-13T16:42:23.094 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCT76eZCCQ0SSUjIVsJk9Ls334X2CgXXGNzpkZbLAVONWOdm3yrYtEnX8KcvoTQNTt/gaR+9a/NkmLi6+wJy7Ain02Vr/SFSkBHNqsatI2DfQup0roXMcGWiVwXXM9UN8T/eR5HG5HnAzYJXmDz98EFkimzMIM+1iXGF5BmDSac+3ox4NhOXJBIrx8Zlw1RmoVJNAkpB9lbAn1bpIy1CwBd4o2InV4+fh7oQGBR24+2DdYxOSXpYkjuXu/M8OD1VtPLbdHYNOgb0EVkKQZRRQ4hYrkRy2ipqd57NbzNu8NqLqQp8Awin9ZjnkX+Kt8174Vset/Wng2hPZlLnXM4WjWGJMBJri6TFvC/OFToO7dFQ8A9oL/XvS+QW7fdhPmdScEzB4G5e9aj6RdKXpurgKlKvMiMqlr4Oy1vDYTMCB17AWGQGidVRkn6j7iiNrHxBvdz4oxigZTvDA8Lo9WcOIwJHVJalMbgRMWHSE/KOEVOjThrIlvkigZwp4MhId9xnmU= ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T16:42:23.135 INFO:teuthology.orchestra.run.smithi094.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCT76eZCCQ0SSUjIVsJk9Ls334X2CgXXGNzpkZbLAVONWOdm3yrYtEnX8KcvoTQNTt/gaR+9a/NkmLi6+wJy7Ain02Vr/SFSkBHNqsatI2DfQup0roXMcGWiVwXXM9UN8T/eR5HG5HnAzYJXmDz98EFkimzMIM+1iXGF5BmDSac+3ox4NhOXJBIrx8Zlw1RmoVJNAkpB9lbAn1bpIy1CwBd4o2InV4+fh7oQGBR24+2DdYxOSXpYkjuXu/M8OD1VtPLbdHYNOgb0EVkKQZRRQ4hYrkRy2ipqd57NbzNu8NqLqQp8Awin9ZjnkX+Kt8174Vset/Wng2hPZlLnXM4WjWGJMBJri6TFvC/OFToO7dFQ8A9oL/XvS+QW7fdhPmdScEzB4G5e9aj6RdKXpurgKlKvMiMqlr4Oy1vDYTMCB17AWGQGidVRkn6j7iiNrHxBvdz4oxigZTvDA8Lo9WcOIwJHVJalMbgRMWHSE/KOEVOjThrIlvkigZwp4MhId9xnmU= ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:42:23.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCT76eZCCQ0SSUjIVsJk9Ls334X2CgXXGNzpkZbLAVONWOdm3yrYtEnX8KcvoTQNTt/gaR+9a/NkmLi6+wJy7Ain02Vr/SFSkBHNqsatI2DfQup0roXMcGWiVwXXM9UN8T/eR5HG5HnAzYJXmDz98EFkimzMIM+1iXGF5BmDSac+3ox4NhOXJBIrx8Zlw1RmoVJNAkpB9lbAn1bpIy1CwBd4o2InV4+fh7oQGBR24+2DdYxOSXpYkjuXu/M8OD1VtPLbdHYNOgb0EVkKQZRRQ4hYrkRy2ipqd57NbzNu8NqLqQp8Awin9ZjnkX+Kt8174Vset/Wng2hPZlLnXM4WjWGJMBJri6TFvC/OFToO7dFQ8A9oL/XvS+QW7fdhPmdScEzB4G5e9aj6RdKXpurgKlKvMiMqlr4Oy1vDYTMCB17AWGQGidVRkn6j7iiNrHxBvdz4oxigZTvDA8Lo9WcOIwJHVJalMbgRMWHSE/KOEVOjThrIlvkigZwp4MhId9xnmU= ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T16:42:23.193 INFO:teuthology.orchestra.run.smithi144.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCT76eZCCQ0SSUjIVsJk9Ls334X2CgXXGNzpkZbLAVONWOdm3yrYtEnX8KcvoTQNTt/gaR+9a/NkmLi6+wJy7Ain02Vr/SFSkBHNqsatI2DfQup0roXMcGWiVwXXM9UN8T/eR5HG5HnAzYJXmDz98EFkimzMIM+1iXGF5BmDSac+3ox4NhOXJBIrx8Zlw1RmoVJNAkpB9lbAn1bpIy1CwBd4o2InV4+fh7oQGBR24+2DdYxOSXpYkjuXu/M8OD1VtPLbdHYNOgb0EVkKQZRRQ4hYrkRy2ipqd57NbzNu8NqLqQp8Awin9ZjnkX+Kt8174Vset/Wng2hPZlLnXM4WjWGJMBJri6TFvC/OFToO7dFQ8A9oL/XvS+QW7fdhPmdScEzB4G5e9aj6RdKXpurgKlKvMiMqlr4Oy1vDYTMCB17AWGQGidVRkn6j7iiNrHxBvdz4oxigZTvDA8Lo9WcOIwJHVJalMbgRMWHSE/KOEVOjThrIlvkigZwp4MhId9xnmU= ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:42:23.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T16:42:23.517 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:42:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.069+0000 7fb435e00640 1 -- 172.21.15.18:0/3094747384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb430074e60 msgr2=0x7fb430075260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.069+0000 7fb435e00640 1 --2- 172.21.15.18:0/3094747384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb430074e60 0x7fb430075260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb420009880 tx=0x7fb42002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:42:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.069+0000 7fb435e00640 1 -- 172.21.15.18:0/3094747384 shutdown_connections 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.069+0000 7fb435e00640 1 --2- 172.21.15.18:0/3094747384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb430074e60 0x7fb430075260 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.069+0000 7fb435e00640 1 -- 172.21.15.18:0/3094747384 >> 172.21.15.18:0/3094747384 conn(0x7fb4300fd1a0 msgr2=0x7fb4300ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.070+0000 7fb435e00640 1 -- 172.21.15.18:0/3094747384 shutdown_connections 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.070+0000 7fb435e00640 1 -- 172.21.15.18:0/3094747384 wait complete. 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.070+0000 7fb435e00640 1 Processor -- start 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.071+0000 7fb435e00640 1 -- start start 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.071+0000 7fb435e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb430074e60 0x7fb43019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.071+0000 7fb435e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43019b6f0 con 0x7fb430074e60 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.071+0000 7fb42ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb430074e60 0x7fb43019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.071+0000 7fb42ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb430074e60 0x7fb43019b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41532/0 (socket says 172.21.15.18:41532) 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.071+0000 7fb42ea00640 1 -- 172.21.15.18:0/4006080037 learned_addr learned my addr 172.21.15.18:0/4006080037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.071+0000 7fb42ea00640 1 -- 172.21.15.18:0/4006080037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420009560 con 0x7fb430074e60 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.072+0000 7fb42ea00640 1 --2- 172.21.15.18:0/4006080037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb430074e60 0x7fb43019b1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb420004e60 tx=0x7fb420004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.072+0000 7fb434a00640 1 -- 172.21.15.18:0/4006080037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4200054a0 con 0x7fb430074e60 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.072+0000 7fb435e00640 1 -- 172.21.15.18:0/4006080037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43019b8f0 con 0x7fb430074e60 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.072+0000 7fb434a00640 1 -- 172.21.15.18:0/4006080037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb420005600 con 0x7fb430074e60 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.072+0000 7fb434a00640 1 -- 172.21.15.18:0/4006080037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb42003ca00 con 0x7fb430074e60 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.072+0000 7fb435e00640 1 -- 172.21.15.18:0/4006080037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43019bd90 con 0x7fb430074e60 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.073+0000 7fb434a00640 1 -- 172.21.15.18:0/4006080037 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fb42003cc30 con 0x7fb430074e60 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.073+0000 7fb435e00640 1 -- 172.21.15.18:0/4006080037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb430075260 con 0x7fb430074e60 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.074+0000 7fb434a00640 1 --2- 172.21.15.18:0/4006080037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb414038760 0x7fb41403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.074+0000 7fb434a00640 1 -- 172.21.15.18:0/4006080037 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb42006c630 con 0x7fb430074e60 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.074+0000 7fb427e00640 1 --2- 172.21.15.18:0/4006080037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb414038760 0x7fb41403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.075+0000 7fb427e00640 1 --2- 172.21.15.18:0/4006080037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb414038760 0x7fb41403ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb4180098c0 tx=0x7fb418006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.083+0000 7fb434a00640 1 -- 172.21.15.18:0/4006080037 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb42003a900 con 0x7fb430074e60 2024-09-13T16:42:26.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.264+0000 7fb435e00640 1 -- 172.21.15.18:0/4006080037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fb43010bf00 con 0x7fb430074e60 2024-09-13T16:42:26.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.268+0000 7fb434a00640 1 -- 172.21.15.18:0/4006080037 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb420035020 con 0x7fb430074e60 2024-09-13T16:42:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.270+0000 7fb435e00640 1 -- 172.21.15.18:0/4006080037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb414038760 msgr2=0x7fb41403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.271+0000 7fb435e00640 1 --2- 172.21.15.18:0/4006080037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb414038760 0x7fb41403ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb4180098c0 tx=0x7fb418006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.271+0000 7fb435e00640 1 -- 172.21.15.18:0/4006080037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb430074e60 msgr2=0x7fb43019b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.271+0000 7fb435e00640 1 --2- 172.21.15.18:0/4006080037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb430074e60 0x7fb43019b1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb420004e60 tx=0x7fb420004f50 comp rx=0 tx=0).stop 2024-09-13T16:42:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.271+0000 7fb435e00640 1 -- 172.21.15.18:0/4006080037 shutdown_connections 2024-09-13T16:42:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.271+0000 7fb435e00640 1 --2- 172.21.15.18:0/4006080037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb414038760 0x7fb41403ac20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.271+0000 7fb435e00640 1 --2- 172.21.15.18:0/4006080037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb430074e60 0x7fb43019b1b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.271+0000 7fb435e00640 1 -- 172.21.15.18:0/4006080037 >> 172.21.15.18:0/4006080037 conn(0x7fb4300fd1a0 msgr2=0x7fb4300fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.271+0000 7fb435e00640 1 -- 172.21.15.18:0/4006080037 shutdown_connections 2024-09-13T16:42:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:26.271+0000 7fb435e00640 1 -- 172.21.15.18:0/4006080037 wait complete. 2024-09-13T16:42:27.062 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T16:42:27.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T16:42:27.632 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:27 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4006080037' entity='client.admin' 2024-09-13T16:42:27.795 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:42:28.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:28.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:42:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:42:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:29.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.626+0000 7f111fa00640 1 -- 172.21.15.18:0/1758698237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1118105e00 msgr2=0x7f1118106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:29.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.626+0000 7f111fa00640 1 --2- 172.21.15.18:0/1758698237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1118105e00 0x7f1118106200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1108009880 tx=0x7f110802a5d0 comp rx=0 tx=0).stop 2024-09-13T16:42:29.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.626+0000 7f111fa00640 1 -- 172.21.15.18:0/1758698237 shutdown_connections 2024-09-13T16:42:29.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.626+0000 7f111fa00640 1 --2- 172.21.15.18:0/1758698237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1118105e00 0x7f1118106200 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:29.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.626+0000 7f111fa00640 1 -- 172.21.15.18:0/1758698237 >> 172.21.15.18:0/1758698237 conn(0x7f1118074fe0 msgr2=0x7f1118077400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:29.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.626+0000 7f111fa00640 1 -- 172.21.15.18:0/1758698237 shutdown_connections 2024-09-13T16:42:29.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.626+0000 7f111fa00640 1 -- 172.21.15.18:0/1758698237 wait complete. 2024-09-13T16:42:29.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.627+0000 7f111fa00640 1 Processor -- start 2024-09-13T16:42:29.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.627+0000 7f111fa00640 1 -- start start 2024-09-13T16:42:29.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.628+0000 7f111fa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1118105e00 0x7f111819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.628+0000 7f111fa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111819b6f0 con 0x7f1118105e00 2024-09-13T16:42:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.628+0000 7f111d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1118105e00 0x7f111819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.628+0000 7f111d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1118105e00 0x7f111819b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41558/0 (socket says 172.21.15.18:41558) 2024-09-13T16:42:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.628+0000 7f111d000640 1 -- 172.21.15.18:0/979614797 learned_addr learned my addr 172.21.15.18:0/979614797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.628+0000 7f111d000640 1 -- 172.21.15.18:0/979614797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1108009560 con 0x7f1118105e00 2024-09-13T16:42:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.629+0000 7f111d000640 1 --2- 172.21.15.18:0/979614797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1118105e00 0x7f111819b1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1108004e60 tx=0x7f1108004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.629+0000 7f1116000640 1 -- 172.21.15.18:0/979614797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11080054a0 con 0x7f1118105e00 2024-09-13T16:42:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.629+0000 7f1116000640 1 -- 172.21.15.18:0/979614797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1108005600 con 0x7f1118105e00 2024-09-13T16:42:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.629+0000 7f111fa00640 1 -- 172.21.15.18:0/979614797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111819b8f0 con 0x7f1118105e00 2024-09-13T16:42:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.629+0000 7f1116000640 1 -- 172.21.15.18:0/979614797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f110803ca00 con 0x7f1118105e00 2024-09-13T16:42:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.629+0000 7f111fa00640 1 -- 172.21.15.18:0/979614797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111819bd90 con 0x7f1118105e00 2024-09-13T16:42:29.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.630+0000 7f1116000640 1 -- 172.21.15.18:0/979614797 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f110803cc30 con 0x7f1118105e00 2024-09-13T16:42:29.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.630+0000 7f111fa00640 1 -- 172.21.15.18:0/979614797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1118106200 con 0x7f1118105e00 2024-09-13T16:42:29.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.631+0000 7f1116000640 1 --2- 172.21.15.18:0/979614797 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10fc038760 0x7f10fc03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:29.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.631+0000 7f1116000640 1 -- 172.21.15.18:0/979614797 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f110806c700 con 0x7f1118105e00 2024-09-13T16:42:29.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.631+0000 7f110fe00640 1 --2- 172.21.15.18:0/979614797 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10fc038760 0x7f10fc03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:29.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.632+0000 7f110fe00640 1 --2- 172.21.15.18:0/979614797 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10fc038760 0x7f10fc03ac20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f11000098c0 tx=0x7f1100006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.636+0000 7f1116000640 1 -- 172.21.15.18:0/979614797 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f110803a540 con 0x7f1118105e00 2024-09-13T16:42:29.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.825+0000 7f111fa00640 1 -- 172.21.15.18:0/979614797 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f1118060980 con 0x7f10fc038760 2024-09-13T16:42:29.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.828+0000 7f1116000640 1 -- 172.21.15.18:0/979614797 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1118060980 con 0x7f10fc038760 2024-09-13T16:42:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.831+0000 7f111fa00640 1 -- 172.21.15.18:0/979614797 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10fc038760 msgr2=0x7f10fc03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.831+0000 7f111fa00640 1 --2- 172.21.15.18:0/979614797 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10fc038760 0x7f10fc03ac20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f11000098c0 tx=0x7f1100006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.831+0000 7f111fa00640 1 -- 172.21.15.18:0/979614797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1118105e00 msgr2=0x7f111819b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.831+0000 7f111fa00640 1 --2- 172.21.15.18:0/979614797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1118105e00 0x7f111819b1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1108004e60 tx=0x7f1108004f50 comp rx=0 tx=0).stop 2024-09-13T16:42:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.831+0000 7f111fa00640 1 -- 172.21.15.18:0/979614797 shutdown_connections 2024-09-13T16:42:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.831+0000 7f111fa00640 1 --2- 172.21.15.18:0/979614797 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10fc038760 0x7f10fc03ac20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.831+0000 7f111fa00640 1 --2- 172.21.15.18:0/979614797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1118105e00 0x7f111819b1b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.831+0000 7f111fa00640 1 -- 172.21.15.18:0/979614797 >> 172.21.15.18:0/979614797 conn(0x7f1118074fe0 msgr2=0x7f11180759c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.831+0000 7f111fa00640 1 -- 172.21.15.18:0/979614797 shutdown_connections 2024-09-13T16:42:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:29.832+0000 7f111fa00640 1 -- 172.21.15.18:0/979614797 wait complete. 2024-09-13T16:42:30.627 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi094 2024-09-13T16:42:30.628 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:42:30.628 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/etc/ceph/ceph.conf 2024-09-13T16:42:30.648 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:42:30.648 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:42:30.706 INFO:tasks.cephadm:Adding host smithi094 to orchestrator... 2024-09-13T16:42:30.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch host add smithi094 2024-09-13T16:42:31.024 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:42:31.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:30 smithi018 ceph-mon[30981]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:42:31.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:31.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:42:31.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:42:31.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:42:31.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:30 smithi018 ceph-mon[30981]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-13T16:42:31.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:30 smithi018 ceph-mon[30981]: Updating smithi018:/var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:42:32.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:31 smithi018 ceph-mon[30981]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:42:32.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:31 smithi018 ceph-mon[30981]: Updating smithi018:/var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:42:32.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:31 smithi018 ceph-mon[30981]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:32.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:32.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:32.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:32.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.902+0000 7fab33e00640 1 -- 172.21.15.18:0/2328927219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab34072850 msgr2=0x7fab34072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:32.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.902+0000 7fab33e00640 1 --2- 172.21.15.18:0/2328927219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab34072850 0x7fab34072c30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab24009880 tx=0x7fab2402a670 comp rx=0 tx=0).stop 2024-09-13T16:42:32.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.902+0000 7fab33e00640 1 -- 172.21.15.18:0/2328927219 shutdown_connections 2024-09-13T16:42:32.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.902+0000 7fab33e00640 1 --2- 172.21.15.18:0/2328927219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab34072850 0x7fab34072c30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:32.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.902+0000 7fab33e00640 1 -- 172.21.15.18:0/2328927219 >> 172.21.15.18:0/2328927219 conn(0x7fab340fb230 msgr2=0x7fab340fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:32.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.902+0000 7fab33e00640 1 -- 172.21.15.18:0/2328927219 shutdown_connections 2024-09-13T16:42:32.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.902+0000 7fab33e00640 1 -- 172.21.15.18:0/2328927219 wait complete. 2024-09-13T16:42:32.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.903+0000 7fab33e00640 1 Processor -- start 2024-09-13T16:42:32.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.903+0000 7fab33e00640 1 -- start start 2024-09-13T16:42:32.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.903+0000 7fab33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab34072850 0x7fab3419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:32.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.903+0000 7fab33e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3419b920 con 0x7fab34072850 2024-09-13T16:42:32.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.903+0000 7fab32a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab34072850 0x7fab3419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:32.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.903+0000 7fab32a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab34072850 0x7fab3419b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55324/0 (socket says 172.21.15.18:55324) 2024-09-13T16:42:32.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.903+0000 7fab32a00640 1 -- 172.21.15.18:0/2989384119 learned_addr learned my addr 172.21.15.18:0/2989384119 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:32.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.904+0000 7fab32a00640 1 -- 172.21.15.18:0/2989384119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24009560 con 0x7fab34072850 2024-09-13T16:42:32.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.904+0000 7fab32a00640 1 --2- 172.21.15.18:0/2989384119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab34072850 0x7fab3419b3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab24009230 tx=0x7fab24004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:32.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.904+0000 7fab2b400640 1 -- 172.21.15.18:0/2989384119 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab240053c0 con 0x7fab34072850 2024-09-13T16:42:32.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.904+0000 7fab2b400640 1 -- 172.21.15.18:0/2989384119 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab24005520 con 0x7fab34072850 2024-09-13T16:42:32.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.904+0000 7fab33e00640 1 -- 172.21.15.18:0/2989384119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3419bb80 con 0x7fab34072850 2024-09-13T16:42:32.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.905+0000 7fab2b400640 1 -- 172.21.15.18:0/2989384119 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab2403c830 con 0x7fab34072850 2024-09-13T16:42:32.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.905+0000 7fab33e00640 1 -- 172.21.15.18:0/2989384119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3419c000 con 0x7fab34072850 2024-09-13T16:42:32.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.906+0000 7fab33e00640 1 -- 172.21.15.18:0/2989384119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab340fcfa0 con 0x7fab34072850 2024-09-13T16:42:32.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.906+0000 7fab2b400640 1 -- 172.21.15.18:0/2989384119 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fab240035f0 con 0x7fab34072850 2024-09-13T16:42:32.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.906+0000 7fab2b400640 1 --2- 172.21.15.18:0/2989384119 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab180387b0 0x7fab1803ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:32.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.907+0000 7fab2b400640 1 -- 172.21.15.18:0/2989384119 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fab2406c490 con 0x7fab34072850 2024-09-13T16:42:32.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.907+0000 7fab2be00640 1 --2- 172.21.15.18:0/2989384119 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab180387b0 0x7fab1803ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:32.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.908+0000 7fab2be00640 1 --2- 172.21.15.18:0/2989384119 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab180387b0 0x7fab1803ac70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0098c0 tx=0x7fab1c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:32.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:32.912+0000 7fab2b400640 1 -- 172.21.15.18:0/2989384119 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fab24003cc0 con 0x7fab34072850 2024-09-13T16:42:33.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:33.097+0000 7fab33e00640 1 -- 172.21.15.18:0/2989384119 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi094", "target": ["mon-mgr", ""]}) v1 -- 0x7fab3410fff0 con 0x7fab180387b0 2024-09-13T16:42:35.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:34 smithi018 ceph-mon[30981]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi094", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:42:35.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:34 smithi018 ceph-mon[30981]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:35 smithi018 ceph-mon[30981]: Deploying cephadm binary to smithi094 2024-09-13T16:42:36.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.383+0000 7fab2b400640 1 -- 172.21.15.18:0/2989384119 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fab3410fff0 con 0x7fab180387b0 2024-09-13T16:42:36.385 INFO:teuthology.orchestra.run.smithi018.stdout:Added host 'smithi094' with addr '172.21.15.94' 2024-09-13T16:42:36.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.386+0000 7fab33e00640 1 -- 172.21.15.18:0/2989384119 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab180387b0 msgr2=0x7fab1803ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.386+0000 7fab33e00640 1 --2- 172.21.15.18:0/2989384119 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab180387b0 0x7fab1803ac70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0098c0 tx=0x7fab1c006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.386+0000 7fab33e00640 1 -- 172.21.15.18:0/2989384119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab34072850 msgr2=0x7fab3419b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.386+0000 7fab33e00640 1 --2- 172.21.15.18:0/2989384119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab34072850 0x7fab3419b3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab24009230 tx=0x7fab24004e10 comp rx=0 tx=0).stop 2024-09-13T16:42:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.386+0000 7fab33e00640 1 -- 172.21.15.18:0/2989384119 shutdown_connections 2024-09-13T16:42:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.386+0000 7fab33e00640 1 --2- 172.21.15.18:0/2989384119 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab180387b0 0x7fab1803ac70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.386+0000 7fab33e00640 1 --2- 172.21.15.18:0/2989384119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab34072850 0x7fab3419b3e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.386+0000 7fab33e00640 1 -- 172.21.15.18:0/2989384119 >> 172.21.15.18:0/2989384119 conn(0x7fab340fb230 msgr2=0x7fab340fb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.386+0000 7fab33e00640 1 -- 172.21.15.18:0/2989384119 shutdown_connections 2024-09-13T16:42:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:36.386+0000 7fab33e00640 1 -- 172.21.15.18:0/2989384119 wait complete. 2024-09-13T16:42:37.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:36 smithi018 ceph-mon[30981]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:37.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:37.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:42:37.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:37.066 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T16:42:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:42:37.822 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:37 smithi018 ceph-mon[30981]: Added host smithi094 2024-09-13T16:42:37.822 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:37 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:37.822 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:37 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:38.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:38 smithi018 ceph-mon[30981]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.206+0000 7fc248a00640 1 -- 172.21.15.18:0/878160298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc244107790 msgr2=0x7fc244107b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.206+0000 7fc248a00640 1 --2- 172.21.15.18:0/878160298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc244107790 0x7fc244107b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc234009880 tx=0x7fc23402a5d0 comp rx=0 tx=0).stop 2024-09-13T16:42:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.206+0000 7fc248a00640 1 -- 172.21.15.18:0/878160298 shutdown_connections 2024-09-13T16:42:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.206+0000 7fc248a00640 1 --2- 172.21.15.18:0/878160298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc244107790 0x7fc244107b70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:39.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.206+0000 7fc248a00640 1 -- 172.21.15.18:0/878160298 >> 172.21.15.18:0/878160298 conn(0x7fc2440fd490 msgr2=0x7fc2440ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:39.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.207+0000 7fc248a00640 1 -- 172.21.15.18:0/878160298 shutdown_connections 2024-09-13T16:42:39.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.207+0000 7fc248a00640 1 -- 172.21.15.18:0/878160298 wait complete. 2024-09-13T16:42:39.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.207+0000 7fc248a00640 1 Processor -- start 2024-09-13T16:42:39.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.208+0000 7fc248a00640 1 -- start start 2024-09-13T16:42:39.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.208+0000 7fc248a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc244107790 0x7fc244196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:39.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.208+0000 7fc248a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2441974a0 con 0x7fc244107790 2024-09-13T16:42:39.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.208+0000 7fc242800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc244107790 0x7fc244196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:39.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.208+0000 7fc242800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc244107790 0x7fc244196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55342/0 (socket says 172.21.15.18:55342) 2024-09-13T16:42:39.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.208+0000 7fc242800640 1 -- 172.21.15.18:0/758326248 learned_addr learned my addr 172.21.15.18:0/758326248 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:39.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.209+0000 7fc242800640 1 -- 172.21.15.18:0/758326248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234009560 con 0x7fc244107790 2024-09-13T16:42:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.209+0000 7fc242800640 1 --2- 172.21.15.18:0/758326248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc244107790 0x7fc244196f60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc234009230 tx=0x7fc234004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.209+0000 7fc23b400640 1 -- 172.21.15.18:0/758326248 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2340054d0 con 0x7fc244107790 2024-09-13T16:42:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.209+0000 7fc23b400640 1 -- 172.21.15.18:0/758326248 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc234003ab0 con 0x7fc244107790 2024-09-13T16:42:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.209+0000 7fc23b400640 1 -- 172.21.15.18:0/758326248 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc23403c940 con 0x7fc244107790 2024-09-13T16:42:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.209+0000 7fc248a00640 1 -- 172.21.15.18:0/758326248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc244197700 con 0x7fc244107790 2024-09-13T16:42:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.209+0000 7fc248a00640 1 -- 172.21.15.18:0/758326248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc244197b80 con 0x7fc244107790 2024-09-13T16:42:39.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.210+0000 7fc248a00640 1 -- 172.21.15.18:0/758326248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc244102ed0 con 0x7fc244107790 2024-09-13T16:42:39.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.210+0000 7fc23b400640 1 -- 172.21.15.18:0/758326248 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fc234003c20 con 0x7fc244107790 2024-09-13T16:42:39.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.211+0000 7fc23b400640 1 --2- 172.21.15.18:0/758326248 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc228038710 0x7fc22803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:39.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.211+0000 7fc23b400640 1 -- 172.21.15.18:0/758326248 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc23406c430 con 0x7fc244107790 2024-09-13T16:42:39.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.211+0000 7fc23be00640 1 --2- 172.21.15.18:0/758326248 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc228038710 0x7fc22803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:39.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.212+0000 7fc23be00640 1 --2- 172.21.15.18:0/758326248 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc228038710 0x7fc22803abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0098c0 tx=0x7fc22c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:39.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.216+0000 7fc23b400640 1 -- 172.21.15.18:0/758326248 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc23404d530 con 0x7fc244107790 2024-09-13T16:42:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.401+0000 7fc248a00640 1 -- 172.21.15.18:0/758326248 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc24410bb70 con 0x7fc228038710 2024-09-13T16:42:39.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.402+0000 7fc23b400640 1 -- 172.21.15.18:0/758326248 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7fc24410bb70 con 0x7fc228038710 2024-09-13T16:42:39.403 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:39.404 INFO:teuthology.orchestra.run.smithi018.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.94", "hostname": "smithi094", "labels": [], "status": ""}] 2024-09-13T16:42:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.404+0000 7fc248a00640 1 -- 172.21.15.18:0/758326248 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc228038710 msgr2=0x7fc22803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.404+0000 7fc248a00640 1 --2- 172.21.15.18:0/758326248 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc228038710 0x7fc22803abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0098c0 tx=0x7fc22c006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.404+0000 7fc248a00640 1 -- 172.21.15.18:0/758326248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc244107790 msgr2=0x7fc244196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.404+0000 7fc248a00640 1 --2- 172.21.15.18:0/758326248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc244107790 0x7fc244196f60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc234009230 tx=0x7fc234004e50 comp rx=0 tx=0).stop 2024-09-13T16:42:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.404+0000 7fc248a00640 1 -- 172.21.15.18:0/758326248 shutdown_connections 2024-09-13T16:42:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.404+0000 7fc248a00640 1 --2- 172.21.15.18:0/758326248 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc228038710 0x7fc22803abd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.404+0000 7fc248a00640 1 --2- 172.21.15.18:0/758326248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc244107790 0x7fc244196f60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.404+0000 7fc248a00640 1 -- 172.21.15.18:0/758326248 >> 172.21.15.18:0/758326248 conn(0x7fc2440fd490 msgr2=0x7fc2440fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.404+0000 7fc248a00640 1 -- 172.21.15.18:0/758326248 shutdown_connections 2024-09-13T16:42:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:39.405+0000 7fc248a00640 1 -- 172.21.15.18:0/758326248 wait complete. 2024-09-13T16:42:40.096 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi144 2024-09-13T16:42:40.097 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:42:40.097 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/etc/ceph/ceph.conf 2024-09-13T16:42:40.116 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:42:40.116 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:42:40.175 INFO:tasks.cephadm:Adding host smithi144 to orchestrator... 2024-09-13T16:42:40.175 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch host add smithi144 2024-09-13T16:42:40.485 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:42:40.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:40 smithi018 ceph-mon[30981]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:42:40.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:40 smithi018 ceph-mon[30981]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:40.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:40.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:40.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:40.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:40.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi094", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:42:40.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:42:40.936 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:42:41.957 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:41 smithi018 ceph-mon[30981]: Updating smithi094:/etc/ceph/ceph.conf 2024-09-13T16:42:41.957 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:41 smithi018 ceph-mon[30981]: Updating smithi094:/var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:42:41.957 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:41 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:41.957 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:41 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:41.957 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:41 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:42.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.320+0000 7f8615800640 1 -- 172.21.15.18:0/2283377686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100749e0 msgr2=0x7f8610074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:42.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.320+0000 7f8615800640 1 --2- 172.21.15.18:0/2283377686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100749e0 0x7f8610074dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8600009880 tx=0x7f860002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:42:42.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.320+0000 7f8615800640 1 -- 172.21.15.18:0/2283377686 shutdown_connections 2024-09-13T16:42:42.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.320+0000 7f8615800640 1 --2- 172.21.15.18:0/2283377686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100749e0 0x7f8610074dc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:42.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.320+0000 7f8615800640 1 -- 172.21.15.18:0/2283377686 >> 172.21.15.18:0/2283377686 conn(0x7f86100fd690 msgr2=0x7f86100ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:42.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.320+0000 7f8615800640 1 -- 172.21.15.18:0/2283377686 shutdown_connections 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.320+0000 7f8615800640 1 -- 172.21.15.18:0/2283377686 wait complete. 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.321+0000 7f8615800640 1 Processor -- start 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.321+0000 7f8615800640 1 -- start start 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.322+0000 7f8615800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100749e0 0x7f861019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.322+0000 7f8615800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861019bb00 con 0x7f86100749e0 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.322+0000 7f860ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100749e0 0x7f861019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.322+0000 7f860ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100749e0 0x7f861019b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54738/0 (socket says 172.21.15.18:54738) 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.322+0000 7f860ea00640 1 -- 172.21.15.18:0/3937931296 learned_addr learned my addr 172.21.15.18:0/3937931296 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.322+0000 7f860ea00640 1 -- 172.21.15.18:0/3937931296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600009560 con 0x7f86100749e0 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.323+0000 7f860ea00640 1 --2- 172.21.15.18:0/3937931296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100749e0 0x7f861019b5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8600009230 tx=0x7f8600004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.323+0000 7f8607400640 1 -- 172.21.15.18:0/3937931296 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86000054d0 con 0x7f86100749e0 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.323+0000 7f8607400640 1 -- 172.21.15.18:0/3937931296 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8600003ab0 con 0x7f86100749e0 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.323+0000 7f8615800640 1 -- 172.21.15.18:0/3937931296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861019bd00 con 0x7f86100749e0 2024-09-13T16:42:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.323+0000 7f8607400640 1 -- 172.21.15.18:0/3937931296 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f860003c940 con 0x7f86100749e0 2024-09-13T16:42:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.323+0000 7f8615800640 1 -- 172.21.15.18:0/3937931296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861019c120 con 0x7f86100749e0 2024-09-13T16:42:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.324+0000 7f8607400640 1 -- 172.21.15.18:0/3937931296 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f8600003c20 con 0x7f86100749e0 2024-09-13T16:42:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.324+0000 7f8615800640 1 -- 172.21.15.18:0/3937931296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8610076120 con 0x7f86100749e0 2024-09-13T16:42:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.325+0000 7f8607400640 1 --2- 172.21.15.18:0/3937931296 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85f4038760 0x7f85f403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.325+0000 7f8607400640 1 -- 172.21.15.18:0/3937931296 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f860006c420 con 0x7f86100749e0 2024-09-13T16:42:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.325+0000 7f860e000640 1 --2- 172.21.15.18:0/3937931296 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85f4038760 0x7f85f403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.326+0000 7f860e000640 1 --2- 172.21.15.18:0/3937931296 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85f4038760 0x7f85f403ac20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0098c0 tx=0x7f85fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.330+0000 7f8607400640 1 -- 172.21.15.18:0/3937931296 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f860004d920 con 0x7f86100749e0 2024-09-13T16:42:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:42.514+0000 7f8615800640 1 -- 172.21.15.18:0/3937931296 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi144", "target": ["mon-mgr", ""]}) v1 -- 0x7f8610110140 con 0x7f85f4038760 2024-09-13T16:42:42.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:42 smithi018 ceph-mon[30981]: Updating smithi094:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:42:42.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:42 smithi018 ceph-mon[30981]: Updating smithi094:/var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:42:42.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:42 smithi018 ceph-mon[30981]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:44.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:43 smithi018 ceph-mon[30981]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi144", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:42:45.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:44 smithi018 ceph-mon[30981]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:45.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:44 smithi018 ceph-mon[30981]: Deploying cephadm binary to smithi144 2024-09-13T16:42:45.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.811+0000 7f8607400640 1 -- 172.21.15.18:0/3937931296 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8610110140 con 0x7f85f4038760 2024-09-13T16:42:45.814 INFO:teuthology.orchestra.run.smithi018.stdout:Added host 'smithi144' with addr '172.21.15.144' 2024-09-13T16:42:45.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.814+0000 7f8615800640 1 -- 172.21.15.18:0/3937931296 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85f4038760 msgr2=0x7f85f403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:45.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.814+0000 7f8615800640 1 --2- 172.21.15.18:0/3937931296 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85f4038760 0x7f85f403ac20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0098c0 tx=0x7f85fc006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:45.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.814+0000 7f8615800640 1 -- 172.21.15.18:0/3937931296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100749e0 msgr2=0x7f861019b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:45.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.814+0000 7f8615800640 1 --2- 172.21.15.18:0/3937931296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100749e0 0x7f861019b5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8600009230 tx=0x7f8600004e50 comp rx=0 tx=0).stop 2024-09-13T16:42:45.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.814+0000 7f8615800640 1 -- 172.21.15.18:0/3937931296 shutdown_connections 2024-09-13T16:42:45.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.814+0000 7f8615800640 1 --2- 172.21.15.18:0/3937931296 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85f4038760 0x7f85f403ac20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:45.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.814+0000 7f8615800640 1 --2- 172.21.15.18:0/3937931296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100749e0 0x7f861019b5c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:45.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.814+0000 7f8615800640 1 -- 172.21.15.18:0/3937931296 >> 172.21.15.18:0/3937931296 conn(0x7f86100fd690 msgr2=0x7f861010c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:45.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.814+0000 7f8615800640 1 -- 172.21.15.18:0/3937931296 shutdown_connections 2024-09-13T16:42:45.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:45.814+0000 7f8615800640 1 -- 172.21.15.18:0/3937931296 wait complete. 2024-09-13T16:42:46.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T16:42:46.825 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:42:46.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:46 smithi018 ceph-mon[30981]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:46.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:46 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:46.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:46 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:42:46.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:46 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:46.997 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:46 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:48.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:47 smithi018 ceph-mon[30981]: Added host smithi144 2024-09-13T16:42:48.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:47 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:48.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.715+0000 7fd155000640 1 -- 172.21.15.18:0/1898745075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd150107970 msgr2=0x7fd150107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:48.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.715+0000 7fd155000640 1 --2- 172.21.15.18:0/1898745075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd150107970 0x7fd150107d50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd140009880 tx=0x7fd14002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:42:48.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.715+0000 7fd155000640 1 -- 172.21.15.18:0/1898745075 shutdown_connections 2024-09-13T16:42:48.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.715+0000 7fd155000640 1 --2- 172.21.15.18:0/1898745075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd150107970 0x7fd150107d50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:48.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.715+0000 7fd155000640 1 -- 172.21.15.18:0/1898745075 >> 172.21.15.18:0/1898745075 conn(0x7fd1500fd630 msgr2=0x7fd1500ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:48.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.715+0000 7fd155000640 1 -- 172.21.15.18:0/1898745075 shutdown_connections 2024-09-13T16:42:48.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.715+0000 7fd155000640 1 -- 172.21.15.18:0/1898745075 wait complete. 2024-09-13T16:42:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.716+0000 7fd155000640 1 Processor -- start 2024-09-13T16:42:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.716+0000 7fd155000640 1 -- start start 2024-09-13T16:42:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.717+0000 7fd155000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd150107970 0x7fd1501971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.717+0000 7fd155000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd150197700 con 0x7fd150107970 2024-09-13T16:42:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.717+0000 7fd14de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd150107970 0x7fd1501971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.717+0000 7fd14de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd150107970 0x7fd1501971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54768/0 (socket says 172.21.15.18:54768) 2024-09-13T16:42:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.717+0000 7fd14de00640 1 -- 172.21.15.18:0/3972735202 learned_addr learned my addr 172.21.15.18:0/3972735202 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.717+0000 7fd14de00640 1 -- 172.21.15.18:0/3972735202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140009560 con 0x7fd150107970 2024-09-13T16:42:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.718+0000 7fd14de00640 1 --2- 172.21.15.18:0/3972735202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd150107970 0x7fd1501971c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd140009230 tx=0x7fd140004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.718+0000 7fd146a00640 1 -- 172.21.15.18:0/3972735202 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1400054d0 con 0x7fd150107970 2024-09-13T16:42:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.718+0000 7fd146a00640 1 -- 172.21.15.18:0/3972735202 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd140003ab0 con 0x7fd150107970 2024-09-13T16:42:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.718+0000 7fd146a00640 1 -- 172.21.15.18:0/3972735202 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd14003c940 con 0x7fd150107970 2024-09-13T16:42:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.718+0000 7fd155000640 1 -- 172.21.15.18:0/3972735202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd150197960 con 0x7fd150107970 2024-09-13T16:42:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.718+0000 7fd155000640 1 -- 172.21.15.18:0/3972735202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd150197de0 con 0x7fd150107970 2024-09-13T16:42:48.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.719+0000 7fd146a00640 1 -- 172.21.15.18:0/3972735202 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fd140003c20 con 0x7fd150107970 2024-09-13T16:42:48.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.719+0000 7fd155000640 1 -- 172.21.15.18:0/3972735202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1501030b0 con 0x7fd150107970 2024-09-13T16:42:48.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.720+0000 7fd146a00640 1 --2- 172.21.15.18:0/3972735202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd134038760 0x7fd13403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:48.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.720+0000 7fd146a00640 1 -- 172.21.15.18:0/3972735202 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd14006c420 con 0x7fd150107970 2024-09-13T16:42:48.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.720+0000 7fd147e00640 1 --2- 172.21.15.18:0/3972735202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd134038760 0x7fd13403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:48.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.721+0000 7fd147e00640 1 --2- 172.21.15.18:0/3972735202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd134038760 0x7fd13403ac20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd1380098c0 tx=0x7fd138006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:48.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.725+0000 7fd146a00640 1 -- 172.21.15.18:0/3972735202 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd14004d530 con 0x7fd150107970 2024-09-13T16:42:48.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.910+0000 7fd155000640 1 -- 172.21.15.18:0/3972735202 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd15010bd50 con 0x7fd134038760 2024-09-13T16:42:48.913 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:48 smithi018 ceph-mon[30981]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:48.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.911+0000 7fd146a00640 1 -- 172.21.15.18:0/3972735202 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7fd15010bd50 con 0x7fd134038760 2024-09-13T16:42:48.914 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:42:48.914 INFO:teuthology.orchestra.run.smithi018.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.94", "hostname": "smithi094", "labels": [], "status": ""}, {"addr": "172.21.15.144", "hostname": "smithi144", "labels": [], "status": ""}] 2024-09-13T16:42:48.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.913+0000 7fd155000640 1 -- 172.21.15.18:0/3972735202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd134038760 msgr2=0x7fd13403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:48.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.913+0000 7fd155000640 1 --2- 172.21.15.18:0/3972735202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd134038760 0x7fd13403ac20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd1380098c0 tx=0x7fd138006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:48.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.913+0000 7fd155000640 1 -- 172.21.15.18:0/3972735202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd150107970 msgr2=0x7fd1501971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:48.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.913+0000 7fd155000640 1 --2- 172.21.15.18:0/3972735202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd150107970 0x7fd1501971c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd140009230 tx=0x7fd140004e50 comp rx=0 tx=0).stop 2024-09-13T16:42:48.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.913+0000 7fd155000640 1 -- 172.21.15.18:0/3972735202 shutdown_connections 2024-09-13T16:42:48.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.913+0000 7fd155000640 1 --2- 172.21.15.18:0/3972735202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd134038760 0x7fd13403ac20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:48.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.913+0000 7fd155000640 1 --2- 172.21.15.18:0/3972735202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd150107970 0x7fd1501971c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:48.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.913+0000 7fd155000640 1 -- 172.21.15.18:0/3972735202 >> 172.21.15.18:0/3972735202 conn(0x7fd1500fd630 msgr2=0x7fd1500ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:48.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.913+0000 7fd155000640 1 -- 172.21.15.18:0/3972735202 shutdown_connections 2024-09-13T16:42:48.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:48.913+0000 7fd155000640 1 -- 172.21.15.18:0/3972735202 wait complete. 2024-09-13T16:42:49.606 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T16:42:49.606 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T16:42:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:42:50.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:42:50.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:50.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:50.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:50.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:50.863 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:50.863 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:42:50.863 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:42:50.863 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:42:50.863 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:50.863 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:50.863 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:51.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.779+0000 7f9d39800640 1 -- 172.21.15.18:0/3903682072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d34107790 msgr2=0x7f9d34107b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:51.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.779+0000 7f9d39800640 1 --2- 172.21.15.18:0/3903682072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d34107790 0x7f9d34107b70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009880 tx=0x7f9d2402a5d0 comp rx=0 tx=0).stop 2024-09-13T16:42:51.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.780+0000 7f9d39800640 1 -- 172.21.15.18:0/3903682072 shutdown_connections 2024-09-13T16:42:51.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.780+0000 7f9d39800640 1 --2- 172.21.15.18:0/3903682072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d34107790 0x7f9d34107b70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:51.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.780+0000 7f9d39800640 1 -- 172.21.15.18:0/3903682072 >> 172.21.15.18:0/3903682072 conn(0x7f9d340fd490 msgr2=0x7f9d340ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.780+0000 7f9d39800640 1 -- 172.21.15.18:0/3903682072 shutdown_connections 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.780+0000 7f9d39800640 1 -- 172.21.15.18:0/3903682072 wait complete. 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.781+0000 7f9d39800640 1 Processor -- start 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.781+0000 7f9d39800640 1 -- start start 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.781+0000 7f9d39800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d34107790 0x7f9d34196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.781+0000 7f9d39800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d341974a0 con 0x7f9d34107790 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.781+0000 7f9d33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d34107790 0x7f9d34196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.781+0000 7f9d33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d34107790 0x7f9d34196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58460/0 (socket says 172.21.15.18:58460) 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.781+0000 7f9d33e00640 1 -- 172.21.15.18:0/3159587630 learned_addr learned my addr 172.21.15.18:0/3159587630 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.782+0000 7f9d33e00640 1 -- 172.21.15.18:0/3159587630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d24009560 con 0x7f9d34107790 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.782+0000 7f9d33e00640 1 --2- 172.21.15.18:0/3159587630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d34107790 0x7f9d34196f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009230 tx=0x7f9d24004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:51.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.782+0000 7f9d31600640 1 -- 172.21.15.18:0/3159587630 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d240054d0 con 0x7f9d34107790 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.782+0000 7f9d31600640 1 -- 172.21.15.18:0/3159587630 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d24003ab0 con 0x7f9d34107790 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.782+0000 7f9d39800640 1 -- 172.21.15.18:0/3159587630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d34197700 con 0x7f9d34107790 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.782+0000 7f9d31600640 1 -- 172.21.15.18:0/3159587630 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d2403c940 con 0x7f9d34107790 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.782+0000 7f9d39800640 1 -- 172.21.15.18:0/3159587630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d34197b80 con 0x7f9d34107790 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.783+0000 7f9d31600640 1 -- 172.21.15.18:0/3159587630 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f9d2403cbb0 con 0x7f9d34107790 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.784+0000 7f9d39800640 1 -- 172.21.15.18:0/3159587630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d34102ed0 con 0x7f9d34107790 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.784+0000 7f9d31600640 1 --2- 172.21.15.18:0/3159587630 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9d18038710 0x7f9d1803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.784+0000 7f9d31600640 1 -- 172.21.15.18:0/3159587630 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9d2406c3c0 con 0x7f9d34107790 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.784+0000 7f9d2b400640 1 --2- 172.21.15.18:0/3159587630 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9d18038710 0x7f9d1803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.785+0000 7f9d2b400640 1 --2- 172.21.15.18:0/3159587630 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9d18038710 0x7f9d1803abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0098c0 tx=0x7f9d1c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.789+0000 7f9d31600640 1 -- 172.21.15.18:0/3159587630 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9d2403ace0 con 0x7f9d34107790 2024-09-13T16:42:51.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:51 smithi018 ceph-mon[30981]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-13T16:42:51.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:51 smithi018 ceph-mon[30981]: Updating smithi144:/var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:42:51.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:51 smithi018 ceph-mon[30981]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:42:51.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:51 smithi018 ceph-mon[30981]: Updating smithi144:/var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:42:51.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:51.972+0000 7f9d39800640 1 -- 172.21.15.18:0/3159587630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9d3410bb00 con 0x7f9d34107790 2024-09-13T16:42:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.748+0000 7f9d31600640 1 -- 172.21.15.18:0/3159587630 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9d24035020 con 0x7f9d34107790 2024-09-13T16:42:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-09-13T16:42:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.751+0000 7f9d39800640 1 -- 172.21.15.18:0/3159587630 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9d18038710 msgr2=0x7f9d1803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.751+0000 7f9d39800640 1 --2- 172.21.15.18:0/3159587630 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9d18038710 0x7f9d1803abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0098c0 tx=0x7f9d1c006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.751+0000 7f9d39800640 1 -- 172.21.15.18:0/3159587630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d34107790 msgr2=0x7f9d34196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.751+0000 7f9d39800640 1 --2- 172.21.15.18:0/3159587630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d34107790 0x7f9d34196f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009230 tx=0x7f9d24004e50 comp rx=0 tx=0).stop 2024-09-13T16:42:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.751+0000 7f9d39800640 1 -- 172.21.15.18:0/3159587630 shutdown_connections 2024-09-13T16:42:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.751+0000 7f9d39800640 1 --2- 172.21.15.18:0/3159587630 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9d18038710 0x7f9d1803abd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.751+0000 7f9d39800640 1 --2- 172.21.15.18:0/3159587630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d34107790 0x7f9d34196f60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.751+0000 7f9d39800640 1 -- 172.21.15.18:0/3159587630 >> 172.21.15.18:0/3159587630 conn(0x7f9d340fd490 msgr2=0x7f9d340fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.752+0000 7f9d39800640 1 -- 172.21.15.18:0/3159587630 shutdown_connections 2024-09-13T16:42:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:42:52.752+0000 7f9d39800640 1 -- 172.21.15.18:0/3159587630 wait complete. 2024-09-13T16:42:52.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:52 smithi018 ceph-mon[30981]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:52.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:52 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3159587630' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T16:42:53.482 INFO:tasks.cephadm:Adding mon.a on smithi018 2024-09-13T16:42:53.482 INFO:tasks.cephadm:Adding mon.b on smithi094 2024-09-13T16:42:53.483 INFO:tasks.cephadm:Adding mon.c on smithi144 2024-09-13T16:42:53.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi018:172.21.15.18=a;smithi094:172.21.15.94=b;smithi144:172.21.15.144=c' 2024-09-13T16:42:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:42:54.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:53 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3159587630' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T16:42:54.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:53 smithi018 ceph-mon[30981]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:42:54.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:53 smithi018 ceph-mon[30981]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.265+0000 7fbf3641b640 1 -- 172.21.15.144:0/260747813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30104650 msgr2=0x7fbf30104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.265+0000 7fbf3641b640 1 --2- 172.21.15.144:0/260747813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30104650 0x7fbf30104a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009880 tx=0x7fbf2002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:42:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.265+0000 7fbf3641b640 1 -- 172.21.15.144:0/260747813 shutdown_connections 2024-09-13T16:42:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.265+0000 7fbf3641b640 1 --2- 172.21.15.144:0/260747813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30104650 0x7fbf30104a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.265+0000 7fbf3641b640 1 -- 172.21.15.144:0/260747813 >> 172.21.15.144:0/260747813 conn(0x7fbf30075490 msgr2=0x7fbf300fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.265+0000 7fbf3641b640 1 -- 172.21.15.144:0/260747813 shutdown_connections 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.265+0000 7fbf3641b640 1 -- 172.21.15.144:0/260747813 wait complete. 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.265+0000 7fbf3641b640 1 Processor -- start 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.266+0000 7fbf3641b640 1 -- start start 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.266+0000 7fbf3641b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30104650 0x7fbf30197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.266+0000 7fbf3641b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30197750 con 0x7fbf30104650 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.266+0000 7fbf2ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30104650 0x7fbf30197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.266+0000 7fbf2ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30104650 0x7fbf30197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:38948/0 (socket says 172.21.15.144:38948) 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.266+0000 7fbf2ffff640 1 -- 172.21.15.144:0/1021104129 learned_addr learned my addr 172.21.15.144:0/1021104129 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.266+0000 7fbf2ffff640 1 -- 172.21.15.144:0/1021104129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf20009560 con 0x7fbf30104650 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.267+0000 7fbf2ffff640 1 --2- 172.21.15.144:0/1021104129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30104650 0x7fbf30197210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009230 tx=0x7fbf20004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.267+0000 7fbf2dffb640 1 -- 172.21.15.144:0/1021104129 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf200053c0 con 0x7fbf30104650 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.267+0000 7fbf2dffb640 1 -- 172.21.15.144:0/1021104129 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf20005520 con 0x7fbf30104650 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.267+0000 7fbf3641b640 1 -- 172.21.15.144:0/1021104129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf301979b0 con 0x7fbf30104650 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.267+0000 7fbf2dffb640 1 -- 172.21.15.144:0/1021104129 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf2003c830 con 0x7fbf30104650 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.267+0000 7fbf3641b640 1 -- 172.21.15.144:0/1021104129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf30197e30 con 0x7fbf30104650 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.268+0000 7fbf2dffb640 1 -- 172.21.15.144:0/1021104129 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fbf200035f0 con 0x7fbf30104650 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.268+0000 7fbf3641b640 1 -- 172.21.15.144:0/1021104129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf30067850 con 0x7fbf30104650 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.268+0000 7fbf2dffb640 1 --2- 172.21.15.144:0/1021104129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf1c038760 0x7fbf1c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.268+0000 7fbf2dffb640 1 -- 172.21.15.144:0/1021104129 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbf2006c490 con 0x7fbf30104650 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.268+0000 7fbf27fff640 1 --2- 172.21.15.144:0/1021104129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf1c038760 0x7fbf1c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.269+0000 7fbf27fff640 1 --2- 172.21.15.144:0/1021104129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf1c038760 0x7fbf1c03ac20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbf180098c0 tx=0x7fbf18006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.273+0000 7fbf2dffb640 1 -- 172.21.15.144:0/1021104129 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbf20003cc0 con 0x7fbf30104650 2024-09-13T16:42:55.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.445+0000 7fbf3641b640 1 -- 172.21.15.144:0/1021104129 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi094:172.21.15.94=b;smithi144:172.21.15.144=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf30108b90 con 0x7fbf1c038760 2024-09-13T16:42:55.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.452+0000 7fbf2dffb640 1 -- 172.21.15.144:0/1021104129 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fbf30108b90 con 0x7fbf1c038760 2024-09-13T16:42:55.453 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mon update... 2024-09-13T16:42:55.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.454+0000 7fbf3641b640 1 -- 172.21.15.144:0/1021104129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf1c038760 msgr2=0x7fbf1c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:55.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.454+0000 7fbf3641b640 1 --2- 172.21.15.144:0/1021104129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf1c038760 0x7fbf1c03ac20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbf180098c0 tx=0x7fbf18006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:55.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.454+0000 7fbf3641b640 1 -- 172.21.15.144:0/1021104129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30104650 msgr2=0x7fbf30197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:55.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.454+0000 7fbf3641b640 1 --2- 172.21.15.144:0/1021104129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30104650 0x7fbf30197210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009230 tx=0x7fbf20004e10 comp rx=0 tx=0).stop 2024-09-13T16:42:55.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.454+0000 7fbf3641b640 1 -- 172.21.15.144:0/1021104129 shutdown_connections 2024-09-13T16:42:55.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.454+0000 7fbf3641b640 1 --2- 172.21.15.144:0/1021104129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf1c038760 0x7fbf1c03ac20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:55.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.454+0000 7fbf3641b640 1 --2- 172.21.15.144:0/1021104129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30104650 0x7fbf30197210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:55.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.454+0000 7fbf3641b640 1 -- 172.21.15.144:0/1021104129 >> 172.21.15.144:0/1021104129 conn(0x7fbf30075490 msgr2=0x7fbf301031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:55.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.454+0000 7fbf3641b640 1 -- 172.21.15.144:0/1021104129 shutdown_connections 2024-09-13T16:42:55.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:55.454+0000 7fbf3641b640 1 -- 172.21.15.144:0/1021104129 wait complete. 2024-09-13T16:42:56.033 DEBUG:teuthology.orchestra.run.smithi094:mon.b> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.b.service 2024-09-13T16:42:56.036 DEBUG:teuthology.orchestra.run.smithi144:mon.c> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.c.service 2024-09-13T16:42:56.038 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T16:42:56.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:42:56.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi094:172.21.15.94=b;smithi144:172.21.15.144=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:42:56.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: Saving service mon spec with placement smithi018:172.21.15.18=a;smithi094:172.21.15.94=b;smithi144:172.21.15.144=c;count:3 2024-09-13T16:42:56.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:56.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:42:56.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:42:56.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:42:56.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:42:56.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:42:56.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:42:56.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: Deploying daemon mon.c on smithi144 2024-09-13T16:42:56.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:56 smithi018 ceph-mon[30981]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:42:56.793 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:42:58.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.624+0000 7f5b537eb640 1 -- 172.21.15.144:0/3188169278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b4c0fe070 msgr2=0x7f5b4c0fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:58.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.624+0000 7f5b537eb640 1 --2- 172.21.15.144:0/3188169278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b4c0fe070 0x7f5b4c0fe450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009880 tx=0x7f5b4002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:42:58.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.624+0000 7f5b537eb640 1 -- 172.21.15.144:0/3188169278 shutdown_connections 2024-09-13T16:42:58.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.624+0000 7f5b537eb640 1 --2- 172.21.15.144:0/3188169278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b4c0fe070 0x7f5b4c0fe450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:58.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.624+0000 7f5b537eb640 1 -- 172.21.15.144:0/3188169278 >> 172.21.15.144:0/3188169278 conn(0x7f5b4c0f9b10 msgr2=0x7f5b4c0fbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:58.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.625+0000 7f5b537eb640 1 -- 172.21.15.144:0/3188169278 shutdown_connections 2024-09-13T16:42:58.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.625+0000 7f5b537eb640 1 -- 172.21.15.144:0/3188169278 wait complete. 2024-09-13T16:42:58.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.625+0000 7f5b537eb640 1 Processor -- start 2024-09-13T16:42:58.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.625+0000 7f5b537eb640 1 -- start start 2024-09-13T16:42:58.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.626+0000 7f5b537eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b4c0fe070 0x7f5b4c193ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:58.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.626+0000 7f5b537eb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c194430 con 0x7f5b4c0fe070 2024-09-13T16:42:58.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.626+0000 7f5b51587640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b4c0fe070 0x7f5b4c193ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:58.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.626+0000 7f5b51587640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b4c0fe070 0x7f5b4c193ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:38968/0 (socket says 172.21.15.144:38968) 2024-09-13T16:42:58.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.626+0000 7f5b51587640 1 -- 172.21.15.144:0/1058870867 learned_addr learned my addr 172.21.15.144:0/1058870867 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:42:58.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.626+0000 7f5b51587640 1 -- 172.21.15.144:0/1058870867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40009560 con 0x7f5b4c0fe070 2024-09-13T16:42:58.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.627+0000 7f5b51587640 1 --2- 172.21.15.144:0/1058870867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b4c0fe070 0x7f5b4c193ef0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009230 tx=0x7f5b40004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:58.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.627+0000 7f5b3e7fc640 1 -- 172.21.15.144:0/1058870867 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b400053c0 con 0x7f5b4c0fe070 2024-09-13T16:42:58.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.627+0000 7f5b537eb640 1 -- 172.21.15.144:0/1058870867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c194630 con 0x7f5b4c0fe070 2024-09-13T16:42:58.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.627+0000 7f5b3e7fc640 1 -- 172.21.15.144:0/1058870867 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b40005520 con 0x7f5b4c0fe070 2024-09-13T16:42:58.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.627+0000 7f5b3e7fc640 1 -- 172.21.15.144:0/1058870867 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b4003c890 con 0x7f5b4c0fe070 2024-09-13T16:42:58.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.627+0000 7f5b537eb640 1 -- 172.21.15.144:0/1058870867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c194a50 con 0x7f5b4c0fe070 2024-09-13T16:42:58.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.628+0000 7f5b537eb640 1 -- 172.21.15.144:0/1058870867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c0fc120 con 0x7f5b4c0fe070 2024-09-13T16:42:58.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.628+0000 7f5b3e7fc640 1 -- 172.21.15.144:0/1058870867 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f5b400035f0 con 0x7f5b4c0fe070 2024-09-13T16:42:58.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.628+0000 7f5b3e7fc640 1 --2- 172.21.15.144:0/1058870867 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b38038710 0x7f5b3803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:42:58.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.628+0000 7f5b3e7fc640 1 -- 172.21.15.144:0/1058870867 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5b4006c510 con 0x7f5b4c0fe070 2024-09-13T16:42:58.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.628+0000 7f5b50d86640 1 --2- 172.21.15.144:0/1058870867 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b38038710 0x7f5b3803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:42:58.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.629+0000 7f5b50d86640 1 --2- 172.21.15.144:0/1058870867 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b38038710 0x7f5b3803abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b480098c0 tx=0x7f5b48006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:42:58.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.634+0000 7f5b3e7fc640 1 -- 172.21.15.144:0/1058870867 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5b40003cc0 con 0x7f5b4c0fe070 2024-09-13T16:42:58.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.869+0000 7f5b537eb640 1 -- 172.21.15.144:0/1058870867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5b4c0ff550 con 0x7f5b4c0fe070 2024-09-13T16:42:58.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.870+0000 7f5b3e7fc640 1 -- 172.21.15.144:0/1058870867 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f5b40035070 con 0x7f5b4c0fe070 2024-09-13T16:42:58.871 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:42:58.871 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":1,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","modified":"2024-09-13T16:41:14.933341Z","created":"2024-09-13T16:41:14.933341Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:42:58.871 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 1 2024-09-13T16:42:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.872+0000 7f5b537eb640 1 -- 172.21.15.144:0/1058870867 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b38038710 msgr2=0x7f5b3803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.872+0000 7f5b537eb640 1 --2- 172.21.15.144:0/1058870867 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b38038710 0x7f5b3803abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b480098c0 tx=0x7f5b48006db0 comp rx=0 tx=0).stop 2024-09-13T16:42:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.872+0000 7f5b537eb640 1 -- 172.21.15.144:0/1058870867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b4c0fe070 msgr2=0x7f5b4c193ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:42:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.872+0000 7f5b537eb640 1 --2- 172.21.15.144:0/1058870867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b4c0fe070 0x7f5b4c193ef0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009230 tx=0x7f5b40004e10 comp rx=0 tx=0).stop 2024-09-13T16:42:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.872+0000 7f5b537eb640 1 -- 172.21.15.144:0/1058870867 shutdown_connections 2024-09-13T16:42:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.872+0000 7f5b537eb640 1 --2- 172.21.15.144:0/1058870867 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b38038710 0x7f5b3803abd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.872+0000 7f5b537eb640 1 --2- 172.21.15.144:0/1058870867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b4c0fe070 0x7f5b4c193ef0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:42:58.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.872+0000 7f5b537eb640 1 -- 172.21.15.144:0/1058870867 >> 172.21.15.144:0/1058870867 conn(0x7f5b4c0f9b10 msgr2=0x7f5b4c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:42:58.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.872+0000 7f5b537eb640 1 -- 172.21.15.144:0/1058870867 shutdown_connections 2024-09-13T16:42:58.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:42:58.872+0000 7f5b537eb640 1 -- 172.21.15.144:0/1058870867 wait complete. 2024-09-13T16:42:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:58 smithi018 ceph-mon[30981]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:00.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:42:59 smithi018 ceph-mon[30981]: from='client.? 172.21.15.144:0/1058870867' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:43:01.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:00 smithi018 ceph-mon[30981]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:01.402 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T16:43:01.402 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:43:01.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:01 smithi144 systemd[1]: Started Ceph mon.c for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:43:01.600 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:43:06.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.270+0000 7f209bbfa640 1 -- 172.21.15.144:0/3734494737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2080003530 msgr2=0x7f20800059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:06.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.270+0000 7f209bbfa640 1 --2- 172.21.15.144:0/3734494737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2080003530 0x7f20800059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2094068060 tx=0x7f209002c150 comp rx=0 tx=0).stop 2024-09-13T16:43:06.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.270+0000 7f209bbfa640 1 -- 172.21.15.144:0/3734494737 shutdown_connections 2024-09-13T16:43:06.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.270+0000 7f209bbfa640 1 --2- 172.21.15.144:0/3734494737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2080003530 0x7f20800059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:06.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.270+0000 7f209bbfa640 1 -- 172.21.15.144:0/3734494737 >> 172.21.15.144:0/3734494737 conn(0x7f20940f9c20 msgr2=0x7f20940fc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:06.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.270+0000 7f209bbfa640 1 -- 172.21.15.144:0/3734494737 shutdown_connections 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.270+0000 7f209bbfa640 1 -- 172.21.15.144:0/3734494737 wait complete. 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.271+0000 7f209bbfa640 1 Processor -- start 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.271+0000 7f209bbfa640 1 -- start start 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f209bbfa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2080003530 0x7f2094195150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f209bbfa640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2094195690 0x7f2094199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f209bbfa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094195c00 con 0x7f2080003530 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f209bbfa640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094195d70 con 0x7f2094195690 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099996640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2080003530 0x7f2094195150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099195640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2094195690 0x7f2094199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099996640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2080003530 0x7f2094195150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34456/0 (socket says 172.21.15.144:34456) 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099996640 1 -- 172.21.15.144:0/65941722 learned_addr learned my addr 172.21.15.144:0/65941722 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:43:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099195640 1 -- 172.21.15.144:0/65941722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2094195690 msgr2=0x7f2094199a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099195640 1 -- 172.21.15.144:0/65941722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2094195690 msgr2=0x7f2094199a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099195640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2094195690 0x7f2094199a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099195640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2094195690 0x7f2094199a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099996640 1 -- 172.21.15.144:0/65941722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2094195690 msgr2=0x7f2094199a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099996640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2094195690 0x7f2094199a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.272+0000 7f2099996640 1 -- 172.21.15.144:0/65941722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2090013900 con 0x7f2080003530 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.273+0000 7f2099996640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2080003530 0x7f2094195150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f209002c740 tx=0x7f2090004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.273+0000 7f208affd640 1 -- 172.21.15.144:0/65941722 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f20900051c0 con 0x7f2080003530 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.273+0000 7f209bbfa640 1 -- 172.21.15.144:0/65941722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2094199fd0 con 0x7f2080003530 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.273+0000 7f208affd640 1 -- 172.21.15.144:0/65941722 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2090005320 con 0x7f2080003530 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.273+0000 7f208affd640 1 -- 172.21.15.144:0/65941722 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2090036610 con 0x7f2080003530 2024-09-13T16:43:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.273+0000 7f209bbfa640 1 -- 172.21.15.144:0/65941722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209419a520 con 0x7f2080003530 2024-09-13T16:43:06.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.274+0000 7f208affd640 1 -- 172.21.15.144:0/65941722 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f209003e070 con 0x7f2080003530 2024-09-13T16:43:06.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.274+0000 7f209bbfa640 1 -- 172.21.15.144:0/65941722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20940fd470 con 0x7f2080003530 2024-09-13T16:43:06.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.274+0000 7f208affd640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f20780384f0 0x7f207803a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:06.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.274+0000 7f208affd640 1 -- 172.21.15.144:0/65941722 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2090000e40 con 0x7f2080003530 2024-09-13T16:43:06.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.274+0000 7f2099195640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f20780384f0 0x7f207803a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:06.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.275+0000 7f2099195640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f20780384f0 0x7f207803a9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2084006fd0 tx=0x7f2084008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:06.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.280+0000 7f208affd640 1 -- 172.21.15.144:0/65941722 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2090005490 con 0x7f2080003530 2024-09-13T16:43:06.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.503+0000 7f209bbfa640 1 -- 172.21.15.144:0/65941722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f20941010d0 con 0x7f2080003530 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: mon.a calling monitor election 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: mon.c calling monitor election 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:06.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: monmap e2: 2 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],c=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: fsmap 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: mgrmap e13: x(active, since 54s) 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: overall HEALTH_OK 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:06.506 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:06.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.504+0000 7f208affd640 1 -- 172.21.15.144:0/65941722 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f2090048b10 con 0x7f2080003530 2024-09-13T16:43:06.507 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:43:06.507 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":2,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","modified":"2024-09-13T16:43:01.186308Z","created":"2024-09-13T16:41:14.933341Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 2 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 -- 172.21.15.144:0/65941722 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f20780384f0 msgr2=0x7f207803a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f20780384f0 0x7f207803a9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2084006fd0 tx=0x7f2084008040 comp rx=0 tx=0).stop 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 -- 172.21.15.144:0/65941722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2080003530 msgr2=0x7f2094195150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2080003530 0x7f2094195150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f209002c740 tx=0x7f2090004cb0 comp rx=0 tx=0).stop 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 -- 172.21.15.144:0/65941722 shutdown_connections 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2094195690 0x7f2094199a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f20780384f0 0x7f207803a9b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 --2- 172.21.15.144:0/65941722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2080003530 0x7f2094195150 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 -- 172.21.15.144:0/65941722 >> 172.21.15.144:0/65941722 conn(0x7f20940f9c20 msgr2=0x7f20940fafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 -- 172.21.15.144:0/65941722 shutdown_connections 2024-09-13T16:43:06.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:06.506+0000 7f209bbfa640 1 -- 172.21.15.144:0/65941722 wait complete. 2024-09-13T16:43:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:43:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: mon.a calling monitor election 2024-09-13T16:43:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: mon.c calling monitor election 2024-09-13T16:43:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:06.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:06.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:06.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T16:43:06.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: monmap e2: 2 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],c=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:43:06.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: fsmap 2024-09-13T16:43:06.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:43:06.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: mgrmap e13: x(active, since 54s) 2024-09-13T16:43:06.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: overall HEALTH_OK 2024-09-13T16:43:06.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:06.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:06.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:06.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:06.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:07.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:07 smithi144 ceph-mon[35328]: Deploying daemon mon.b on smithi094 2024-09-13T16:43:07.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:07 smithi144 ceph-mon[35328]: from='client.? 172.21.15.144:0/65941722' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:43:07.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:07 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:07.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:07 smithi018 ceph-mon[30981]: Deploying daemon mon.b on smithi094 2024-09-13T16:43:07.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:07 smithi018 ceph-mon[30981]: from='client.? 172.21.15.144:0/65941722' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:43:07.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:07 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:08.068 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T16:43:08.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:43:08.273 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:43:08.393 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:08 smithi144 ceph-mon[35328]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:08.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:08 smithi018 ceph-mon[30981]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:08.460 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:43:08 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:43:08.186+0000 7f3517a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T16:43:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.721+0000 7f7bb47f6640 1 -- 172.21.15.144:0/2471181585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bac104780 msgr2=0x7f7bac104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.721+0000 7f7bb47f6640 1 --2- 172.21.15.144:0/2471181585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bac104780 0x7f7bac104b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8009880 tx=0x7f7ba802a5d0 comp rx=0 tx=0).stop 2024-09-13T16:43:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.721+0000 7f7bb47f6640 1 -- 172.21.15.144:0/2471181585 shutdown_connections 2024-09-13T16:43:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.721+0000 7f7bb47f6640 1 --2- 172.21.15.144:0/2471181585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bac104780 0x7f7bac104b60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.721+0000 7f7bb47f6640 1 -- 172.21.15.144:0/2471181585 >> 172.21.15.144:0/2471181585 conn(0x7f7bac0fa440 msgr2=0x7f7bac0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.721+0000 7f7bb47f6640 1 -- 172.21.15.144:0/2471181585 shutdown_connections 2024-09-13T16:43:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.721+0000 7f7bb47f6640 1 -- 172.21.15.144:0/2471181585 wait complete. 2024-09-13T16:43:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.721+0000 7f7bb47f6640 1 Processor -- start 2024-09-13T16:43:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.721+0000 7f7bb47f6640 1 -- start start 2024-09-13T16:43:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb47f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bac104780 0x7f7bac195220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb47f6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bac195760 0x7f7bac199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb47f6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac195cd0 con 0x7f7bac104780 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb47f6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac195e40 con 0x7f7bac195760 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb1d91640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bac195760 0x7f7bac199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb1d91640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bac195760 0x7f7bac199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53466/0 (socket says 172.21.15.144:53466) 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb1d91640 1 -- 172.21.15.144:0/1436868483 learned_addr learned my addr 172.21.15.144:0/1436868483 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb1d91640 1 -- 172.21.15.144:0/1436868483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bac195760 msgr2=0x7f7bac199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb1d91640 1 -- 172.21.15.144:0/1436868483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bac195760 msgr2=0x7f7bac199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb1d91640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bac195760 0x7f7bac199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb1d91640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bac195760 0x7f7bac199b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.722+0000 7f7bb2592640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bac104780 0x7f7bac195220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.723+0000 7f7bb2592640 1 -- 172.21.15.144:0/1436868483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bac195760 msgr2=0x7f7bac199b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.723+0000 7f7bb2592640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bac195760 0x7f7bac199b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.723+0000 7f7bb2592640 1 -- 172.21.15.144:0/1436868483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba8009560 con 0x7f7bac104780 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.723+0000 7f7bb2592640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bac104780 0x7f7bac195220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8006010 tx=0x7f7ba8004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.723+0000 7f7ba37fe640 1 -- 172.21.15.144:0/1436868483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f7ba8005320 con 0x7f7bac104780 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.723+0000 7f7bb47f6640 1 -- 172.21.15.144:0/1436868483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac19a0a0 con 0x7f7bac104780 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.723+0000 7f7ba37fe640 1 -- 172.21.15.144:0/1436868483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ba8005480 con 0x7f7bac104780 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.723+0000 7f7ba37fe640 1 -- 172.21.15.144:0/1436868483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f7ba803b5e0 con 0x7f7bac104780 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.723+0000 7f7bb47f6640 1 -- 172.21.15.144:0/1436868483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac19a5f0 con 0x7f7bac104780 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.724+0000 7f7bb47f6640 1 -- 172.21.15.144:0/1436868483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac0ffec0 con 0x7f7bac104780 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.724+0000 7f7ba37fe640 1 -- 172.21.15.144:0/1436868483 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f7ba80035f0 con 0x7f7bac104780 2024-09-13T16:43:09.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.724+0000 7f7ba37fe640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b980384f0 0x7f7b9803a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.725+0000 7f7ba37fe640 1 -- 172.21.15.144:0/1436868483 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7ba806bfd0 con 0x7f7bac104780 2024-09-13T16:43:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.725+0000 7f7bb1d91640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b980384f0 0x7f7b9803a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.725+0000 7f7bb1d91640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b980384f0 0x7f7b9803a9b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009100 tx=0x7f7b9c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:09.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.730+0000 7f7ba37fe640 1 -- 172.21.15.144:0/1436868483 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7ba803aa10 con 0x7f7bac104780 2024-09-13T16:43:09.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.954+0000 7f7bb47f6640 1 -- 172.21.15.144:0/1436868483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7bac19a990 con 0x7f7bac104780 2024-09-13T16:43:09.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.955+0000 7f7ba37fe640 1 -- 172.21.15.144:0/1436868483 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f7ba803a3c0 con 0x7f7bac104780 2024-09-13T16:43:09.957 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:43:09.957 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":2,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","modified":"2024-09-13T16:43:01.186308Z","created":"2024-09-13T16:41:14.933341Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T16:43:09.957 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 2 2024-09-13T16:43:09.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 -- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b980384f0 msgr2=0x7f7b9803a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:09.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b980384f0 0x7f7b9803a9b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009100 tx=0x7f7b9c008040 comp rx=0 tx=0).stop 2024-09-13T16:43:09.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 -- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bac104780 msgr2=0x7f7bac195220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:09.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bac104780 0x7f7bac195220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8006010 tx=0x7f7ba8004c60 comp rx=0 tx=0).stop 2024-09-13T16:43:09.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 -- 172.21.15.144:0/1436868483 shutdown_connections 2024-09-13T16:43:09.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bac195760 0x7f7bac199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:09.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b980384f0 0x7f7b9803a9b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 --2- 172.21.15.144:0/1436868483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bac104780 0x7f7bac195220 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 -- 172.21.15.144:0/1436868483 >> 172.21.15.144:0/1436868483 conn(0x7f7bac0fa440 msgr2=0x7f7bac102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 -- 172.21.15.144:0/1436868483 shutdown_connections 2024-09-13T16:43:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:09.957+0000 7f7bb47f6640 1 -- 172.21.15.144:0/1436868483 wait complete. 2024-09-13T16:43:11.468 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T16:43:11.469 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:43:11.670 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:43:15.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:43:15.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: mon.c calling monitor election 2024-09-13T16:43:15.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: mon.a calling monitor election 2024-09-13T16:43:15.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:15.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:15.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:15.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T16:43:15.463 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: monmap e3: 3 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],b=[v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0],c=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:43:15.463 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: fsmap 2024-09-13T16:43:15.463 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:43:15.463 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: mgrmap e13: x(active, since 63s) 2024-09-13T16:43:15.463 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T16:43:15.464 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T16:43:15.464 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T16:43:15.464 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: mon.b (rank 2) addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] is down (out of quorum) 2024-09-13T16:43:15.464 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:15.464 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:15.464 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:15.465 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:15.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:43:15.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: mon.c calling monitor election 2024-09-13T16:43:15.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: mon.a calling monitor election 2024-09-13T16:43:15.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:43:15.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:15.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: monmap e3: 3 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],b=[v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0],c=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: fsmap 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: mgrmap e13: x(active, since 63s) 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T16:43:15.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: mon.b (rank 2) addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] is down (out of quorum) 2024-09-13T16:43:15.524 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:15.524 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:15.524 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:15.524 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:16.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.141+0000 7f65a67a4640 1 -- 172.21.15.144:0/126366499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65a0104780 msgr2=0x7f6588005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.141+0000 7f65a67a4640 1 --2- 172.21.15.144:0/126366499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65a0104780 0x7f6588005580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6590011c50 tx=0x7f659002be50 comp rx=0 tx=0).stop 2024-09-13T16:43:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.141+0000 7f65a67a4640 1 -- 172.21.15.144:0/126366499 shutdown_connections 2024-09-13T16:43:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.141+0000 7f65a67a4640 1 --2- 172.21.15.144:0/126366499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65a0104780 0x7f6588005580 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.141+0000 7f65a67a4640 1 -- 172.21.15.144:0/126366499 >> 172.21.15.144:0/126366499 conn(0x7f65a00fa440 msgr2=0x7f65a00fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.142+0000 7f65a67a4640 1 -- 172.21.15.144:0/126366499 shutdown_connections 2024-09-13T16:43:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.142+0000 7f65a67a4640 1 -- 172.21.15.144:0/126366499 wait complete. 2024-09-13T16:43:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.142+0000 7f65a67a4640 1 Processor -- start 2024-09-13T16:43:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.142+0000 7f65a67a4640 1 -- start start 2024-09-13T16:43:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f65a67a4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65a0104780 0x7f65a0100350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f65a67a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65a0100890 0x7f65a0100cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f65a67a4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65a01a1410 0x7f65a01a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f65a67a4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a01a3dd0 con 0x7f65a0100890 2024-09-13T16:43:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f65a67a4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a01a3f10 con 0x7f65a01a1410 2024-09-13T16:43:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f65a67a4640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a01a40d0 con 0x7f65a0104780 2024-09-13T16:43:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65a0104780 0x7f65a0100350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65a0104780 0x7f65a0100350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47906/0 (socket says 172.21.15.144:47906) 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659ffff640 1 -- 172.21.15.144:0/791743201 learned_addr learned my addr 172.21.15.144:0/791743201 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659ffff640 1 -- 172.21.15.144:0/791743201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65a0104780 msgr2=0x7f65a0100350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659f7fe640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65a0100890 0x7f65a0100cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659ffff640 1 -- 172.21.15.144:0/791743201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65a0104780 msgr2=0x7f65a0100350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659ffff640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65a0104780 0x7f65a0100350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659ffff640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65a0104780 0x7f65a0100350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f65a4d41640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65a01a1410 0x7f65a01a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659f7fe640 1 -- 172.21.15.144:0/791743201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65a0104780 msgr2=0x7f65a0100350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659f7fe640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65a0104780 0x7f65a0100350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659f7fe640 1 -- 172.21.15.144:0/791743201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65a01a1410 msgr2=0x7f65a01a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:16.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659f7fe640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65a01a1410 0x7f65a01a3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659f7fe640 1 -- 172.21.15.144:0/791743201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590011930 con 0x7f65a0100890 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.143+0000 7f659f7fe640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65a0100890 0x7f65a0100cf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f659400b450 tx=0x7f659400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.144+0000 7f659d7fa640 1 -- 172.21.15.144:0/791743201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594004230 con 0x7f65a0100890 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.144+0000 7f659d7fa640 1 -- 172.21.15.144:0/791743201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6594004390 con 0x7f65a0100890 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.144+0000 7f65a67a4640 1 -- 172.21.15.144:0/791743201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a01a43b0 con 0x7f65a0100890 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.144+0000 7f659d7fa640 1 -- 172.21.15.144:0/791743201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594003b80 con 0x7f65a0100890 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.144+0000 7f65a67a4640 1 -- 172.21.15.144:0/791743201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a01a48b0 con 0x7f65a0100890 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.145+0000 7f65a67a4640 1 -- 172.21.15.144:0/791743201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a00ffec0 con 0x7f65a0100890 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.145+0000 7f659d7fa640 1 -- 172.21.15.144:0/791743201 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f6594003d00 con 0x7f65a0100890 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.145+0000 7f659d7fa640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f658c038be0 0x7f658c03b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.145+0000 7f659d7fa640 1 -- 172.21.15.144:0/791743201 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f659404b0f0 con 0x7f65a0100890 2024-09-13T16:43:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.145+0000 7f659ffff640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f658c038be0 0x7f658c03b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:16.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.146+0000 7f659ffff640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f658c038be0 0x7f658c03b0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6590005f50 tx=0x7f6590005bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:16.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.151+0000 7f659d7fa640 1 -- 172.21.15.144:0/791743201 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f659401a400 con 0x7f65a0100890 2024-09-13T16:43:16.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.390+0000 7f65a67a4640 1 -- 172.21.15.144:0/791743201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f65a0106600 con 0x7f65a0100890 2024-09-13T16:43:16.393 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:16 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:16.393 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:16 smithi144 ceph-mon[35328]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:16.393 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:16 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:16.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.391+0000 7f659d7fa640 1 -- 172.21.15.144:0/791743201 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1270 (secure 0 0 0) 0x7f659400f340 con 0x7f65a0100890 2024-09-13T16:43:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T16:43:16.393 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":3,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","modified":"2024-09-13T16:43:09.960877Z","created":"2024-09-13T16:41:14.933341Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T16:43:16.394 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 3 2024-09-13T16:43:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 -- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f658c038be0 msgr2=0x7f658c03b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f658c038be0 0x7f658c03b0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6590005f50 tx=0x7f6590005bc0 comp rx=0 tx=0).stop 2024-09-13T16:43:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 -- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65a0100890 msgr2=0x7f65a0100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65a0100890 0x7f65a0100cf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f659400b450 tx=0x7f659400b910 comp rx=0 tx=0).stop 2024-09-13T16:43:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 -- 172.21.15.144:0/791743201 shutdown_connections 2024-09-13T16:43:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f658c038be0 0x7f658c03b0a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65a0100890 0x7f65a0100cf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65a01a1410 0x7f65a01a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 --2- 172.21.15.144:0/791743201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65a0104780 0x7f65a0100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 -- 172.21.15.144:0/791743201 >> 172.21.15.144:0/791743201 conn(0x7f65a00fa440 msgr2=0x7f65a0103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 -- 172.21.15.144:0/791743201 shutdown_connections 2024-09-13T16:43:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:16.394+0000 7f65a67a4640 1 -- 172.21.15.144:0/791743201 wait complete. 2024-09-13T16:43:16.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:16 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:16.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:16 smithi018 ceph-mon[30981]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:16.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:16 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:17.042 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T16:43:17.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T16:43:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:43:17.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:16 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:17.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: mon.b calling monitor election 2024-09-13T16:43:17.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: mon.b calling monitor election 2024-09-13T16:43:17.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: mon.c calling monitor election 2024-09-13T16:43:17.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: mon.a calling monitor election 2024-09-13T16:43:17.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T16:43:17.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: monmap e3: 3 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],b=[v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0],c=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:43:17.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: fsmap 2024-09-13T16:43:17.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: mgrmap e13: x(active, since 65s) 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: Cluster is now healthy 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: overall HEALTH_OK 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:43:17.767 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: mon.b calling monitor election 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: mon.b calling monitor election 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: mon.c calling monitor election 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: mon.a calling monitor election 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: monmap e3: 3 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],b=[v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0],c=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: fsmap 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: mgrmap e13: x(active, since 65s) 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: Cluster is now healthy 2024-09-13T16:43:18.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: overall HEALTH_OK 2024-09-13T16:43:18.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:18.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:43:18.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: mon.b calling monitor election 2024-09-13T16:43:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: mon.b calling monitor election 2024-09-13T16:43:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: mon.c calling monitor election 2024-09-13T16:43:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: mon.a calling monitor election 2024-09-13T16:43:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T16:43:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: monmap e3: 3 mons at {a=[v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0],b=[v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0],c=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:43:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: fsmap 2024-09-13T16:43:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:43:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: mgrmap e13: x(active, since 65s) 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: Cluster is now healthy 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: overall HEALTH_OK 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:43:18.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:18.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:18 smithi018 ceph-mon[30981]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T16:43:18.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:18 smithi018 ceph-mon[30981]: Reconfiguring daemon mon.a on smithi018 2024-09-13T16:43:18.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:18 smithi018 ceph-mon[30981]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:18.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:18 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:19.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:18 smithi144 ceph-mon[35328]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T16:43:19.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:18 smithi144 ceph-mon[35328]: Reconfiguring daemon mon.a on smithi018 2024-09-13T16:43:19.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:18 smithi144 ceph-mon[35328]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:19.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:18 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:19.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:18 smithi094 ceph-mon[35259]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T16:43:19.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:18 smithi094 ceph-mon[35259]: Reconfiguring daemon mon.a on smithi018 2024-09-13T16:43:19.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:18 smithi094 ceph-mon[35259]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:19.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:18 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:43:19.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.974+0000 7fafd8000640 1 -- 172.21.15.18:0/1416250714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd00742e0 msgr2=0x7fafd00726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:19.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.974+0000 7fafd8000640 1 --2- 172.21.15.18:0/1416250714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd00742e0 0x7fafd00726e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009880 tx=0x7fafc402a5d0 comp rx=0 tx=0).stop 2024-09-13T16:43:19.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.974+0000 7fafd8000640 1 -- 172.21.15.18:0/1416250714 shutdown_connections 2024-09-13T16:43:19.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.974+0000 7fafd8000640 1 --2- 172.21.15.18:0/1416250714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd00742e0 0x7fafd00726e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:19.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.974+0000 7fafd8000640 1 -- 172.21.15.18:0/1416250714 >> 172.21.15.18:0/1416250714 conn(0x7fafd0076510 msgr2=0x7fafd0076920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:19.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.974+0000 7fafd8000640 1 -- 172.21.15.18:0/1416250714 shutdown_connections 2024-09-13T16:43:19.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.974+0000 7fafd8000640 1 -- 172.21.15.18:0/1416250714 wait complete. 2024-09-13T16:43:19.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.975+0000 7fafd8000640 1 Processor -- start 2024-09-13T16:43:19.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.976+0000 7fafd8000640 1 -- start start 2024-09-13T16:43:19.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.976+0000 7fafd8000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00742e0 0x7fafd01a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:19.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.976+0000 7fafd8000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafd01a1b10 0x7fafd019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.976+0000 7fafd8000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd019bc00 0x7fafd019c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.976+0000 7fafd8000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd01a2140 con 0x7fafd019bc00 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.976+0000 7fafd8000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd01a83f0 con 0x7fafd01a1b10 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.976+0000 7fafd8000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd01a8530 con 0x7fafd00742e0 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd019bc00 0x7fafd019c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd019bc00 0x7fafd019c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50006/0 (socket says 172.21.15.18:50006) 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd6000640 1 -- 172.21.15.18:0/3804650825 learned_addr learned my addr 172.21.15.18:0/3804650825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd5600640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00742e0 0x7fafd01a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd4c00640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafd01a1b10 0x7fafd019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd6000640 1 -- 172.21.15.18:0/3804650825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00742e0 msgr2=0x7fafd01a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:19.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd6000640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00742e0 0x7fafd01a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd6000640 1 -- 172.21.15.18:0/3804650825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafd01a1b10 msgr2=0x7fafd019b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd6000640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafd01a1b10 0x7fafd019b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd6000640 1 -- 172.21.15.18:0/3804650825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009560 con 0x7fafd019bc00 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.977+0000 7fafd4c00640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafd01a1b10 0x7fafd019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.978+0000 7fafd6000640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd019bc00 0x7fafd019c060 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fafc800bab0 tx=0x7fafc800bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.978+0000 7fafce000640 1 -- 172.21.15.18:0/3804650825 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc800cc00 con 0x7fafd019bc00 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.978+0000 7fafce000640 1 -- 172.21.15.18:0/3804650825 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafc800cd60 con 0x7fafd019bc00 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.978+0000 7fafce000640 1 -- 172.21.15.18:0/3804650825 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8007750 con 0x7fafd019bc00 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.978+0000 7fafd8000640 1 -- 172.21.15.18:0/3804650825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd01a87e0 con 0x7fafd019bc00 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.978+0000 7fafd8000640 1 -- 172.21.15.18:0/3804650825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd01a8c90 con 0x7fafd019bc00 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.979+0000 7fafce000640 1 -- 172.21.15.18:0/3804650825 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fafc8014440 con 0x7fafd019bc00 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.979+0000 7fafd8000640 1 -- 172.21.15.18:0/3804650825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd0073bf0 con 0x7fafd019bc00 2024-09-13T16:43:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.980+0000 7fafce000640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafb8038b90 0x7fafb803b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.980+0000 7fafce000640 1 -- 172.21.15.18:0/3804650825 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fafc804ae30 con 0x7fafd019bc00 2024-09-13T16:43:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.980+0000 7fafd5600640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafb8038b90 0x7fafb803b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.981+0000 7fafd5600640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafb8038b90 0x7fafb803b050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fafc4000c00 tx=0x7fafc4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:19.985+0000 7fafce000640 1 -- 172.21.15.18:0/3804650825 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fafc8014a00 con 0x7fafd019bc00 2024-09-13T16:43:20.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.177+0000 7fafd8000640 1 -- 172.21.15.18:0/3804650825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fafd01100f0 con 0x7fafd019bc00 2024-09-13T16:43:20.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.177+0000 7fafce000640 1 -- 172.21.15.18:0/3804650825 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7fafc8012950 con 0x7fafd019bc00 2024-09-13T16:43:20.179 INFO:teuthology.orchestra.run.smithi018.stdout:# minimal ceph.conf for d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:43:20.179 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-09-13T16:43:20.179 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:43:20.179 INFO:teuthology.orchestra.run.smithi018.stdout: mon_host = [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-09-13T16:43:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.179+0000 7fafd8000640 1 -- 172.21.15.18:0/3804650825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafb8038b90 msgr2=0x7fafb803b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.179+0000 7fafd8000640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafb8038b90 0x7fafb803b050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fafc4000c00 tx=0x7fafc4031400 comp rx=0 tx=0).stop 2024-09-13T16:43:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.179+0000 7fafd8000640 1 -- 172.21.15.18:0/3804650825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd019bc00 msgr2=0x7fafd019c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.179+0000 7fafd8000640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd019bc00 0x7fafd019c060 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fafc800bab0 tx=0x7fafc800bf70 comp rx=0 tx=0).stop 2024-09-13T16:43:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.180+0000 7fafd8000640 1 -- 172.21.15.18:0/3804650825 shutdown_connections 2024-09-13T16:43:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.180+0000 7fafd8000640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafb8038b90 0x7fafb803b050 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.180+0000 7fafd8000640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd019bc00 0x7fafd019c060 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.180+0000 7fafd8000640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafd01a1b10 0x7fafd019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.180+0000 7fafd8000640 1 --2- 172.21.15.18:0/3804650825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00742e0 0x7fafd01a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.180+0000 7fafd8000640 1 -- 172.21.15.18:0/3804650825 >> 172.21.15.18:0/3804650825 conn(0x7fafd0076510 msgr2=0x7fafd00fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.180+0000 7fafd8000640 1 -- 172.21.15.18:0/3804650825 shutdown_connections 2024-09-13T16:43:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:20.180+0000 7fafd8000640 1 -- 172.21.15.18:0/3804650825 wait complete. 2024-09-13T16:43:20.883 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:20 smithi018 ceph-mon[30981]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:20.883 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:20 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3804650825' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:20.883 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:20.884 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:20.884 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:20.884 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:43:20.884 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:21.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:20 smithi144 ceph-mon[35328]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:21.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:20 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3804650825' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:21.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:21.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:21.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:21.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:43:21.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:21.029 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:20 smithi094 ceph-mon[35259]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:21.029 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:20 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3804650825' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:21.030 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:21.030 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:21.030 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:21.030 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:43:21.030 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:21.205 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T16:43:21.205 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:43:21.205 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T16:43:21.264 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:43:21.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:43:21.359 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:43:21.359 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T16:43:21.388 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:43:21.389 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:43:21.453 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:43:21.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T16:43:21.487 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:43:21.487 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:43:21.558 INFO:tasks.cephadm:Adding mgr.x on smithi018 2024-09-13T16:43:21.558 INFO:tasks.cephadm:Adding mgr.y on smithi094 2024-09-13T16:43:21.558 INFO:tasks.cephadm:Adding mgr.z on smithi144 2024-09-13T16:43:21.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi018=x;smithi094=y;smithi144=z' 2024-09-13T16:43:21.793 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:43:22.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:21 smithi144 ceph-mon[35328]: Reconfiguring mon.b (monmap changed)... 2024-09-13T16:43:22.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:21 smithi144 ceph-mon[35328]: Reconfiguring daemon mon.b on smithi094 2024-09-13T16:43:22.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:21 smithi094 ceph-mon[35259]: Reconfiguring mon.b (monmap changed)... 2024-09-13T16:43:22.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:21 smithi094 ceph-mon[35259]: Reconfiguring daemon mon.b on smithi094 2024-09-13T16:43:22.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:21 smithi018 ceph-mon[30981]: Reconfiguring mon.b (monmap changed)... 2024-09-13T16:43:22.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:21 smithi018 ceph-mon[30981]: Reconfiguring daemon mon.b on smithi094 2024-09-13T16:43:22.940 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:22 smithi144 ceph-mon[35328]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:22.941 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:22.941 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:22.941 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:22.941 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:43:22.941 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:23.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:22 smithi094 ceph-mon[35259]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:43:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:22 smithi018 ceph-mon[30981]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:43:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:43:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:23.916 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:23 smithi144 ceph-mon[35328]: Reconfiguring mon.c (monmap changed)... 2024-09-13T16:43:23.916 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:23 smithi144 ceph-mon[35328]: Reconfiguring daemon mon.c on smithi144 2024-09-13T16:43:24.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:23 smithi094 ceph-mon[35259]: Reconfiguring mon.c (monmap changed)... 2024-09-13T16:43:24.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:23 smithi094 ceph-mon[35259]: Reconfiguring daemon mon.c on smithi144 2024-09-13T16:43:24.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:23 smithi018 ceph-mon[30981]: Reconfiguring mon.c (monmap changed)... 2024-09-13T16:43:24.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:23 smithi018 ceph-mon[30981]: Reconfiguring daemon mon.c on smithi144 2024-09-13T16:43:24.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.425+0000 7f6d8b5db640 1 -- 172.21.15.144:0/560016355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d84100fe0 msgr2=0x7f6d84101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:24.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.425+0000 7f6d8b5db640 1 --2- 172.21.15.144:0/560016355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d84100fe0 0x7f6d84101460 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009900 tx=0x7f6d7402a410 comp rx=0 tx=0).stop 2024-09-13T16:43:24.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.425+0000 7f6d8b5db640 1 -- 172.21.15.144:0/560016355 shutdown_connections 2024-09-13T16:43:24.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.425+0000 7f6d8b5db640 1 --2- 172.21.15.144:0/560016355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d841019a0 0x7f6d84108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:24.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.425+0000 7f6d8b5db640 1 --2- 172.21.15.144:0/560016355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d84100fe0 0x7f6d84101460 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:24.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.425+0000 7f6d8b5db640 1 --2- 172.21.15.144:0/560016355 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d840ffde0 0x7f6d841001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:24.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.425+0000 7f6d8b5db640 1 -- 172.21.15.144:0/560016355 >> 172.21.15.144:0/560016355 conn(0x7f6d840fb590 msgr2=0x7f6d840fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:24.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.425+0000 7f6d8b5db640 1 -- 172.21.15.144:0/560016355 shutdown_connections 2024-09-13T16:43:24.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.425+0000 7f6d8b5db640 1 -- 172.21.15.144:0/560016355 wait complete. 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d8b5db640 1 Processor -- start 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d8b5db640 1 -- start start 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d8b5db640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d840ffde0 0x7f6d84074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d8b5db640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d84100fe0 0x7f6d840728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d8b5db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d841019a0 0x7f6d84072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d8b5db640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840734e0 con 0x7f6d841019a0 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d8b5db640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d84073650 con 0x7f6d840ffde0 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d8b5db640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8419fde0 con 0x7f6d84100fe0 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d88b76640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d84100fe0 0x7f6d840728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d88b76640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d84100fe0 0x7f6d840728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49504/0 (socket says 172.21.15.144:49504) 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.426+0000 7f6d88b76640 1 -- 172.21.15.144:0/1762292037 learned_addr learned my addr 172.21.15.144:0/1762292037 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d89377640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d840ffde0 0x7f6d84074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:24.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d89b78640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d841019a0 0x7f6d84072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d88b76640 1 -- 172.21.15.144:0/1762292037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d840ffde0 msgr2=0x7f6d84074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d88b76640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d840ffde0 0x7f6d84074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d88b76640 1 -- 172.21.15.144:0/1762292037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d841019a0 msgr2=0x7f6d84072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d88b76640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d841019a0 0x7f6d84072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d88b76640 1 -- 172.21.15.144:0/1762292037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d74009560 con 0x7f6d84100fe0 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d88b76640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d84100fe0 0x7f6d840728a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009230 tx=0x7f6d74004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d7a7fc640 1 -- 172.21.15.144:0/1762292037 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74004e00 con 0x7f6d84100fe0 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d8b5db640 1 -- 172.21.15.144:0/1762292037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8419ffe0 con 0x7f6d84100fe0 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d7a7fc640 1 -- 172.21.15.144:0/1762292037 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d74003ab0 con 0x7f6d84100fe0 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d7a7fc640 1 -- 172.21.15.144:0/1762292037 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74031cd0 con 0x7f6d84100fe0 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.427+0000 7f6d8b5db640 1 -- 172.21.15.144:0/1762292037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d841a0480 con 0x7f6d84100fe0 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.428+0000 7f6d7a7fc640 1 -- 172.21.15.144:0/1762292037 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f6d74003c20 con 0x7f6d84100fe0 2024-09-13T16:43:24.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.428+0000 7f6d7a7fc640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6d70038930 0x7f6d7003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:24.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.428+0000 7f6d8b5db640 1 -- 172.21.15.144:0/1762292037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d84107270 con 0x7f6d84100fe0 2024-09-13T16:43:24.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.428+0000 7f6d7a7fc640 1 -- 172.21.15.144:0/1762292037 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6d7406c8d0 con 0x7f6d84100fe0 2024-09-13T16:43:24.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.429+0000 7f6d89377640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6d70038930 0x7f6d7003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:24.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.429+0000 7f6d89377640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6d70038930 0x7f6d7003adf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d800058c0 tx=0x7f6d80005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:24.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.433+0000 7f6d7a7fc640 1 -- 172.21.15.144:0/1762292037 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6d7403b3d0 con 0x7f6d84100fe0 2024-09-13T16:43:24.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.618+0000 7f6d8b5db640 1 -- 172.21.15.144:0/1762292037 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi094=y;smithi144=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d8402c4f0 con 0x7f6d70038930 2024-09-13T16:43:24.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.624+0000 7f6d7a7fc640 1 -- 172.21.15.144:0/1762292037 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6d8402c4f0 con 0x7f6d70038930 2024-09-13T16:43:24.627 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mgr update... 2024-09-13T16:43:24.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 -- 172.21.15.144:0/1762292037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6d70038930 msgr2=0x7f6d7003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:24.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6d70038930 0x7f6d7003adf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d800058c0 tx=0x7f6d80005850 comp rx=0 tx=0).stop 2024-09-13T16:43:24.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 -- 172.21.15.144:0/1762292037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d84100fe0 msgr2=0x7f6d840728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:24.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d84100fe0 0x7f6d840728a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009230 tx=0x7f6d74004740 comp rx=0 tx=0).stop 2024-09-13T16:43:24.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 -- 172.21.15.144:0/1762292037 shutdown_connections 2024-09-13T16:43:24.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6d70038930 0x7f6d7003adf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:24.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d841019a0 0x7f6d84072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:24.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d84100fe0 0x7f6d840728a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:24.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 --2- 172.21.15.144:0/1762292037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d840ffde0 0x7f6d84074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:24.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 -- 172.21.15.144:0/1762292037 >> 172.21.15.144:0/1762292037 conn(0x7f6d840fb590 msgr2=0x7f6d84104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:24.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 -- 172.21.15.144:0/1762292037 shutdown_connections 2024-09-13T16:43:24.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:43:24.627+0000 7f6d8b5db640 1 -- 172.21.15.144:0/1762292037 wait complete. 2024-09-13T16:43:25.024 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:25.024 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:43:25.026 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:43:25.026 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:43:25.026 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:25.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:25.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:25.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:25.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:25.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:25.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:25.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:25.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:43:25.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:43:25.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:43:25.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:25.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:25.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:25.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:43:25.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:43:25.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:43:25.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:25.232 DEBUG:teuthology.orchestra.run.smithi094:mgr.y> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.y.service 2024-09-13T16:43:25.235 DEBUG:teuthology.orchestra.run.smithi144:mgr.z> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.z.service 2024-09-13T16:43:25.238 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T16:43:25.238 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:43:25.238 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T16:43:25.278 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T16:43:25.278 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-13T16:43:25.356 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T16:43:25.356 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:25.356 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 638 Links: 1 2024-09-13T16:43:25.356 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:25.356 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:25.356 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-13 16:42:26.647205404 +0000 2024-09-13T16:43:25.356 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-13 16:38:06.754742198 +0000 2024-09-13T16:43:25.356 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-13 16:38:06.754742198 +0000 2024-09-13T16:43:25.357 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-13 16:38:06.754742198 +0000 2024-09-13T16:43:25.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T16:43:25.452 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-13T16:43:25.452 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-13T16:43:25.452 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000182907 s, 2.8 MB/s 2024-09-13T16:43:25.455 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T16:43:25.492 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-13T16:43:25.568 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T16:43:25.569 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:25.569 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-13T16:43:25.569 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:25.569 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:25.569 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-13 16:42:26.690204887 +0000 2024-09-13T16:43:25.569 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-13 16:38:07.211736672 +0000 2024-09-13T16:43:25.569 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-13 16:38:07.211736672 +0000 2024-09-13T16:43:25.569 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-13 16:38:07.211736672 +0000 2024-09-13T16:43:25.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T16:43:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-13T16:43:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-13T16:43:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000181894 s, 2.8 MB/s 2024-09-13T16:43:25.665 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T16:43:25.703 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-13T16:43:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T16:43:25.779 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:25.779 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 678 Links: 1 2024-09-13T16:43:25.779 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:25.779 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:25.779 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-13 16:42:26.732204381 +0000 2024-09-13T16:43:25.779 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-13 16:38:07.684730953 +0000 2024-09-13T16:43:25.780 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-13 16:38:07.684730953 +0000 2024-09-13T16:43:25.780 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-13 16:38:07.684730953 +0000 2024-09-13T16:43:25.780 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T16:43:25.873 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-13T16:43:25.873 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-13T16:43:25.873 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000183136 s, 2.8 MB/s 2024-09-13T16:43:25.875 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T16:43:25.911 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-13T16:43:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T16:43:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:25.988 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 696 Links: 1 2024-09-13T16:43:25.988 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:25.988 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:25.988 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-13 16:42:26.774203875 +0000 2024-09-13T16:43:25.988 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-13 16:38:08.151725306 +0000 2024-09-13T16:43:25.988 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-13 16:38:08.151725306 +0000 2024-09-13T16:43:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-13 16:38:08.151725306 +0000 2024-09-13T16:43:25.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T16:43:26.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:25 smithi144 ceph-mon[35328]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi094=y;smithi144=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:43:26.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:25 smithi144 ceph-mon[35328]: Saving service mgr spec with placement smithi018=x;smithi094=y;smithi144=z;count:3 2024-09-13T16:43:26.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:25 smithi144 ceph-mon[35328]: Deploying daemon mgr.z on smithi144 2024-09-13T16:43:26.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:25 smithi018 ceph-mon[30981]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi094=y;smithi144=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:43:26.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:25 smithi018 ceph-mon[30981]: Saving service mgr spec with placement smithi018=x;smithi094=y;smithi144=z;count:3 2024-09-13T16:43:26.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:25 smithi018 ceph-mon[30981]: Deploying daemon mgr.z on smithi144 2024-09-13T16:43:26.080 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-13T16:43:26.081 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-13T16:43:26.081 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000175352 s, 2.9 MB/s 2024-09-13T16:43:26.083 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T16:43:26.120 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T16:43:26.120 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T16:43:26.140 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T16:43:26.140 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-09-13T16:43:26.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:25 smithi094 ceph-mon[35259]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi094=y;smithi144=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:43:26.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:25 smithi094 ceph-mon[35259]: Saving service mgr spec with placement smithi018=x;smithi094=y;smithi144=z;count:3 2024-09-13T16:43:26.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:25 smithi094 ceph-mon[35259]: Deploying daemon mgr.z on smithi144 2024-09-13T16:43:26.179 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T16:43:26.179 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:26.179 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-13T16:43:26.180 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:26.180 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:26.180 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-13 16:43:09.388626084 +0000 2024-09-13T16:43:26.180 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-13 16:37:29.181576431 +0000 2024-09-13T16:43:26.180 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-13 16:37:29.181576431 +0000 2024-09-13T16:43:26.180 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-13 16:37:29.181576431 +0000 2024-09-13T16:43:26.180 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T16:43:26.247 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-13T16:43:26.247 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-13T16:43:26.247 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000117371 s, 4.4 MB/s 2024-09-13T16:43:26.249 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T16:43:26.306 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-09-13T16:43:26.361 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T16:43:26.361 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:26.361 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T16:43:26.361 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:26.361 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:26.362 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-13 16:43:09.388626084 +0000 2024-09-13T16:43:26.362 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-13 16:37:29.503571226 +0000 2024-09-13T16:43:26.362 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-13 16:37:29.503571226 +0000 2024-09-13T16:43:26.362 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-13 16:37:29.503571226 +0000 2024-09-13T16:43:26.362 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T16:43:26.425 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-13T16:43:26.425 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-13T16:43:26.425 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 8.6268e-05 s, 5.9 MB/s 2024-09-13T16:43:26.426 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T16:43:26.482 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-09-13T16:43:26.537 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T16:43:26.538 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:26.538 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-13T16:43:26.538 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:26.538 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:26.538 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-13 16:43:09.388626084 +0000 2024-09-13T16:43:26.538 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-13 16:37:29.807566311 +0000 2024-09-13T16:43:26.538 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-13 16:37:29.807566311 +0000 2024-09-13T16:43:26.538 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-13 16:37:29.807566311 +0000 2024-09-13T16:43:26.538 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T16:43:26.602 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-13T16:43:26.602 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-13T16:43:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 9.1646e-05 s, 5.6 MB/s 2024-09-13T16:43:26.604 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T16:43:26.660 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-09-13T16:43:26.716 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T16:43:26.716 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:26.716 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-13T16:43:26.716 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:26.717 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:26.717 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-13 16:43:09.389626068 +0000 2024-09-13T16:43:26.717 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-13 16:37:30.116561316 +0000 2024-09-13T16:43:26.717 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-13 16:37:30.116561316 +0000 2024-09-13T16:43:26.717 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-13 16:37:30.116561316 +0000 2024-09-13T16:43:26.717 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T16:43:26.779 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-13T16:43:26.779 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-13T16:43:26.779 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000109992 s, 4.7 MB/s 2024-09-13T16:43:26.781 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T16:43:26.837 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T16:43:26.837 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T16:43:26.854 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T16:43:26.854 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-09-13T16:43:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T16:43:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:26.911 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-13T16:43:26.911 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:26.911 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:26.911 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-13 16:43:26.671635481 +0000 2024-09-13T16:43:26.911 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-13 16:37:29.200550223 +0000 2024-09-13T16:43:26.911 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-13 16:37:29.200550223 +0000 2024-09-13T16:43:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-13 16:37:29.200550223 +0000 2024-09-13T16:43:26.912 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T16:43:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-13T16:43:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-13T16:43:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000226256 s, 2.3 MB/s 2024-09-13T16:43:26.978 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T16:43:27.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:26 smithi144 ceph-mon[35328]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:27.035 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-09-13T16:43:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T16:43:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:27.092 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T16:43:27.092 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:27.092 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:27.092 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-13 16:43:26.671635481 +0000 2024-09-13T16:43:27.092 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-13 16:37:29.539543972 +0000 2024-09-13T16:43:27.092 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-13 16:37:29.539543972 +0000 2024-09-13T16:43:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-13 16:37:29.539543972 +0000 2024-09-13T16:43:27.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T16:43:27.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-13T16:43:27.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-13T16:43:27.155 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000193402 s, 2.6 MB/s 2024-09-13T16:43:27.156 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T16:43:27.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:26 smithi094 ceph-mon[35259]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:27.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:26 smithi018 ceph-mon[30981]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:27.214 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-09-13T16:43:27.270 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T16:43:27.270 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:27.271 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-13T16:43:27.271 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:27.271 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:27.271 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-13 16:43:26.671635481 +0000 2024-09-13T16:43:27.271 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-13 16:37:29.857538109 +0000 2024-09-13T16:43:27.271 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-13 16:37:29.857538109 +0000 2024-09-13T16:43:27.272 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-13 16:37:29.857538109 +0000 2024-09-13T16:43:27.272 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T16:43:27.334 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:27.306+0000 7f7258208040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:43:27.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-13T16:43:27.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-13T16:43:27.338 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000213404 s, 2.4 MB/s 2024-09-13T16:43:27.339 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T16:43:27.396 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-09-13T16:43:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T16:43:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:43:27.451 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-13T16:43:27.451 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:43:27.451 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:43:27.452 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-13 16:43:26.672635463 +0000 2024-09-13T16:43:27.452 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-13 16:37:30.186532043 +0000 2024-09-13T16:43:27.452 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-13 16:37:30.186532043 +0000 2024-09-13T16:43:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-13 16:37:30.186532043 +0000 2024-09-13T16:43:27.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T16:43:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-13T16:43:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-13T16:43:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000177442 s, 2.9 MB/s 2024-09-13T16:43:27.517 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T16:43:27.574 INFO:tasks.cephadm:Deploying osd.0 on smithi018 with /dev/vg_nvme/lv_4... 2024-09-13T16:43:27.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T16:43:27.595 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:27.372+0000 7f7258208040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:43:27.595 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:27.525+0000 7f7258208040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:43:27.595 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:27.593+0000 7f7258208040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:43:27.876 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:27.737+0000 7f7258208040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:43:27.876 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:27.874+0000 7f7258208040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:43:27.893 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:43:28.521 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:28.180+0000 7f7258208040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:43:28.521 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:28.240+0000 7f7258208040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:43:28.522 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:28.422+0000 7f7258208040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:43:28.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:28.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:28.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:28.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:43:28.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:43:28.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:43:28.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:28.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-mon[35328]: Deploying daemon mgr.y on smithi094 2024-09-13T16:43:28.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:28 smithi144 ceph-mon[35328]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:28.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:28.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:28.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:28.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:43:28.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:43:28.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:43:28.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:28.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:28 smithi094 ceph-mon[35259]: Deploying daemon mgr.y on smithi094 2024-09-13T16:43:28.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:28 smithi094 ceph-mon[35259]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:28.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:28.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:28.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:28.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:43:28.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:43:28.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:43:28.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:28.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:28 smithi018 ceph-mon[30981]: Deploying daemon mgr.y on smithi094 2024-09-13T16:43:28.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:28 smithi018 ceph-mon[30981]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:29.089 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:28 smithi094 systemd[1]: Starting Ceph mgr.y for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:43:29.375 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 podman[36653]: 2024-09-13 16:43:29.088447981 +0000 UTC m=+0.094100274 container create a380fa1b64e8fcd6731636dd7b9fda797551ce7278bb648a6491e635f4d970f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:43:29.375 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 podman[36653]: 2024-09-13 16:43:29.010269978 +0000 UTC m=+0.015922296 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:43:29.375 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 podman[36653]: 2024-09-13 16:43:29.29057631 +0000 UTC m=+0.296228604 container init a380fa1b64e8fcd6731636dd7b9fda797551ce7278bb648a6491e635f4d970f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T16:43:29.375 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 podman[36653]: 2024-09-13 16:43:29.293984821 +0000 UTC m=+0.299637116 container start a380fa1b64e8fcd6731636dd7b9fda797551ce7278bb648a6491e635f4d970f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T16:43:29.375 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 ceph-mgr[36672]: -- 172.21.15.94:0/1707449750 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55730e52ed00 con 0x55730e503000 2024-09-13T16:43:29.375 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 bash[36653]: a380fa1b64e8fcd6731636dd7b9fda797551ce7278bb648a6491e635f4d970f7 2024-09-13T16:43:29.626 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 systemd[1]: Started Ceph mgr.y for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:43:29.626 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:29.414+0000 7f16546ca040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T16:43:29.626 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:29.473+0000 7f16546ca040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T16:43:29.627 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:29.625+0000 7f16546ca040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T16:43:29.771 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:29 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:29.277+0000 7f7258208040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:43:29.771 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:29 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:29.343+0000 7f7258208040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:43:29.911 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:29.694+0000 7f16546ca040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T16:43:29.912 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:29 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:29.853+0000 7f16546ca040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:43:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T16:43:30.189 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T16:43:30.222 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-09-13T16:43:30.222 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-09-13T16:43:30.222 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0278738 s, 376 MB/s 2024-09-13T16:43:30.223 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-09-13T16:43:30.327 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:30 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:30.008+0000 7f16546ca040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T16:43:30.327 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:30 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:30.325+0000 7f16546ca040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T16:43:30.400 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:30.129+0000 7f7258208040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:43:30.401 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:30.253+0000 7f7258208040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:43:30.401 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:30.398+0000 7f7258208040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:43:30.661 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:30 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:30.385+0000 7f16546ca040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T16:43:30.662 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:30 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:30.572+0000 7f16546ca040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T16:43:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:30 smithi094 ceph-mon[35259]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:30.703 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:30.460+0000 7f7258208040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:43:30.703 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:30.628+0000 7f7258208040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:43:30.703 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:30.700+0000 7f7258208040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:43:30.703 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.703 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.703 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.703 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.703 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:30.704 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-mon[35328]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:30.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:30.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:30 smithi018 ceph-mon[30981]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:30.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_4 2024-09-13T16:43:30.984 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:30.760+0000 7f7258208040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:43:30.984 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:30.918+0000 7f7258208040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:43:30.984 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:30.982+0000 7f7258208040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:43:31.246 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:31.047+0000 7f7258208040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:43:31.246 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:31.127+0000 7f7258208040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:43:31.246 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:31.186+0000 7f7258208040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:43:31.246 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:31.243+0000 7f7258208040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:43:31.899 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:43:31.911 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:31.431+0000 7f16546ca040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T16:43:31.912 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:31.495+0000 7f16546ca040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T16:43:31.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:31.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:31.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:31.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:31.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:31.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:31.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:31.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:43:31.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:43:31.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:31.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:31.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:31.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:31.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:31.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:31.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:31.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:31.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:43:31.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:43:31.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:32.011 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:32.011 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:32.011 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:32.011 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:32.011 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:32.011 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:32.012 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:32.012 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:43:32.012 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:43:32.012 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:32.271 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z[37188]: 2024-09-13T16:43:32.009+0000 7f7258208040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:43:32.451 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:32.200+0000 7f16546ca040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T16:43:32.452 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:32.311+0000 7f16546ca040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T16:43:32.452 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:32.450+0000 7f16546ca040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T16:43:32.726 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:32.510+0000 7f16546ca040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T16:43:32.727 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:32.659+0000 7f16546ca040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T16:43:32.727 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:32.725+0000 7f16546ca040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T16:43:32.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T16:43:32.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: Reconfiguring daemon mgr.x on smithi018 2024-09-13T16:43:32.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:32.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:32.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: Standby manager daemon z started 2024-09-13T16:43:32.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T16:43:32.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:43:32.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T16:43:32.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:43:32.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:32.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:32.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:32.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:32.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:32.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:33.001 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:32.784+0000 7f16546ca040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T16:43:33.001 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:32.936+0000 7f16546ca040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T16:43:33.001 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:32.999+0000 7f16546ca040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T16:43:33.001 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T16:43:33.001 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: Reconfiguring daemon mgr.x on smithi018 2024-09-13T16:43:33.001 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:33.001 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: Standby manager daemon z started 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:33.002 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:33.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T16:43:33.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: Reconfiguring daemon mgr.x on smithi018 2024-09-13T16:43:33.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:33.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:33.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: Standby manager daemon z started 2024-09-13T16:43:33.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T16:43:33.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:43:33.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T16:43:33.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.? 172.21.15.144:0/4088209865' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:43:33.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:33.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:33.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:33.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:33.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:33.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:33.259 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:33.064+0000 7f16546ca040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T16:43:33.260 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:33.144+0000 7f16546ca040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T16:43:33.260 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:33.201+0000 7f16546ca040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T16:43:33.260 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:33.258+0000 7f16546ca040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T16:43:33.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:33 smithi018 ceph-mon[30981]: mgrmap e14: x(active, since 81s), standbys: z 2024-09-13T16:43:33.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:33 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T16:43:34.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:33 smithi144 ceph-mon[35328]: mgrmap e14: x(active, since 81s), standbys: z 2024-09-13T16:43:34.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:33 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T16:43:34.022 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:33 smithi094 ceph-mon[35259]: mgrmap e14: x(active, since 81s), standbys: z 2024-09-13T16:43:34.022 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:33 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T16:43:34.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.253+0000 7fe603200640 1 -- 172.21.15.18:0/1204581495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe604101e30 msgr2=0x7fe604102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:34.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.253+0000 7fe603200640 1 --2- 172.21.15.18:0/1204581495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe604101e30 0x7fe604102230 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009900 tx=0x7fe5f402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:43:34.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.253+0000 7fe603200640 1 -- 172.21.15.18:0/1204581495 shutdown_connections 2024-09-13T16:43:34.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.253+0000 7fe603200640 1 --2- 172.21.15.18:0/1204581495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe604103950 0x7fe60410a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:34.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.253+0000 7fe603200640 1 --2- 172.21.15.18:0/1204581495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe604102f90 0x7fe604103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:34.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.253+0000 7fe603200640 1 --2- 172.21.15.18:0/1204581495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe604101e30 0x7fe604102230 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:34.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.253+0000 7fe603200640 1 -- 172.21.15.18:0/1204581495 >> 172.21.15.18:0/1204581495 conn(0x7fe6040fd5e0 msgr2=0x7fe6040ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:34.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.253+0000 7fe603200640 1 -- 172.21.15.18:0/1204581495 shutdown_connections 2024-09-13T16:43:34.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.253+0000 7fe603200640 1 -- 172.21.15.18:0/1204581495 wait complete. 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.254+0000 7fe603200640 1 Processor -- start 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.254+0000 7fe603200640 1 -- start start 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe603200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe604101e30 0x7fe604197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe603200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe604102f90 0x7fe604198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe603200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe604103950 0x7fe60419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe603200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60419f8f0 con 0x7fe604103950 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe603200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60419fa60 con 0x7fe604101e30 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe603200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60419fc20 con 0x7fe604102f90 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe601e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe604101e30 0x7fe604197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe601e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe604101e30 0x7fe604197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:53784/0 (socket says 172.21.15.18:53784) 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe601e00640 1 -- 172.21.15.18:0/2327005955 learned_addr learned my addr 172.21.15.18:0/2327005955 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:43:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe5fbe00640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe604102f90 0x7fe604198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:34.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe602800640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe604103950 0x7fe60419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:34.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe601e00640 1 -- 172.21.15.18:0/2327005955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe604102f90 msgr2=0x7fe604198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:34.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe601e00640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe604102f90 0x7fe604198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:34.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe601e00640 1 -- 172.21.15.18:0/2327005955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe604103950 msgr2=0x7fe60419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:34.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe601e00640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe604103950 0x7fe60419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:34.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.255+0000 7fe601e00640 1 -- 172.21.15.18:0/2327005955 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f4009560 con 0x7fe604101e30 2024-09-13T16:43:34.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.256+0000 7fe601e00640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe604101e30 0x7fe604197e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4031500 tx=0x7fe5f4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:34.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.256+0000 7fe5faa00640 1 -- 172.21.15.18:0/2327005955 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4003e00 con 0x7fe604101e30 2024-09-13T16:43:34.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.256+0000 7fe5faa00640 1 -- 172.21.15.18:0/2327005955 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5f4031c70 con 0x7fe604101e30 2024-09-13T16:43:34.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.256+0000 7fe603200640 1 -- 172.21.15.18:0/2327005955 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60419fea0 con 0x7fe604101e30 2024-09-13T16:43:34.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.256+0000 7fe5faa00640 1 -- 172.21.15.18:0/2327005955 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f403bc20 con 0x7fe604101e30 2024-09-13T16:43:34.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.256+0000 7fe603200640 1 -- 172.21.15.18:0/2327005955 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6041a02b0 con 0x7fe604101e30 2024-09-13T16:43:34.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.258+0000 7fe603200640 1 -- 172.21.15.18:0/2327005955 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe604109270 con 0x7fe604101e30 2024-09-13T16:43:34.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.258+0000 7fe5faa00640 1 -- 172.21.15.18:0/2327005955 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7fe5f40317b0 con 0x7fe604101e30 2024-09-13T16:43:34.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.259+0000 7fe5faa00640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5e806ccb0 0x7fe5e806f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:43:34.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.259+0000 7fe5faa00640 1 -- 172.21.15.18:0/2327005955 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe5f40ab780 con 0x7fe604101e30 2024-09-13T16:43:34.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.259+0000 7fe5fbe00640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5e806ccb0 0x7fe5e806f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:43:34.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.260+0000 7fe5fbe00640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5e806ccb0 0x7fe5e806f170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe604199310 tx=0x7fe5ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:43:34.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.264+0000 7fe5faa00640 1 -- 172.21.15.18:0/2327005955 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe5f4076e30 con 0x7fe604101e30 2024-09-13T16:43:34.411 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 16:43:34 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y[36668]: 2024-09-13T16:43:34.020+0000 7f16546ca040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T16:43:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.456+0000 7fe603200640 1 -- 172.21.15.18:0/2327005955 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe60402c450 con 0x7fe5e806ccb0 2024-09-13T16:43:34.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:34.743+0000 7fe5faa00640 1 -- 172.21.15.18:0/2327005955 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fe5f4077200 con 0x7fe604101e30 2024-09-13T16:43:34.995 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:34 smithi018 ceph-mon[30981]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:34.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:34 smithi018 ceph-mon[30981]: Standby manager daemon y started 2024-09-13T16:43:34.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:34 smithi018 ceph-mon[30981]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T16:43:34.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:34 smithi018 ceph-mon[30981]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:43:34.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:34 smithi018 ceph-mon[30981]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T16:43:34.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:34 smithi018 ceph-mon[30981]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:43:34.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:43:34.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:43:34.996 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:35.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:34 smithi144 ceph-mon[35328]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:35.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:34 smithi144 ceph-mon[35328]: Standby manager daemon y started 2024-09-13T16:43:35.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:34 smithi144 ceph-mon[35328]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T16:43:35.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:34 smithi144 ceph-mon[35328]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:43:35.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:34 smithi144 ceph-mon[35328]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T16:43:35.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:34 smithi144 ceph-mon[35328]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:43:35.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:43:35.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:43:35.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:35.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:34 smithi094 ceph-mon[35259]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:35.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:34 smithi094 ceph-mon[35259]: Standby manager daemon y started 2024-09-13T16:43:35.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:34 smithi094 ceph-mon[35259]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T16:43:35.164 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:34 smithi094 ceph-mon[35259]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:43:35.164 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:34 smithi094 ceph-mon[35259]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T16:43:35.164 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:34 smithi094 ceph-mon[35259]: from='mgr.? 172.21.15.94:0/4181036855' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:43:35.164 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:43:35.164 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:43:35.164 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:36.015 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:35 smithi018 ceph-mon[30981]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:43:36.016 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:35 smithi018 ceph-mon[30981]: mgrmap e15: x(active, since 83s), standbys: z, y 2024-09-13T16:43:36.016 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:35 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T16:43:36.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:35 smithi144 ceph-mon[35328]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:43:36.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:35 smithi144 ceph-mon[35328]: mgrmap e15: x(active, since 83s), standbys: z, y 2024-09-13T16:43:36.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:35 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T16:43:36.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:35 smithi094 ceph-mon[35259]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:43:36.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:35 smithi094 ceph-mon[35259]: mgrmap e15: x(active, since 83s), standbys: z, y 2024-09-13T16:43:36.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:35 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T16:43:36.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:36 smithi018 ceph-mon[30981]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:37.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:36 smithi144 ceph-mon[35328]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:37.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:36 smithi094 ceph-mon[35259]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:38.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:37 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/210625809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d42fca5-9912-4f5c-9e13-13e879484040"}]: dispatch 2024-09-13T16:43:38.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:37 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/210625809' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d42fca5-9912-4f5c-9e13-13e879484040"}]': finished 2024-09-13T16:43:38.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:37 smithi144 ceph-mon[35328]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T16:43:38.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:37 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:37 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/210625809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d42fca5-9912-4f5c-9e13-13e879484040"}]: dispatch 2024-09-13T16:43:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:37 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/210625809' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d42fca5-9912-4f5c-9e13-13e879484040"}]': finished 2024-09-13T16:43:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:37 smithi094 ceph-mon[35259]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T16:43:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:37 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:38.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:37 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/210625809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d42fca5-9912-4f5c-9e13-13e879484040"}]: dispatch 2024-09-13T16:43:38.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:37 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/210625809' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d42fca5-9912-4f5c-9e13-13e879484040"}]': finished 2024-09-13T16:43:38.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:37 smithi018 ceph-mon[30981]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T16:43:38.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:37 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:39.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:38 smithi144 ceph-mon[35328]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:39.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:38 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3554481738' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:43:39.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:38 smithi094 ceph-mon[35259]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:39.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:38 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3554481738' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:43:39.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:38 smithi018 ceph-mon[30981]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:39.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:38 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3554481738' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:43:40.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:39 smithi094 ceph-mon[35259]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:40.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:39 smithi018 ceph-mon[30981]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:40.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:39 smithi144 ceph-mon[35328]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:43.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:42 smithi144 ceph-mon[35328]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:43.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:42 smithi018 ceph-mon[30981]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:43.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:42 smithi094 ceph-mon[35259]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:44.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:44 smithi018 ceph-mon[30981]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:45.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:44 smithi144 ceph-mon[35328]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:45.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:44 smithi094 ceph-mon[35259]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:46.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:45 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T16:43:46.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:45 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:46.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:45 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T16:43:46.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:45 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:46.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:45 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T16:43:46.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:45 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:46.918 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:46 smithi018 ceph-mon[30981]: Deploying daemon osd.0 on smithi018 2024-09-13T16:43:46.918 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:46 smithi018 ceph-mon[30981]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:47.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:46 smithi144 ceph-mon[35328]: Deploying daemon osd.0 on smithi018 2024-09-13T16:43:47.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:46 smithi144 ceph-mon[35328]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:47.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:46 smithi094 ceph-mon[35259]: Deploying daemon osd.0 on smithi018 2024-09-13T16:43:47.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:46 smithi094 ceph-mon[35259]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:48.894 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:48 smithi018 ceph-mon[30981]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:49.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:48 smithi144 ceph-mon[35328]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:49.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:48 smithi094 ceph-mon[35259]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:50.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:50 smithi018 ceph-mon[30981]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:51.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:50 smithi144 ceph-mon[35328]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:51.164 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:50 smithi094 ceph-mon[35259]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:51.953 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:51 smithi018 ceph-mon[30981]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:52.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:51 smithi094 ceph-mon[35259]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:52.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:51 smithi144 ceph-mon[35328]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:53.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:53.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:53.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:53.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:53.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:53.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:53.944 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:53 smithi018 ceph-mon[30981]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:54.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:53 smithi094 ceph-mon[35259]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:54.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:53 smithi144 ceph-mon[35328]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:55.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:55 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:55.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:55 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:55.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:55 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:55.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:55 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:55.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:55 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:55.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:55 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:55.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:55 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:55.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:55 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:55.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:55 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:55.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:55 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:55.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:55 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:55.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:55 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:55.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:55 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:43:55.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:55 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:43:55.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:55 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:56.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.188+0000 7fe5faa00640 1 -- 172.21.15.18:0/2327005955 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe60402c450 con 0x7fe5e806ccb0 2024-09-13T16:43:56.190 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 0 on host 'smithi018' 2024-09-13T16:43:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 -- 172.21.15.18:0/2327005955 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5e806ccb0 msgr2=0x7fe5e806f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5e806ccb0 0x7fe5e806f170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe604199310 tx=0x7fe5ec005f90 comp rx=0 tx=0).stop 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 -- 172.21.15.18:0/2327005955 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe604101e30 msgr2=0x7fe604197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe604101e30 0x7fe604197e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4031500 tx=0x7fe5f4003c10 comp rx=0 tx=0).stop 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 -- 172.21.15.18:0/2327005955 shutdown_connections 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5e806ccb0 0x7fe5e806f170 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe604103950 0x7fe60419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe604102f90 0x7fe604198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 --2- 172.21.15.18:0/2327005955 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe604101e30 0x7fe604197e40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 -- 172.21.15.18:0/2327005955 >> 172.21.15.18:0/2327005955 conn(0x7fe6040fd5e0 msgr2=0x7fe604106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 -- 172.21.15.18:0/2327005955 shutdown_connections 2024-09-13T16:43:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:43:56.191+0000 7fe603200640 1 -- 172.21.15.18:0/2327005955 wait complete. 2024-09-13T16:43:56.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:56 smithi144 ceph-mon[35328]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:56.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:56 smithi144 ceph-mon[35328]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T16:43:56.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:56 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:56.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:56 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:56.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:56 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:56.813 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:56 smithi094 ceph-mon[35259]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:56.813 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:56 smithi094 ceph-mon[35259]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T16:43:56.813 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:56 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:56.814 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:56 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:56.814 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:56 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:56.948 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:56 smithi018 ceph-mon[30981]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:56.949 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:56 smithi018 ceph-mon[30981]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T16:43:56.949 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:43:56.949 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:56.949 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:43:56.983 DEBUG:teuthology.orchestra.run.smithi018:osd.0> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T16:43:56.988 INFO:tasks.cephadm:Deploying osd.1 on smithi094 with /dev/vg_nvme/lv_4... 2024-09-13T16:43:56.988 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T16:43:57.189 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:43:57.585 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:57 smithi018 ceph-mon[30981]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T16:43:57.585 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:57 smithi018 ceph-mon[30981]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T16:43:57.585 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:57 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:57.585 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:57 smithi018 ceph-mon[30981]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:43:57.586 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 16:43:57 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0[45141]: 2024-09-13T16:43:57.509+0000 7fe400400640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T16:43:57.586 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 16:43:57 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0[45141]: 2024-09-13T16:43:57.513+0000 7fe3faa00640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:43:57.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:57 smithi144 ceph-mon[35328]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T16:43:57.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:57 smithi144 ceph-mon[35328]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T16:43:57.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:57 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:57.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:57 smithi144 ceph-mon[35328]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:43:57.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:57 smithi094 ceph-mon[35259]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T16:43:57.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:57 smithi094 ceph-mon[35259]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T16:43:57.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:57 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:57.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:57 smithi094 ceph-mon[35259]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:43:58.594 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:58 smithi094 ceph-mon[35259]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:43:58.594 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:58 smithi094 ceph-mon[35259]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T16:43:58.594 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:58.594 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:58.594 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:58 smithi094 ceph-mon[35259]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:58.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:58 smithi018 ceph-mon[30981]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:43:58.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:58 smithi018 ceph-mon[30981]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T16:43:58.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:58.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:58.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:58 smithi018 ceph-mon[30981]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:58.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:58 smithi144 ceph-mon[35328]: from='osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:43:58.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:58 smithi144 ceph-mon[35328]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T16:43:58.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:58.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:58.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:58 smithi144 ceph-mon[35328]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:43:58.916 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T16:43:59.008 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T16:43:59.018 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2024-09-13T16:43:59.019 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2024-09-13T16:43:59.019 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00841192 s, 1.2 GB/s 2024-09-13T16:43:59.019 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2024-09-13T16:43:59.605 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:59 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:43:59.605 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:59 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:43:59.605 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:59.605 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:59 smithi094 ceph-mon[35259]: osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] boot 2024-09-13T16:43:59.605 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:59 smithi094 ceph-mon[35259]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T16:43:59.605 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:43:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:59.627 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi094:vg_nvme/lv_4 2024-09-13T16:43:59.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:59 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:43:59.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:59 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:43:59.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:59.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:59 smithi144 ceph-mon[35328]: osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] boot 2024-09-13T16:43:59.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:59 smithi144 ceph-mon[35328]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T16:43:59.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:43:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:59.818 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:43:59.857 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:59 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:43:59.857 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:59 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:43:59.858 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:43:59.858 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:59 smithi018 ceph-mon[30981]: osd.0 [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] boot 2024-09-13T16:43:59.858 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:59 smithi018 ceph-mon[30981]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T16:43:59.858 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:43:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:44:00.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:00 smithi018 ceph-mon[30981]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T16:44:00.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:00 smithi018 ceph-mon[30981]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:00.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:00 smithi144 ceph-mon[35328]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T16:44:00.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:00 smithi144 ceph-mon[35328]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:00.777 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:00 smithi094 ceph-mon[35259]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T16:44:00.777 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:00 smithi094 ceph-mon[35259]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:01.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.234+0000 7f86183e8640 1 -- 172.21.15.94:0/3438314561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86100fe0d0 msgr2=0x7f86100fe4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:01.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.234+0000 7f86183e8640 1 --2- 172.21.15.94:0/3438314561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86100fe0d0 0x7f86100fe4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f860c009900 tx=0x7f860c02a410 comp rx=0 tx=0).stop 2024-09-13T16:44:01.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 -- 172.21.15.94:0/3438314561 shutdown_connections 2024-09-13T16:44:01.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 --2- 172.21.15.94:0/3438314561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86101010b0 0x7f8610101530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:01.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 --2- 172.21.15.94:0/3438314561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8610101a70 0x7f8610108300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:01.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 --2- 172.21.15.94:0/3438314561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86100fe0d0 0x7f86100fe4d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:01.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 -- 172.21.15.94:0/3438314561 >> 172.21.15.94:0/3438314561 conn(0x7f86100f9c20 msgr2=0x7f86100fc060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:44:01.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 -- 172.21.15.94:0/3438314561 shutdown_connections 2024-09-13T16:44:01.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 -- 172.21.15.94:0/3438314561 wait complete. 2024-09-13T16:44:01.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 Processor -- start 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 -- start start 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100fe0d0 0x7f8610195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86101010b0 0x7f86101962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8610101a70 0x7f861019d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861019d8a0 con 0x7f86100fe0d0 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861019da10 con 0x7f86101010b0 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f86183e8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861019dbd0 con 0x7f8610101a70 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.235+0000 7f8615983640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86101010b0 0x7f86101962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8615983640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86101010b0 0x7f86101962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57926/0 (socket says 172.21.15.94:57926) 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8615983640 1 -- 172.21.15.94:0/870725727 learned_addr learned my addr 172.21.15.94:0/870725727 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T16:44:01.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8616985640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8610101a70 0x7f861019d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8616184640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100fe0d0 0x7f8610195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8615983640 1 -- 172.21.15.94:0/870725727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8610101a70 msgr2=0x7f861019d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8615983640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8610101a70 0x7f861019d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8615983640 1 -- 172.21.15.94:0/870725727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100fe0d0 msgr2=0x7f8610195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8615983640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100fe0d0 0x7f8610195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8615983640 1 -- 172.21.15.94:0/870725727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c009560 con 0x7f86101010b0 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8616985640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8610101a70 0x7f861019d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f8615983640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86101010b0 0x7f86101962e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f860000b4a0 tx=0x7f860000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f86077fe640 1 -- 172.21.15.94:0/870725727 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600010610 con 0x7f86101010b0 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f86077fe640 1 -- 172.21.15.94:0/870725727 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8600010c30 con 0x7f86101010b0 2024-09-13T16:44:01.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f86183e8640 1 -- 172.21.15.94:0/870725727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861019deb0 con 0x7f86101010b0 2024-09-13T16:44:01.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f86077fe640 1 -- 172.21.15.94:0/870725727 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600017dd0 con 0x7f86101010b0 2024-09-13T16:44:01.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.236+0000 7f86183e8640 1 -- 172.21.15.94:0/870725727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861019e3a0 con 0x7f86101010b0 2024-09-13T16:44:01.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.237+0000 7f86183e8640 1 -- 172.21.15.94:0/870725727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8610107340 con 0x7f86101010b0 2024-09-13T16:44:01.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.238+0000 7f86077fe640 1 -- 172.21.15.94:0/870725727 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f86000173f0 con 0x7f86101010b0 2024-09-13T16:44:01.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.239+0000 7f86077fe640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85fc0a1020 0x7f85fc0a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:01.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.239+0000 7f86077fe640 1 -- 172.21.15.94:0/870725727 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f86000ca520 con 0x7f86101010b0 2024-09-13T16:44:01.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.240+0000 7f8616184640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85fc0a1020 0x7f85fc0a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:01.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.240+0000 7f8616184640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85fc0a1020 0x7f85fc0a34e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f860c006010 tx=0x7f860c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:44:01.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.244+0000 7f86077fe640 1 -- 172.21.15.94:0/870725727 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8600095720 con 0x7f86101010b0 2024-09-13T16:44:01.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:01.417+0000 7f86183e8640 1 -- 172.21.15.94:0/870725727 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f861002c450 con 0x7f85fc0a1020 2024-09-13T16:44:01.772 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi018 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi018 to 17094M 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:44:01.773 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:01.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi018 2024-09-13T16:44:01.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:01.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:01.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:44:01.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi018 to 17094M 2024-09-13T16:44:01.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:01.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:01.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:01.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:01.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:44:01.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:44:01.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:02.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi018 2024-09-13T16:44:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:44:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi018 to 17094M 2024-09-13T16:44:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:44:02.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:44:02.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:02.827 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:02 smithi094 ceph-mon[35259]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:44:02.828 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:02 smithi094 ceph-mon[35259]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:02.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:02 smithi018 ceph-mon[30981]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:44:02.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:02 smithi018 ceph-mon[30981]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:03.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:02 smithi144 ceph-mon[35328]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:44:03.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:02 smithi144 ceph-mon[35328]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:03.905 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:03 smithi144 ceph-mon[35328]: from='client.? 172.21.15.94:0/1785823389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7347881e-6e90-45e4-8c22-a2dc8d8b7ec6"}]: dispatch 2024-09-13T16:44:03.905 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:03 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7347881e-6e90-45e4-8c22-a2dc8d8b7ec6"}]: dispatch 2024-09-13T16:44:03.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:03 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7347881e-6e90-45e4-8c22-a2dc8d8b7ec6"}]': finished 2024-09-13T16:44:03.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:03 smithi144 ceph-mon[35328]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T16:44:03.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:03.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:03 smithi094 ceph-mon[35259]: from='client.? 172.21.15.94:0/1785823389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7347881e-6e90-45e4-8c22-a2dc8d8b7ec6"}]: dispatch 2024-09-13T16:44:03.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:03 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7347881e-6e90-45e4-8c22-a2dc8d8b7ec6"}]: dispatch 2024-09-13T16:44:03.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:03 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7347881e-6e90-45e4-8c22-a2dc8d8b7ec6"}]': finished 2024-09-13T16:44:03.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:03 smithi094 ceph-mon[35259]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T16:44:03.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:03.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:03 smithi018 ceph-mon[30981]: from='client.? 172.21.15.94:0/1785823389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7347881e-6e90-45e4-8c22-a2dc8d8b7ec6"}]: dispatch 2024-09-13T16:44:03.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:03 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7347881e-6e90-45e4-8c22-a2dc8d8b7ec6"}]: dispatch 2024-09-13T16:44:03.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:03 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7347881e-6e90-45e4-8c22-a2dc8d8b7ec6"}]': finished 2024-09-13T16:44:03.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:03 smithi018 ceph-mon[30981]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T16:44:03.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:04.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:04 smithi144 ceph-mon[35328]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:04.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:04 smithi144 ceph-mon[35328]: from='client.? 172.21.15.94:0/4278022188' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:44:04.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:04 smithi094 ceph-mon[35259]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:04.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:04 smithi094 ceph-mon[35259]: from='client.? 172.21.15.94:0/4278022188' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:44:04.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:04 smithi018 ceph-mon[30981]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:04.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:04 smithi018 ceph-mon[30981]: from='client.? 172.21.15.94:0/4278022188' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:44:07.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:06 smithi144 ceph-mon[35328]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:07.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:06 smithi094 ceph-mon[35259]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:07.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:06 smithi018 ceph-mon[30981]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:08.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:08 smithi094 ceph-mon[35259]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:09.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:08 smithi144 ceph-mon[35328]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:09.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:08 smithi018 ceph-mon[30981]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:11.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:10 smithi144 ceph-mon[35328]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:11.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:10 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T16:44:11.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:10 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:11.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:10 smithi094 ceph-mon[35259]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:11.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:10 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T16:44:11.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:10 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:11.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:10 smithi018 ceph-mon[30981]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:11.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:10 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T16:44:11.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:10 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:11.861 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:11 smithi094 ceph-mon[35259]: Deploying daemon osd.1 on smithi094 2024-09-13T16:44:12.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:11 smithi144 ceph-mon[35328]: Deploying daemon osd.1 on smithi094 2024-09-13T16:44:12.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:11 smithi018 ceph-mon[30981]: Deploying daemon osd.1 on smithi094 2024-09-13T16:44:12.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:12 smithi094 ceph-mon[35259]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:13.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:12 smithi144 ceph-mon[35328]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:13.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:12 smithi018 ceph-mon[30981]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:14.839 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:14 smithi094 ceph-mon[35259]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:15.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:14 smithi144 ceph-mon[35328]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:14 smithi018 ceph-mon[30981]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:16.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:16.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:16.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:15 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:16.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:15 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:16.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:15 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:16.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:15 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:16.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:16.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:16.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:15 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:16.908 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:16 smithi094 ceph-mon[35259]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:17.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:16 smithi144 ceph-mon[35328]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:17.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:16 smithi018 ceph-mon[30981]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:18.000 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:17 smithi094 ceph-mon[35259]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:18.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.034+0000 7f86077fe640 1 -- 172.21.15.94:0/870725727 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f861002c450 con 0x7f85fc0a1020 2024-09-13T16:44:18.036 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 1 on host 'smithi094' 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 -- 172.21.15.94:0/870725727 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85fc0a1020 msgr2=0x7f85fc0a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85fc0a1020 0x7f85fc0a34e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f860c006010 tx=0x7f860c0314a0 comp rx=0 tx=0).stop 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 -- 172.21.15.94:0/870725727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86101010b0 msgr2=0x7f86101962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86101010b0 0x7f86101962e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f860000b4a0 tx=0x7f860000b960 comp rx=0 tx=0).stop 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 -- 172.21.15.94:0/870725727 shutdown_connections 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8610101a70 0x7f861019d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86101010b0 0x7f86101962e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f85fc0a1020 0x7f85fc0a34e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 --2- 172.21.15.94:0/870725727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86100fe0d0 0x7f8610195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 -- 172.21.15.94:0/870725727 >> 172.21.15.94:0/870725727 conn(0x7f86100f9c20 msgr2=0x7f8610104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 -- 172.21.15.94:0/870725727 shutdown_connections 2024-09-13T16:44:18.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:44:18.036+0000 7f86183e8640 1 -- 172.21.15.94:0/870725727 wait complete. 2024-09-13T16:44:18.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:17 smithi018 ceph-mon[30981]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:18.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:17 smithi144 ceph-mon[35328]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:18.650 DEBUG:teuthology.orchestra.run.smithi094:osd.1> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T16:44:18.652 INFO:tasks.cephadm:Deploying osd.2 on smithi144 with /dev/vg_nvme/lv_4... 2024-09-13T16:44:18.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T16:44:18.860 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:44:19.266 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:19 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.267 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:19 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.267 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:19 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.267 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:19 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.267 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:19 smithi094 ceph-mon[35259]: from='osd.1 [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:44:19.267 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:19 smithi094 ceph-mon[35259]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:44:19.267 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:18 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1[39769]: 2024-09-13T16:44:18.963+0000 7fbb3acf4640 -1 osd.1 0 log_to_monitors true 2024-09-13T16:44:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:19 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:19 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:19 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:19 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:19 smithi144 ceph-mon[35328]: from='osd.1 [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:44:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:19 smithi144 ceph-mon[35328]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:44:19.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:19 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:19 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:19 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:19 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:19.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:19 smithi018 ceph-mon[30981]: from='osd.1 [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:44:19.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:19 smithi018 ceph-mon[30981]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T16:44:20.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:20 smithi094 ceph-mon[35259]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:20.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:20 smithi094 ceph-mon[35259]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T16:44:20.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:20 smithi094 ceph-mon[35259]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T16:44:20.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:20.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:20 smithi094 ceph-mon[35259]: from='osd.1 [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:44:20.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:20 smithi094 ceph-mon[35259]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:44:20.193 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:20 smithi144 ceph-mon[35328]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:20.193 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:20 smithi144 ceph-mon[35328]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T16:44:20.193 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:20 smithi144 ceph-mon[35328]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T16:44:20.193 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:20.193 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:20 smithi144 ceph-mon[35328]: from='osd.1 [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:44:20.193 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:20 smithi144 ceph-mon[35328]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:44:20.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:20 smithi018 ceph-mon[30981]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:20.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:20 smithi018 ceph-mon[30981]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T16:44:20.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:20 smithi018 ceph-mon[30981]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T16:44:20.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:20.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:20 smithi018 ceph-mon[30981]: from='osd.1 [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:44:20.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:20 smithi018 ceph-mon[30981]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:44:20.569 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T16:44:20.644 INFO:teuthology.orchestra.run.smithi144.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T16:44:20.658 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10+0 records in 2024-09-13T16:44:20.658 INFO:teuthology.orchestra.run.smithi144.stderr:10+0 records out 2024-09-13T16:44:20.658 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114237 s, 918 MB/s 2024-09-13T16:44:20.658 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping successful for: 2024-09-13T16:44:21.162 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:20 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1[39769]: 2024-09-13T16:44:20.777+0000 7fbb36c75640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T16:44:21.162 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:20 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1[39769]: 2024-09-13T16:44:20.780+0000 7fbb32a9e640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:44:21.281 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi144:vg_nvme/lv_4 2024-09-13T16:44:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:44:21.871 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:21 smithi094 ceph-mon[35259]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:44:21.871 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:21 smithi094 ceph-mon[35259]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T16:44:21.871 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:21.871 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:21.871 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:21 smithi094 ceph-mon[35259]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:21.888 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:21 smithi144 ceph-mon[35328]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:44:21.888 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:21 smithi144 ceph-mon[35328]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T16:44:21.888 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:21.888 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:21.888 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:21 smithi144 ceph-mon[35328]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:22.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:21 smithi018 ceph-mon[30981]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:44:22.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:21 smithi018 ceph-mon[30981]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T16:44:22.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:22.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:22.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:21 smithi018 ceph-mon[30981]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:44:22.849 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:44:22.849 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:44:22.849 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: osd.1 [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] boot 2024-09-13T16:44:22.849 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi094 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi094 to 17088M 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:22.850 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:22.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.847+0000 7fcf48b9e640 1 -- 172.21.15.144:0/3999155696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf44100910 msgr2=0x7fcf44102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.847+0000 7fcf48b9e640 1 --2- 172.21.15.144:0/3999155696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf44100910 0x7fcf44102d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009ca0 tx=0x7fcf3402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.847+0000 7fcf48b9e640 1 -- 172.21.15.144:0/3999155696 shutdown_connections 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.847+0000 7fcf48b9e640 1 --2- 172.21.15.144:0/3999155696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf44103240 0x7fcf44105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.847+0000 7fcf48b9e640 1 --2- 172.21.15.144:0/3999155696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf44105b70 0x7fcf44107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.847+0000 7fcf48b9e640 1 --2- 172.21.15.144:0/3999155696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf44100910 0x7fcf44102d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.847+0000 7fcf48b9e640 1 -- 172.21.15.144:0/3999155696 >> 172.21.15.144:0/3999155696 conn(0x7fcf440fa490 msgr2=0x7fcf440fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.847+0000 7fcf48b9e640 1 -- 172.21.15.144:0/3999155696 shutdown_connections 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.847+0000 7fcf48b9e640 1 -- 172.21.15.144:0/3999155696 wait complete. 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf48b9e640 1 Processor -- start 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf48b9e640 1 -- start start 2024-09-13T16:44:22.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf48b9e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf44100910 0x7fcf44195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf48b9e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf44103240 0x7fcf44196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf48b9e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf44105b70 0x7fcf4419d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf48b9e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4419dac0 con 0x7fcf44105b70 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf48b9e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4419dc30 con 0x7fcf44100910 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf48b9e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4419ddf0 con 0x7fcf44103240 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf41d9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf44103240 0x7fcf44196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf41d9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf44103240 0x7fcf44196500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34670/0 (socket says 172.21.15.144:34670) 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf41d9b640 1 -- 172.21.15.144:0/4069363617 learned_addr learned my addr 172.21.15.144:0/4069363617 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf4259c640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf44100910 0x7fcf44195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf41d9b640 1 -- 172.21.15.144:0/4069363617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf44100910 msgr2=0x7fcf44195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf41d9b640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf44100910 0x7fcf44195fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:22.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf41d9b640 1 -- 172.21.15.144:0/4069363617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf44105b70 msgr2=0x7fcf4419d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf41d9b640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf44105b70 0x7fcf4419d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf41d9b640 1 -- 172.21.15.144:0/4069363617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34009900 con 0x7fcf44103240 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.848+0000 7fcf41d9b640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf44103240 0x7fcf44196500 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800b450 tx=0x7fcf3800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.849+0000 7fcf337fe640 1 -- 172.21.15.144:0/4069363617 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38011890 con 0x7fcf44103240 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.849+0000 7fcf337fe640 1 -- 172.21.15.144:0/4069363617 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf380103e0 con 0x7fcf44103240 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.849+0000 7fcf337fe640 1 -- 172.21.15.144:0/4069363617 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800f5a0 con 0x7fcf44103240 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.849+0000 7fcf48b9e640 1 -- 172.21.15.144:0/4069363617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4419e0d0 con 0x7fcf44103240 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.849+0000 7fcf48b9e640 1 -- 172.21.15.144:0/4069363617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4419e580 con 0x7fcf44103240 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.850+0000 7fcf48b9e640 1 -- 172.21.15.144:0/4069363617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf440fbf80 con 0x7fcf44103240 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.851+0000 7fcf337fe640 1 -- 172.21.15.144:0/4069363617 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fcf38010850 con 0x7fcf44103240 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.852+0000 7fcf337fe640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fcf2c0a1020 0x7fcf2c0a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.852+0000 7fcf337fe640 1 -- 172.21.15.144:0/4069363617 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fcf380cb1f0 con 0x7fcf44103240 2024-09-13T16:44:22.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.852+0000 7fcf4259c640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fcf2c0a1020 0x7fcf2c0a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:22.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.852+0000 7fcf4259c640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fcf2c0a1020 0x7fcf2c0a34e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf34031c40 tx=0x7fcf34030f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:44:22.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:22.856+0000 7fcf337fe640 1 -- 172.21.15.144:0/4069363617 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcf380961d0 con 0x7fcf44103240 2024-09-13T16:44:23.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:23.024+0000 7fcf48b9e640 1 -- 172.21.15.144:0/4069363617 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf4402c4f0 con 0x7fcf2c0a1020 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: osd.1 [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] boot 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi094 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi094 to 17088M 2024-09-13T16:44:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:23.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:23.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:23.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:23.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:23.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:23.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:23.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:23.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: osd.1 [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] boot 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi094 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi094 to 17088M 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:23.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:23.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:23.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:24.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:23 smithi094 ceph-mon[35259]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T16:44:24.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:23 smithi094 ceph-mon[35259]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:44:24.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:23 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:44:24.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:23 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:44:24.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:23 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:24.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:23 smithi094 ceph-mon[35259]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:24.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:23 smithi018 ceph-mon[30981]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T16:44:24.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:23 smithi018 ceph-mon[30981]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:44:24.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:23 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:44:24.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:23 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:44:24.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:23 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:24.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:23 smithi018 ceph-mon[30981]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:24.219 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:23 smithi144 ceph-mon[35328]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T16:44:24.219 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:23 smithi144 ceph-mon[35328]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:44:24.219 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:23 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:44:24.219 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:23 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:44:24.219 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:23 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:24.219 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:23 smithi144 ceph-mon[35328]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:25.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:25 smithi144 ceph-mon[35328]: from='client.? 172.21.15.144:0/2057506768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee31be9-0cee-459c-9552-e6addad9da7c"}]: dispatch 2024-09-13T16:44:25.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:25 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee31be9-0cee-459c-9552-e6addad9da7c"}]: dispatch 2024-09-13T16:44:25.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:25 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eee31be9-0cee-459c-9552-e6addad9da7c"}]': finished 2024-09-13T16:44:25.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:25 smithi144 ceph-mon[35328]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T16:44:25.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:25 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:25.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:25 smithi018 ceph-mon[30981]: from='client.? 172.21.15.144:0/2057506768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee31be9-0cee-459c-9552-e6addad9da7c"}]: dispatch 2024-09-13T16:44:25.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:25 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee31be9-0cee-459c-9552-e6addad9da7c"}]: dispatch 2024-09-13T16:44:25.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:25 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eee31be9-0cee-459c-9552-e6addad9da7c"}]': finished 2024-09-13T16:44:25.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:25 smithi018 ceph-mon[30981]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T16:44:25.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:25 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:25.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:25 smithi094 ceph-mon[35259]: from='client.? 172.21.15.144:0/2057506768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee31be9-0cee-459c-9552-e6addad9da7c"}]: dispatch 2024-09-13T16:44:25.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:25 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee31be9-0cee-459c-9552-e6addad9da7c"}]: dispatch 2024-09-13T16:44:25.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:25 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eee31be9-0cee-459c-9552-e6addad9da7c"}]': finished 2024-09-13T16:44:25.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:25 smithi094 ceph-mon[35259]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T16:44:25.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:25 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:26.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:26 smithi018 ceph-mon[30981]: from='client.? 172.21.15.144:0/889562327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:44:26.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:26 smithi018 ceph-mon[30981]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:26.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:26 smithi144 ceph-mon[35328]: from='client.? 172.21.15.144:0/889562327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:44:26.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:26 smithi144 ceph-mon[35328]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:26.563 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:26 smithi094 ceph-mon[35259]: from='client.? 172.21.15.144:0/889562327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:44:26.563 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:26 smithi094 ceph-mon[35259]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:28 smithi144 ceph-mon[35328]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:29.099 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:28 smithi018 ceph-mon[30981]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:29.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:28 smithi094 ceph-mon[35259]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:30.986 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:30 smithi144 ceph-mon[35328]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:31.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:30 smithi094 ceph-mon[35259]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:31.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:30 smithi018 ceph-mon[30981]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:32.015 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T16:44:32.015 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:31 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:32.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T16:44:32.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:31 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:32.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T16:44:32.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:31 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:33.018 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:32 smithi144 ceph-mon[35328]: Deploying daemon osd.2 on smithi144 2024-09-13T16:44:33.018 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:32 smithi144 ceph-mon[35328]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:33.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:32 smithi094 ceph-mon[35259]: Deploying daemon osd.2 on smithi144 2024-09-13T16:44:33.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:32 smithi094 ceph-mon[35259]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:33.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:32 smithi018 ceph-mon[30981]: Deploying daemon osd.2 on smithi144 2024-09-13T16:44:33.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:32 smithi018 ceph-mon[30981]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:35.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:34 smithi144 ceph-mon[35328]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:35.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:34 smithi094 ceph-mon[35259]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:35.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:34 smithi018 ceph-mon[30981]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:37.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:36 smithi144 ceph-mon[35328]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:37.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:37.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:37.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:37.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:36 smithi094 ceph-mon[35259]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:37.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:37.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:37.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:37.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:36 smithi018 ceph-mon[30981]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:37.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:37.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:37.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:37.877 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:37 smithi144 ceph-mon[35328]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:37 smithi094 ceph-mon[35259]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:38.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:37 smithi018 ceph-mon[30981]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:39.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.593+0000 7fcf337fe640 1 -- 172.21.15.144:0/4069363617 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcf4402c4f0 con 0x7fcf2c0a1020 2024-09-13T16:44:39.594 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 2 on host 'smithi144' 2024-09-13T16:44:39.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 -- 172.21.15.144:0/4069363617 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fcf2c0a1020 msgr2=0x7fcf2c0a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fcf2c0a1020 0x7fcf2c0a34e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf34031c40 tx=0x7fcf34030f50 comp rx=0 tx=0).stop 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 -- 172.21.15.144:0/4069363617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf44103240 msgr2=0x7fcf44196500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf44103240 0x7fcf44196500 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800b450 tx=0x7fcf3800b910 comp rx=0 tx=0).stop 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 -- 172.21.15.144:0/4069363617 shutdown_connections 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fcf2c0a1020 0x7fcf2c0a34e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf44105b70 0x7fcf4419d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf44103240 0x7fcf44196500 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 --2- 172.21.15.144:0/4069363617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf44100910 0x7fcf44195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 -- 172.21.15.144:0/4069363617 >> 172.21.15.144:0/4069363617 conn(0x7fcf440fa490 msgr2=0x7fcf44102750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 -- 172.21.15.144:0/4069363617 shutdown_connections 2024-09-13T16:44:39.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:44:39.595+0000 7fcf48b9e640 1 -- 172.21.15.144:0/4069363617 wait complete. 2024-09-13T16:44:40.237 DEBUG:teuthology.orchestra.run.smithi144:osd.2> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T16:44:40.240 INFO:tasks.cephadm:Deploying osd.3 on smithi018 with /dev/vg_nvme/lv_3... 2024-09-13T16:44:40.241 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T16:44:40.522 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:40 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2[40517]: 2024-09-13T16:44:40.422+0000 7f106276a640 -1 osd.2 0 log_to_monitors true 2024-09-13T16:44:40.566 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:44:40.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:40 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:40 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:40 smithi144 ceph-mon[35328]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:40.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:40 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:40 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:40 smithi144 ceph-mon[35328]: from='osd.2 [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:44:40.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:40 smithi144 ceph-mon[35328]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:44:40.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:40 smithi018 ceph-mon[30981]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:40.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.880 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:40 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.880 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:40 smithi018 ceph-mon[30981]: from='osd.2 [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:44:40.880 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:40 smithi018 ceph-mon[30981]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:44:40.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:40 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:40 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:40 smithi094 ceph-mon[35259]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:40.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:40 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:40 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:40.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:40 smithi094 ceph-mon[35259]: from='osd.2 [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:44:40.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:40 smithi094 ceph-mon[35259]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T16:44:42.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:42 smithi018 ceph-mon[30981]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T16:44:42.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:42 smithi018 ceph-mon[30981]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T16:44:42.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:42 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:42.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:42 smithi018 ceph-mon[30981]: from='osd.2 [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:44:42.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:42 smithi018 ceph-mon[30981]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:44:42.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:42 smithi018 ceph-mon[30981]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:42.665 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:42 smithi094 ceph-mon[35259]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T16:44:42.665 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:42 smithi094 ceph-mon[35259]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T16:44:42.665 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:42 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:42.665 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:42 smithi094 ceph-mon[35259]: from='osd.2 [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:44:42.665 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:42 smithi094 ceph-mon[35259]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:44:42.665 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:42 smithi094 ceph-mon[35259]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:42.745 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:42 smithi144 ceph-mon[35328]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T16:44:42.745 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:42 smithi144 ceph-mon[35328]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T16:44:42.745 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:42 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:42.745 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:42 smithi144 ceph-mon[35328]: from='osd.2 [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:44:42.746 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:42 smithi144 ceph-mon[35328]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:44:42.746 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:42 smithi144 ceph-mon[35328]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:42.746 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2[40517]: 2024-09-13T16:44:42.345+0000 7f105e6eb640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T16:44:42.746 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2[40517]: 2024-09-13T16:44:42.349+0000 7f105a514640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:44:42.758 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T16:44:42.895 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T16:44:42.928 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-09-13T16:44:42.928 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-09-13T16:44:42.928 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0276701 s, 379 MB/s 2024-09-13T16:44:42.928 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-09-13T16:44:43.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:43 smithi094 ceph-mon[35259]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:44:43.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:43 smithi094 ceph-mon[35259]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T16:44:43.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:43 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:43.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:43 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:43.699 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:43 smithi018 ceph-mon[30981]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:44:43.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:43 smithi018 ceph-mon[30981]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T16:44:43.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:43 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:43.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:43 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:43.731 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_3 2024-09-13T16:44:43.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:43 smithi144 ceph-mon[35328]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:44:43.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:43 smithi144 ceph-mon[35328]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T16:44:43.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:43 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:43.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:43 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:44.074 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:44:44.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:44:44.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:44:44.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: osd.2 [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] boot 2024-09-13T16:44:44.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T16:44:44.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:44.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi144 2024-09-13T16:44:44.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:44.612 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:44:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:44:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:44:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: osd.2 [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] boot 2024-09-13T16:44:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T16:44:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi144 2024-09-13T16:44:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:44.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:44:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:44:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:44:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: osd.2 [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] boot 2024-09-13T16:44:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T16:44:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T16:44:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi144 2024-09-13T16:44:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T16:44:44.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:44:45.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:45 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T16:44:45.588 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:45 smithi018 ceph-mon[30981]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T16:44:45.588 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:45 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:44:45.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:45 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T16:44:45.665 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:45 smithi094 ceph-mon[35259]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T16:44:45.665 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:45 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:44:45.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:45 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T16:44:45.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:45 smithi144 ceph-mon[35328]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T16:44:45.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:45 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:44:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.014+0000 7f7b6be00640 1 -- 172.21.15.18:0/3920026732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b6c074460 msgr2=0x7f7b6c0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.014+0000 7f7b6be00640 1 --2- 172.21.15.18:0/3920026732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b6c074460 0x7f7b6c0728c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009860 tx=0x7f7b5c02a340 comp rx=0 tx=0).stop 2024-09-13T16:44:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.014+0000 7f7b6be00640 1 -- 172.21.15.18:0/3920026732 shutdown_connections 2024-09-13T16:44:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.014+0000 7f7b6be00640 1 --2- 172.21.15.18:0/3920026732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b6c107aa0 0x7f7b6c109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.014+0000 7f7b6be00640 1 --2- 172.21.15.18:0/3920026732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b6c072e00 0x7f7b6c073260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.014+0000 7f7b6be00640 1 --2- 172.21.15.18:0/3920026732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b6c074460 0x7f7b6c0728c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.014+0000 7f7b6be00640 1 -- 172.21.15.18:0/3920026732 >> 172.21.15.18:0/3920026732 conn(0x7f7b6c0fb3c0 msgr2=0x7f7b6c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:44:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.014+0000 7f7b6be00640 1 -- 172.21.15.18:0/3920026732 shutdown_connections 2024-09-13T16:44:46.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.014+0000 7f7b6be00640 1 -- 172.21.15.18:0/3920026732 wait complete. 2024-09-13T16:44:46.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.015+0000 7f7b6be00640 1 Processor -- start 2024-09-13T16:44:46.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.015+0000 7f7b6be00640 1 -- start start 2024-09-13T16:44:46.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b6c072e00 0x7f7b6c197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:46.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b6c074460 0x7f7b6c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:46.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b6c107aa0 0x7f7b6c19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c19f900 con 0x7f7b6c072e00 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6be00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c19fa70 con 0x7f7b6c107aa0 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c19fc30 con 0x7f7b6c074460 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b6c072e00 0x7f7b6c197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6b400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b6c107aa0 0x7f7b6c19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b6c072e00 0x7f7b6c197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33422/0 (socket says 172.21.15.18:33422) 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6aa00640 1 -- 172.21.15.18:0/3391278702 learned_addr learned my addr 172.21.15.18:0/3391278702 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.016+0000 7f7b6a000640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b6c074460 0x7f7b6c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.017+0000 7f7b6a000640 1 -- 172.21.15.18:0/3391278702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b6c107aa0 msgr2=0x7f7b6c19f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.017+0000 7f7b6a000640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b6c107aa0 0x7f7b6c19f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.017+0000 7f7b6a000640 1 -- 172.21.15.18:0/3391278702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b6c072e00 msgr2=0x7f7b6c197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:44:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.017+0000 7f7b6a000640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b6c072e00 0x7f7b6c197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:44:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.017+0000 7f7b6a000640 1 -- 172.21.15.18:0/3391278702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64009900 con 0x7f7b6c074460 2024-09-13T16:44:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.017+0000 7f7b6a000640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b6c074460 0x7f7b6c198340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800e9f0 tx=0x7f7b5800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:44:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.017+0000 7f7b63400640 1 -- 172.21.15.18:0/3391278702 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5800ccc0 con 0x7f7b6c074460 2024-09-13T16:44:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.017+0000 7f7b6be00640 1 -- 172.21.15.18:0/3391278702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c009490 con 0x7f7b6c074460 2024-09-13T16:44:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.017+0000 7f7b63400640 1 -- 172.21.15.18:0/3391278702 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b5800ce20 con 0x7f7b6c074460 2024-09-13T16:44:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.017+0000 7f7b63400640 1 -- 172.21.15.18:0/3391278702 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580187c0 con 0x7f7b6c074460 2024-09-13T16:44:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.018+0000 7f7b6be00640 1 -- 172.21.15.18:0/3391278702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c1a0270 con 0x7f7b6c074460 2024-09-13T16:44:46.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.019+0000 7f7b6be00640 1 -- 172.21.15.18:0/3391278702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c1068b0 con 0x7f7b6c074460 2024-09-13T16:44:46.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.022+0000 7f7b63400640 1 -- 172.21.15.18:0/3391278702 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f7b58010430 con 0x7f7b6c074460 2024-09-13T16:44:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.023+0000 7f7b63400640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b500a1010 0x7f7b500a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:44:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.023+0000 7f7b63400640 1 -- 172.21.15.18:0/3391278702 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f7b58014070 con 0x7f7b6c074460 2024-09-13T16:44:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.023+0000 7f7b6aa00640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b500a1010 0x7f7b500a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:44:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.024+0000 7f7b63400640 1 -- 172.21.15.18:0/3391278702 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7b58096810 con 0x7f7b6c074460 2024-09-13T16:44:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.024+0000 7f7b6aa00640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b500a1010 0x7f7b500a34d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c02a930 tx=0x7f7b5c0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:44:46.209 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 16:44:46 smithi018 sudo[49647]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:44:46.210 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 16:44:46 smithi018 sudo[49647]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:46.210 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 16:44:46 smithi018 sudo[49647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:46.210 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 16:44:46 smithi018 sudo[49647]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:46.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.221+0000 7f7b6be00640 1 -- 172.21.15.18:0/3391278702 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b6c02c450 con 0x7f7b500a1010 2024-09-13T16:44:46.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:44:46.418+0000 7f7b63400640 1 -- 172.21.15.18:0/3391278702 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7b58096be0 con 0x7f7b6c074460 2024-09-13T16:44:46.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:46 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:44:46.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:46 smithi018 ceph-mon[30981]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T16:44:46.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:46 smithi018 ceph-mon[30981]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:46.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:46 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:44:46.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:46 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:44:46.622 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:46 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:46.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:46 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:44:46.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:46 smithi094 ceph-mon[35259]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T16:44:46.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:46 smithi094 ceph-mon[35259]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:46.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:46 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:44:46.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:46 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:44:46.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:46 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:46.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:46 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:44:46.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:46 smithi144 ceph-mon[35328]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T16:44:46.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:46 smithi144 ceph-mon[35328]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:46.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:46 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:44:46.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:46 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:44:46.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:46 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:46.911 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 16:44:46 smithi018 sudo[49752]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:44:46.912 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 16:44:46 smithi018 sudo[49752]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:46.912 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 16:44:46 smithi018 sudo[49752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:46.912 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 16:44:46 smithi018 sudo[49752]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:47.154 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:46 smithi094 sudo[43877]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:44:47.155 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:46 smithi094 sudo[43877]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:47.155 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:46 smithi094 sudo[43877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:47.155 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:46 smithi094 sudo[43877]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:47.411 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:47 smithi094 sudo[43880]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:44:47.412 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:47 smithi094 sudo[43880]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:47.412 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:47 smithi094 sudo[43880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:47.412 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 16:44:47 smithi094 sudo[43880]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:47.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:47 smithi018 ceph-mon[30981]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:44:47.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:47 smithi018 ceph-mon[30981]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T16:44:47.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:47 smithi018 ceph-mon[30981]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T16:44:47.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:47 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:47.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:47 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:47.680 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:47 smithi144 sudo[44553]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:44:47.681 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:47 smithi144 sudo[44553]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:47.681 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:47 smithi144 sudo[44553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:47.681 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:47 smithi144 sudo[44553]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:47.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:47 smithi144 ceph-mon[35328]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:44:47.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:47 smithi144 ceph-mon[35328]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T16:44:47.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:47 smithi144 ceph-mon[35328]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T16:44:47.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:47 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:47.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:47 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:47.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:47 smithi094 ceph-mon[35259]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:44:47.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:47 smithi094 ceph-mon[35259]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T16:44:47.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:47 smithi094 ceph-mon[35259]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T16:44:47.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:47 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:47.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:47 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:48.021 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:47 smithi144 sudo[44556]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:44:48.022 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:47 smithi144 sudo[44556]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:48.022 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:47 smithi144 sudo[44556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:48.022 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 16:44:47 smithi144 sudo[44556]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:48.376 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:48 smithi018 sudo[49812]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:44:48.376 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:48 smithi018 sudo[49812]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:48.377 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:48 smithi018 sudo[49812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:48.377 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:48 smithi018 sudo[49812]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:48.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:48 smithi018 sudo[49822]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:44:48.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:48 smithi018 sudo[49822]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:48.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:48 smithi018 sudo[49822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:48.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:48 smithi018 sudo[49822]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:48.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:48.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:48 smithi018 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:44:49.100 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:49.100 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:48 smithi144 ceph-mon[35328]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:44:49.101 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 sudo[44559]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:44:49.101 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 sudo[44559]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:49.101 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 sudo[44559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:49.101 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 sudo[44559]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:49.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:44:49.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:48 smithi094 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:44:49.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 sudo[44562]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:44:49.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 sudo[44562]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:49.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 sudo[44562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:49.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 sudo[44562]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:49.838 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 sudo[43883]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T16:44:49.838 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 sudo[43883]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:49.838 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 sudo[43883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:49.838 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 sudo[43883]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:50.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:50.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:44:50.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:44:50.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:44:50.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:44:50.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:44:50.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:44:50.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:44:50.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:44:50.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:44:50.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:44:50.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:44:50.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:44:50.156 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:49 smithi018 ceph-mon[30981]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:50.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 sudo[43886]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 sudo[43886]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 sudo[43886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 sudo[43886]: pam_unix(sudo:session): session closed for user root 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:44:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:44:50.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:44:50.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:44:50.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:44:50.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:49 smithi094 ceph-mon[35259]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:50.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:50.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:44:50.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:44:50.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:44:50.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:44:50.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:44:50.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:44:50.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:44:50.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:44:50.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:44:50.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:44:50.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:44:50.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:44:50.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:49 smithi144 ceph-mon[35328]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:50 smithi094 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:44:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:50 smithi094 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:44:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:50 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/223158700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cbcd7e-845f-42fb-94eb-31432947a878"}]: dispatch 2024-09-13T16:44:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:50 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cbcd7e-845f-42fb-94eb-31432947a878"}]: dispatch 2024-09-13T16:44:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:50 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97cbcd7e-845f-42fb-94eb-31432947a878"}]': finished 2024-09-13T16:44:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:50 smithi094 ceph-mon[35259]: osdmap e22: 4 total, 3 up, 4 in 2024-09-13T16:44:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:50 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:44:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:50 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/4039070297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:44:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:50 smithi018 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:44:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:50 smithi018 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:44:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:50 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/223158700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cbcd7e-845f-42fb-94eb-31432947a878"}]: dispatch 2024-09-13T16:44:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:50 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cbcd7e-845f-42fb-94eb-31432947a878"}]: dispatch 2024-09-13T16:44:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:50 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97cbcd7e-845f-42fb-94eb-31432947a878"}]': finished 2024-09-13T16:44:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:50 smithi018 ceph-mon[30981]: osdmap e22: 4 total, 3 up, 4 in 2024-09-13T16:44:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:44:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:50 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4039070297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:44:51.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:50 smithi144 ceph-mon[35328]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T16:44:51.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:50 smithi144 ceph-mon[35328]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T16:44:51.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:50 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/223158700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cbcd7e-845f-42fb-94eb-31432947a878"}]: dispatch 2024-09-13T16:44:51.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:50 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cbcd7e-845f-42fb-94eb-31432947a878"}]: dispatch 2024-09-13T16:44:51.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:50 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97cbcd7e-845f-42fb-94eb-31432947a878"}]': finished 2024-09-13T16:44:51.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:50 smithi144 ceph-mon[35328]: osdmap e22: 4 total, 3 up, 4 in 2024-09-13T16:44:51.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:50 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:44:51.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:50 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/4039070297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:44:52.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:51 smithi094 ceph-mon[35259]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:52.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:51 smithi018 ceph-mon[30981]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:52.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:51 smithi144 ceph-mon[35328]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:44:54.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:54 smithi018 ceph-mon[30981]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-13T16:44:55.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:54 smithi144 ceph-mon[35328]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-13T16:44:55.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:54 smithi094 ceph-mon[35259]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-13T16:44:57.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:56 smithi144 ceph-mon[35328]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-13T16:44:57.382 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:56 smithi094 ceph-mon[35259]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-13T16:44:57.382 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:56 smithi018 ceph-mon[30981]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-13T16:44:58.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:58 smithi018 ceph-mon[30981]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-13T16:44:58.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T16:44:58.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:58.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:44:58 smithi018 ceph-mon[30981]: Deploying daemon osd.3 on smithi018 2024-09-13T16:44:59.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:58 smithi144 ceph-mon[35328]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-13T16:44:59.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T16:44:59.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:59.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:44:58 smithi144 ceph-mon[35328]: Deploying daemon osd.3 on smithi018 2024-09-13T16:44:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:58 smithi094 ceph-mon[35259]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-13T16:44:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T16:44:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:44:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:44:58 smithi094 ceph-mon[35259]: Deploying daemon osd.3 on smithi018 2024-09-13T16:45:01.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:00 smithi144 ceph-mon[35328]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-13T16:45:01.089 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:00 smithi018 ceph-mon[30981]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-13T16:45:01.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:00 smithi094 ceph-mon[35259]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-13T16:45:02.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:02 smithi018 ceph-mon[30981]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 110 KiB/s wr, 7 op/s 2024-09-13T16:45:03.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:02 smithi144 ceph-mon[35328]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 110 KiB/s wr, 7 op/s 2024-09-13T16:45:03.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:02 smithi094 ceph-mon[35259]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 110 KiB/s wr, 7 op/s 2024-09-13T16:45:05.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:04 smithi094 ceph-mon[35259]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-13T16:45:05.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:05.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:05.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:05.170 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:04 smithi018 ceph-mon[30981]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-13T16:45:05.170 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:05.170 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:05.170 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:05.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:04 smithi144 ceph-mon[35328]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-13T16:45:05.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:05.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:05.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:06.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:05 smithi144 ceph-mon[35328]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:45:06.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:05 smithi094 ceph-mon[35259]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:45:06.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:05 smithi018 ceph-mon[30981]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:45:08.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.907+0000 7f7b63400640 1 -- 172.21.15.18:0/3391278702 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7b6c02c450 con 0x7f7b500a1010 2024-09-13T16:45:08.909 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 3 on host 'smithi018' 2024-09-13T16:45:08.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.909+0000 7f7b6be00640 1 -- 172.21.15.18:0/3391278702 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b500a1010 msgr2=0x7f7b500a34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:08.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.909+0000 7f7b6be00640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b500a1010 0x7f7b500a34d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c02a930 tx=0x7f7b5c0058b0 comp rx=0 tx=0).stop 2024-09-13T16:45:08.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.909+0000 7f7b6be00640 1 -- 172.21.15.18:0/3391278702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b6c074460 msgr2=0x7f7b6c198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:08.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.909+0000 7f7b6be00640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b6c074460 0x7f7b6c198340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800e9f0 tx=0x7f7b5800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:45:08.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.909+0000 7f7b6be00640 1 -- 172.21.15.18:0/3391278702 shutdown_connections 2024-09-13T16:45:08.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.909+0000 7f7b6be00640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b6c107aa0 0x7f7b6c19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:08.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.909+0000 7f7b6be00640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b6c074460 0x7f7b6c198340 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:08.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.909+0000 7f7b6be00640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7b500a1010 0x7f7b500a34d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:08.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.909+0000 7f7b6be00640 1 --2- 172.21.15.18:0/3391278702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b6c072e00 0x7f7b6c197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:08.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.909+0000 7f7b6be00640 1 -- 172.21.15.18:0/3391278702 >> 172.21.15.18:0/3391278702 conn(0x7f7b6c0fb3c0 msgr2=0x7f7b6c103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:45:08.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.910+0000 7f7b6be00640 1 -- 172.21.15.18:0/3391278702 shutdown_connections 2024-09-13T16:45:08.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:45:08.910+0000 7f7b6be00640 1 -- 172.21.15.18:0/3391278702 wait complete. 2024-09-13T16:45:09.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:08 smithi144 ceph-mon[35328]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:45:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:08 smithi144 ceph-mon[35328]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T16:45:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:08 smithi094 ceph-mon[35259]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:45:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:08 smithi094 ceph-mon[35259]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T16:45:09.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:08 smithi018 ceph-mon[30981]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:45:09.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:08 smithi018 ceph-mon[30981]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T16:45:09.677 DEBUG:teuthology.orchestra.run.smithi018:osd.3> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T16:45:09.681 INFO:tasks.cephadm:Deploying osd.4 on smithi094 with /dev/vg_nvme/lv_3... 2024-09-13T16:45:09.681 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T16:45:09.886 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:45:09.928 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:09 smithi018 ceph-mon[30981]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T16:45:09.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:09 smithi018 ceph-mon[30981]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T16:45:09.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:09 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:09.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:09 smithi018 ceph-mon[30981]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:45:09.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:09 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:09.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:09 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:09 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:09.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:09 smithi018 ceph-mon[30981]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:45:10.004 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:09 smithi094 ceph-mon[35259]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T16:45:10.005 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:09 smithi094 ceph-mon[35259]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T16:45:10.005 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:09 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:10.005 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:09 smithi094 ceph-mon[35259]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:45:10.005 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:09 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:10.005 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:09 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:10.005 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:09 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:10.005 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:09 smithi094 ceph-mon[35259]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:45:10.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:09 smithi144 ceph-mon[35328]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T16:45:10.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:09 smithi144 ceph-mon[35328]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T16:45:10.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:09 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:10.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:09 smithi144 ceph-mon[35328]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:45:10.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:09 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:10.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:09 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:10.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:09 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:10.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:09 smithi144 ceph-mon[35328]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T16:45:10.710 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 16:45:10 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3[51870]: 2024-09-13T16:45:10.391+0000 7f5004800640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T16:45:10.710 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 16:45:10 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3[51870]: 2024-09-13T16:45:10.414+0000 7f4ff9e00640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:45:10.961 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:10 smithi094 ceph-mon[35259]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:45:10.961 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:10 smithi094 ceph-mon[35259]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T16:45:10.961 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:10 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:10.961 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:10 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:10.961 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:10 smithi094 ceph-mon[35259]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' 2024-09-13T16:45:11.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:10 smithi018 ceph-mon[30981]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:45:11.106 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:10 smithi018 ceph-mon[30981]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T16:45:11.106 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:10 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:11.106 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:10 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:11.106 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:10 smithi018 ceph-mon[30981]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' 2024-09-13T16:45:11.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:10 smithi144 ceph-mon[35328]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:45:11.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:10 smithi144 ceph-mon[35328]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T16:45:11.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:10 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:11.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:10 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:11.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:10 smithi144 ceph-mon[35328]: from='osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312]' entity='osd.3' 2024-09-13T16:45:11.590 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T16:45:11.680 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T16:45:11.690 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2024-09-13T16:45:11.690 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2024-09-13T16:45:11.690 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00850319 s, 1.2 GB/s 2024-09-13T16:45:11.690 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2024-09-13T16:45:11.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:11 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:45:11.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:11 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:45:11.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:11 smithi094 ceph-mon[35259]: osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] boot 2024-09-13T16:45:11.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:11 smithi094 ceph-mon[35259]: osdmap e25: 4 total, 4 up, 4 in 2024-09-13T16:45:11.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:11.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:11 smithi094 ceph-mon[35259]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:11.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:11 smithi094 ceph-mon[35259]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T16:45:11.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:11 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:45:11.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:11 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:45:11.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:11 smithi018 ceph-mon[30981]: osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] boot 2024-09-13T16:45:11.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:11 smithi018 ceph-mon[30981]: osdmap e25: 4 total, 4 up, 4 in 2024-09-13T16:45:11.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:11.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:11 smithi018 ceph-mon[30981]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:11.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:11 smithi018 ceph-mon[30981]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T16:45:12.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:11 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:45:12.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:11 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:45:12.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:11 smithi144 ceph-mon[35328]: osd.3 [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] boot 2024-09-13T16:45:12.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:11 smithi144 ceph-mon[35328]: osdmap e25: 4 total, 4 up, 4 in 2024-09-13T16:45:12.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T16:45:12.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:11 smithi144 ceph-mon[35328]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:12.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:11 smithi144 ceph-mon[35328]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T16:45:12.364 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi094:vg_nvme/lv_3 2024-09-13T16:45:12.555 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:45:13.853 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:13 smithi094 ceph-mon[35259]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T16:45:13.853 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:13 smithi094 ceph-mon[35259]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.061+0000 7fbefb64e640 1 -- 172.21.15.94:0/1819567519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbef4100f60 msgr2=0x7fbef41013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.061+0000 7fbefb64e640 1 --2- 172.21.15.94:0/1819567519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbef4100f60 0x7fbef41013e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009900 tx=0x7fbef002a410 comp rx=0 tx=0).stop 2024-09-13T16:45:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.061+0000 7fbefb64e640 1 -- 172.21.15.94:0/1819567519 shutdown_connections 2024-09-13T16:45:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.061+0000 7fbefb64e640 1 --2- 172.21.15.94:0/1819567519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbef4101920 0x7fbef4108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.061+0000 7fbefb64e640 1 --2- 172.21.15.94:0/1819567519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbef4100f60 0x7fbef41013e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.061+0000 7fbefb64e640 1 --2- 172.21.15.94:0/1819567519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbef40ffe00 0x7fbef4100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.061+0000 7fbefb64e640 1 -- 172.21.15.94:0/1819567519 >> 172.21.15.94:0/1819567519 conn(0x7fbef40fb5b0 msgr2=0x7fbef40fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:45:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.061+0000 7fbefb64e640 1 -- 172.21.15.94:0/1819567519 shutdown_connections 2024-09-13T16:45:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.061+0000 7fbefb64e640 1 -- 172.21.15.94:0/1819567519 wait complete. 2024-09-13T16:45:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbefb64e640 1 Processor -- start 2024-09-13T16:45:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbefb64e640 1 -- start start 2024-09-13T16:45:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbefb64e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbef40ffe00 0x7fbef4195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:45:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbefb64e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbef4100f60 0x7fbef41962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:45:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbefb64e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbef4101920 0x7fbef419d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:45:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbefb64e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef419d860 con 0x7fbef4101920 2024-09-13T16:45:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbefb64e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef419d9d0 con 0x7fbef40ffe00 2024-09-13T16:45:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbefb64e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef419db90 con 0x7fbef4100f60 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef93ea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbef40ffe00 0x7fbef4195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef93ea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbef40ffe00 0x7fbef4195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33232/0 (socket says 172.21.15.94:33232) 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef93ea640 1 -- 172.21.15.94:0/2015202091 learned_addr learned my addr 172.21.15.94:0/2015202091 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef9beb640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbef4101920 0x7fbef419d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef8be9640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbef4100f60 0x7fbef41962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef93ea640 1 -- 172.21.15.94:0/2015202091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbef4100f60 msgr2=0x7fbef41962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef93ea640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbef4100f60 0x7fbef41962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef93ea640 1 -- 172.21.15.94:0/2015202091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbef4101920 msgr2=0x7fbef419d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef93ea640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbef4101920 0x7fbef419d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef93ea640 1 -- 172.21.15.94:0/2015202091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef0009560 con 0x7fbef40ffe00 2024-09-13T16:45:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbef93ea640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbef40ffe00 0x7fbef4195d60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbee400d950 tx=0x7fbee400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:45:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.062+0000 7fbeea7fc640 1 -- 172.21.15.94:0/2015202091 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4009a30 con 0x7fbef40ffe00 2024-09-13T16:45:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.063+0000 7fbeea7fc640 1 -- 172.21.15.94:0/2015202091 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbee4009b90 con 0x7fbef40ffe00 2024-09-13T16:45:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.063+0000 7fbeea7fc640 1 -- 172.21.15.94:0/2015202091 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee40047a0 con 0x7fbef40ffe00 2024-09-13T16:45:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.063+0000 7fbefb64e640 1 -- 172.21.15.94:0/2015202091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef419de70 con 0x7fbef40ffe00 2024-09-13T16:45:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.063+0000 7fbefb64e640 1 -- 172.21.15.94:0/2015202091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef419e280 con 0x7fbef40ffe00 2024-09-13T16:45:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.064+0000 7fbefb64e640 1 -- 172.21.15.94:0/2015202091 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef4107290 con 0x7fbef40ffe00 2024-09-13T16:45:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.065+0000 7fbeea7fc640 1 -- 172.21.15.94:0/2015202091 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbee4009d00 con 0x7fbef40ffe00 2024-09-13T16:45:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.066+0000 7fbeea7fc640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbee00a1130 0x7fbee00a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:45:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.066+0000 7fbeea7fc640 1 -- 172.21.15.94:0/2015202091 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3669+0+0 (secure 0 0 0) 0x7fbee40cb870 con 0x7fbef40ffe00 2024-09-13T16:45:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.067+0000 7fbef8be9640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbee00a1130 0x7fbee00a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:45:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.067+0000 7fbef8be9640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbee00a1130 0x7fbee00a35f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbef0006010 tx=0x7fbef00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:45:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.069+0000 7fbeea7fc640 1 -- 172.21.15.94:0/2015202091 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbee40962a0 con 0x7fbef40ffe00 2024-09-13T16:45:14.091 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:13 smithi018 ceph-mon[30981]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T16:45:14.091 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:13 smithi018 ceph-mon[30981]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:14.240+0000 7fbefb64e640 1 -- 172.21.15.94:0/2015202091 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbef402c560 con 0x7fbee00a1130 2024-09-13T16:45:14.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:13 smithi144 ceph-mon[35328]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T16:45:14.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:13 smithi144 ceph-mon[35328]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi018 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi018 to 8547M 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:14.884 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:14.885 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:45:14.885 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:45:14.885 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:45:14.885 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T16:45:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi018 2024-09-13T16:45:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi018 to 8547M 2024-09-13T16:45:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:15.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:15.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:45:15.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:45:15.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:45:15.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T16:45:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi018 2024-09-13T16:45:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi018 to 8547M 2024-09-13T16:45:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:45:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:45:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:45:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:16.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:15 smithi094 ceph-mon[35259]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T16:45:16.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:15 smithi094 ceph-mon[35259]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:16.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:15 smithi018 ceph-mon[30981]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T16:45:16.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:15 smithi018 ceph-mon[30981]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:16.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:15 smithi144 ceph-mon[35328]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T16:45:16.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:15 smithi144 ceph-mon[35328]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:17.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:16 smithi094 ceph-mon[35259]: from='client.? 172.21.15.94:0/3844432948' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b8a6a63-ece3-4271-92f5-a301abae658c"}]: dispatch 2024-09-13T16:45:17.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:16 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b8a6a63-ece3-4271-92f5-a301abae658c"}]: dispatch 2024-09-13T16:45:17.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:16 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b8a6a63-ece3-4271-92f5-a301abae658c"}]': finished 2024-09-13T16:45:17.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:16 smithi094 ceph-mon[35259]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T16:45:17.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:16 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:17.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:16 smithi018 ceph-mon[30981]: from='client.? 172.21.15.94:0/3844432948' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b8a6a63-ece3-4271-92f5-a301abae658c"}]: dispatch 2024-09-13T16:45:17.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:16 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b8a6a63-ece3-4271-92f5-a301abae658c"}]: dispatch 2024-09-13T16:45:17.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:16 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b8a6a63-ece3-4271-92f5-a301abae658c"}]': finished 2024-09-13T16:45:17.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:16 smithi018 ceph-mon[30981]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T16:45:17.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:16 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:17.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:16 smithi144 ceph-mon[35328]: from='client.? 172.21.15.94:0/3844432948' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b8a6a63-ece3-4271-92f5-a301abae658c"}]: dispatch 2024-09-13T16:45:17.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:16 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b8a6a63-ece3-4271-92f5-a301abae658c"}]: dispatch 2024-09-13T16:45:17.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:16 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b8a6a63-ece3-4271-92f5-a301abae658c"}]': finished 2024-09-13T16:45:17.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:16 smithi144 ceph-mon[35328]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T16:45:17.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:16 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:18.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:17 smithi018 ceph-mon[30981]: from='client.? 172.21.15.94:0/3404684568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:45:18.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:17 smithi018 ceph-mon[30981]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-13T16:45:18.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:17 smithi094 ceph-mon[35259]: from='client.? 172.21.15.94:0/3404684568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:45:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:17 smithi094 ceph-mon[35259]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-13T16:45:18.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:17 smithi144 ceph-mon[35328]: from='client.? 172.21.15.94:0/3404684568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:45:18.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:17 smithi144 ceph-mon[35328]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-13T16:45:21.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:20 smithi144 ceph-mon[35328]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:45:21.046 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:20 smithi094 ceph-mon[35259]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:45:21.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:20 smithi018 ceph-mon[30981]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:45:22.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:22 smithi094 ceph-mon[35259]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-13T16:45:23.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:22 smithi144 ceph-mon[35328]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-13T16:45:23.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:22 smithi018 ceph-mon[30981]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-13T16:45:23.967 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:23 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T16:45:23.968 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:23 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:24.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:23 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T16:45:24.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:23 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:24.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:23 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T16:45:24.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:23 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:25.043 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:24 smithi094 ceph-mon[35259]: Deploying daemon osd.4 on smithi094 2024-09-13T16:45:25.043 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:24 smithi094 ceph-mon[35259]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-13T16:45:25.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:24 smithi144 ceph-mon[35328]: Deploying daemon osd.4 on smithi094 2024-09-13T16:45:25.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:24 smithi144 ceph-mon[35328]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-13T16:45:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:24 smithi018 ceph-mon[30981]: Deploying daemon osd.4 on smithi094 2024-09-13T16:45:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:24 smithi018 ceph-mon[30981]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-13T16:45:25.972 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:25 smithi094 ceph-mon[35259]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:45:26.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:25 smithi018 ceph-mon[30981]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:45:26.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:25 smithi144 ceph-mon[35328]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T16:45:29.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:28 smithi144 ceph-mon[35328]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-13T16:45:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:29.045 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:28 smithi094 ceph-mon[35259]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-13T16:45:29.046 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:29.046 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:29.046 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:29.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:28 smithi018 ceph-mon[30981]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-13T16:45:29.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:29.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:29.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:30.886 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:30 smithi094 ceph-mon[35259]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:31.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:30 smithi144 ceph-mon[35328]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:31.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:30 smithi018 ceph-mon[30981]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:31.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.780+0000 7fbeea7fc640 1 -- 172.21.15.94:0/2015202091 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbef402c560 con 0x7fbee00a1130 2024-09-13T16:45:31.782 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 4 on host 'smithi094' 2024-09-13T16:45:31.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 -- 172.21.15.94:0/2015202091 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbee00a1130 msgr2=0x7fbee00a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:31.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbee00a1130 0x7fbee00a35f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbef0006010 tx=0x7fbef00314a0 comp rx=0 tx=0).stop 2024-09-13T16:45:31.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 -- 172.21.15.94:0/2015202091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbef40ffe00 msgr2=0x7fbef4195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:31.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbef40ffe00 0x7fbef4195d60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbee400d950 tx=0x7fbee400de10 comp rx=0 tx=0).stop 2024-09-13T16:45:31.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 -- 172.21.15.94:0/2015202091 shutdown_connections 2024-09-13T16:45:31.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbee00a1130 0x7fbee00a35f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:31.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbef4101920 0x7fbef419d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:31.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbef4100f60 0x7fbef41962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:31.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 --2- 172.21.15.94:0/2015202091 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbef40ffe00 0x7fbef4195d60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:31.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 -- 172.21.15.94:0/2015202091 >> 172.21.15.94:0/2015202091 conn(0x7fbef40fb5b0 msgr2=0x7fbef4104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:45:31.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 -- 172.21.15.94:0/2015202091 shutdown_connections 2024-09-13T16:45:31.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:45:31.783+0000 7fbefb64e640 1 -- 172.21.15.94:0/2015202091 wait complete. 2024-09-13T16:45:32.395 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.395 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.395 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:32.395 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:32.396 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.396 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:32 smithi094 ceph-mon[35259]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:32.396 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:32.396 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.396 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.417 DEBUG:teuthology.orchestra.run.smithi094:osd.4> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T16:45:32.420 INFO:tasks.cephadm:Deploying osd.5 on smithi144 with /dev/vg_nvme/lv_3... 2024-09-13T16:45:32.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T16:45:32.449 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.449 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.449 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:32.449 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:32.449 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.449 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:32 smithi144 ceph-mon[35328]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:32.449 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:32.449 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.449 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:32 smithi018 ceph-mon[30981]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:32.626 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:45:33.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:33 smithi144 ceph-mon[35328]: from='osd.4 [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:45:33.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:33 smithi144 ceph-mon[35328]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:45:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:33 smithi094 ceph-mon[35259]: from='osd.4 [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:45:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:33 smithi094 ceph-mon[35259]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:45:33.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:33 smithi018 ceph-mon[30981]: from='osd.4 [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:45:33.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:33 smithi018 ceph-mon[30981]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T16:45:34.283 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T16:45:34.308 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:34 smithi144 ceph-mon[35328]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T16:45:34.308 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:34 smithi144 ceph-mon[35328]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T16:45:34.308 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:34.308 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:34 smithi144 ceph-mon[35328]: from='osd.4 [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:45:34.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:34 smithi144 ceph-mon[35328]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:45:34.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:34 smithi144 ceph-mon[35328]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:34.368 INFO:teuthology.orchestra.run.smithi144.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T16:45:34.381 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10+0 records in 2024-09-13T16:45:34.381 INFO:teuthology.orchestra.run.smithi144.stderr:10+0 records out 2024-09-13T16:45:34.381 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115048 s, 911 MB/s 2024-09-13T16:45:34.381 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping successful for: 2024-09-13T16:45:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:34 smithi094 ceph-mon[35259]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T16:45:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:34 smithi094 ceph-mon[35259]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T16:45:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:34 smithi094 ceph-mon[35259]: from='osd.4 [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:45:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:34 smithi094 ceph-mon[35259]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:45:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:34 smithi094 ceph-mon[35259]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:34.412 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 16:45:34 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4[46665]: 2024-09-13T16:45:34.142+0000 7feabbe8f640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T16:45:34.413 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 16:45:34 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4[46665]: 2024-09-13T16:45:34.148+0000 7feab7cb8640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:45:34.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:34 smithi018 ceph-mon[30981]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T16:45:34.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:34 smithi018 ceph-mon[30981]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T16:45:34.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:34.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:34 smithi018 ceph-mon[30981]: from='osd.4 [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:45:34.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:34 smithi018 ceph-mon[30981]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:45:34.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:34 smithi018 ceph-mon[30981]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:35.169 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi144:vg_nvme/lv_3 2024-09-13T16:45:35.396 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:35 smithi094 ceph-mon[35259]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:45:35.396 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:35 smithi094 ceph-mon[35259]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T16:45:35.396 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:35 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:35.396 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:35 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:35.405 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:45:35.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:35 smithi018 ceph-mon[30981]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:45:35.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:35 smithi018 ceph-mon[30981]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T16:45:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:35 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:35 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:35 smithi144 ceph-mon[35328]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:45:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:35 smithi144 ceph-mon[35328]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T16:45:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:35 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:35.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:35 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:45:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:45:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: osd.4 [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] boot 2024-09-13T16:45:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T16:45:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi094 2024-09-13T16:45:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:36.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:36.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi094 to 8544M 2024-09-13T16:45:36.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:36.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:36.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:36 smithi094 ceph-mon[35259]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:36.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:45:36.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:45:36.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: osd.4 [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] boot 2024-09-13T16:45:36.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T16:45:36.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:36.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi094 2024-09-13T16:45:36.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:36.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:36.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi094 to 8544M 2024-09-13T16:45:36.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:36.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:36.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:36 smithi018 ceph-mon[30981]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:36.462 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:45:36.462 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:45:36.462 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: osd.4 [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] boot 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi094 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi094 to 8544M 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:36.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:36 smithi144 ceph-mon[35328]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T16:45:36.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.946+0000 7f8196466640 1 -- 172.21.15.144:0/527783342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8190100890 msgr2=0x7f8190107120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:36.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.946+0000 7f8196466640 1 --2- 172.21.15.144:0/527783342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8190100890 0x7f8190107120 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8188009ca0 tx=0x7f818802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:45:36.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.946+0000 7f8196466640 1 -- 172.21.15.144:0/527783342 shutdown_connections 2024-09-13T16:45:36.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.946+0000 7f8196466640 1 --2- 172.21.15.144:0/527783342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81900ffed0 0x7f8190100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:36.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.946+0000 7f8196466640 1 --2- 172.21.15.144:0/527783342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8190100890 0x7f8190107120 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:36.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.946+0000 7f8196466640 1 --2- 172.21.15.144:0/527783342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81900fecd0 0x7f81900ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:36.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.946+0000 7f8196466640 1 -- 172.21.15.144:0/527783342 >> 172.21.15.144:0/527783342 conn(0x7f81900fa480 msgr2=0x7f81900fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:45:36.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.946+0000 7f8196466640 1 -- 172.21.15.144:0/527783342 shutdown_connections 2024-09-13T16:45:36.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.946+0000 7f8196466640 1 -- 172.21.15.144:0/527783342 wait complete. 2024-09-13T16:45:36.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8196466640 1 Processor -- start 2024-09-13T16:45:36.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8196466640 1 -- start start 2024-09-13T16:45:36.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8196466640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81900fecd0 0x7f8190102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:45:36.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8196466640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81900ffed0 0x7f81901012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:45:36.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8196466640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8190100890 0x7f81901017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:45:36.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8196466640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190101f80 con 0x7f81900ffed0 2024-09-13T16:45:36.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8196466640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81901020f0 con 0x7f81900fecd0 2024-09-13T16:45:36.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8196466640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819019fe10 con 0x7f8190100890 2024-09-13T16:45:36.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8194a03640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8190100890 0x7f81901017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:45:36.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8194a03640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8190100890 0x7f81901017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46750/0 (socket says 172.21.15.144:46750) 2024-09-13T16:45:36.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f8194a03640 1 -- 172.21.15.144:0/1390387183 learned_addr learned my addr 172.21.15.144:0/1390387183 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:45:36.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f818ffff640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81900fecd0 0x7f8190102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:45:36.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.947+0000 7f818f7fe640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81900ffed0 0x7f81901012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:45:36.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f8194a03640 1 -- 172.21.15.144:0/1390387183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81900fecd0 msgr2=0x7f8190102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:36.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f8194a03640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81900fecd0 0x7f8190102c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:36.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f8194a03640 1 -- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81900ffed0 msgr2=0x7f81901012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:36.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f8194a03640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81900ffed0 0x7f81901012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:36.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f8194a03640 1 -- 172.21.15.144:0/1390387183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8188009900 con 0x7f8190100890 2024-09-13T16:45:36.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f818f7fe640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81900ffed0 0x7f81901012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:45:36.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f8194a03640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8190100890 0x7f81901017f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8188003ba0 tx=0x7f8188003bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:45:36.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f818d7fa640 1 -- 172.21.15.144:0/1390387183 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818802f310 con 0x7f8190100890 2024-09-13T16:45:36.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f8196466640 1 -- 172.21.15.144:0/1390387183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81901a0060 con 0x7f8190100890 2024-09-13T16:45:36.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f818d7fa640 1 -- 172.21.15.144:0/1390387183 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8188040070 con 0x7f8190100890 2024-09-13T16:45:36.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f818d7fa640 1 -- 172.21.15.144:0/1390387183 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8188004620 con 0x7f8190100890 2024-09-13T16:45:36.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.948+0000 7f8196466640 1 -- 172.21.15.144:0/1390387183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81901a0630 con 0x7f8190100890 2024-09-13T16:45:36.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.949+0000 7f8196466640 1 -- 172.21.15.144:0/1390387183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819010a5f0 con 0x7f8190100890 2024-09-13T16:45:36.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.950+0000 7f818d7fa640 1 -- 172.21.15.144:0/1390387183 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8188042030 con 0x7f8190100890 2024-09-13T16:45:36.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.951+0000 7f818d7fa640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f817c0a1080 0x7f817c0a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:45:36.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.951+0000 7f818d7fa640 1 -- 172.21.15.144:0/1390387183 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f81880ed090 con 0x7f8190100890 2024-09-13T16:45:36.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.952+0000 7f818ffff640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f817c0a1080 0x7f817c0a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:45:36.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.952+0000 7f818ffff640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f817c0a1080 0x7f817c0a3540 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81900ffd30 tx=0x7f818000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:45:36.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:36.956+0000 7f818d7fa640 1 -- 172.21.15.144:0/1390387183 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f81880b77f0 con 0x7f8190100890 2024-09-13T16:45:37.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:37.129+0000 7f8196466640 1 -- 172.21.15.144:0/1390387183 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8190068f20 con 0x7f817c0a1080 2024-09-13T16:45:37.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:37 smithi094 ceph-mon[35259]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T16:45:37.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:37 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:45:37.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:37 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:45:37.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:37 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:37.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:37 smithi018 ceph-mon[30981]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T16:45:37.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:37 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:45:37.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:37 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:45:37.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:37 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:37.490 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:37 smithi144 ceph-mon[35328]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T16:45:37.491 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:37 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:45:37.491 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:37 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:45:37.491 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:37 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:38.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:38 smithi018 ceph-mon[30981]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:45:38.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:38 smithi018 ceph-mon[30981]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:38.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:38 smithi144 ceph-mon[35328]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:45:38.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:38 smithi144 ceph-mon[35328]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:38.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:38 smithi094 ceph-mon[35259]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:45:38.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:38 smithi094 ceph-mon[35259]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:39.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:39 smithi094 ceph-mon[35259]: from='client.? 172.21.15.144:0/2026015309' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f93581d-1da2-4ff7-a4ae-81991f10c2d3"}]: dispatch 2024-09-13T16:45:39.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:39 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f93581d-1da2-4ff7-a4ae-81991f10c2d3"}]: dispatch 2024-09-13T16:45:39.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:39 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f93581d-1da2-4ff7-a4ae-81991f10c2d3"}]': finished 2024-09-13T16:45:39.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:39 smithi094 ceph-mon[35259]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T16:45:39.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:39 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:39.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:39 smithi144 ceph-mon[35328]: from='client.? 172.21.15.144:0/2026015309' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f93581d-1da2-4ff7-a4ae-81991f10c2d3"}]: dispatch 2024-09-13T16:45:39.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:39 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f93581d-1da2-4ff7-a4ae-81991f10c2d3"}]: dispatch 2024-09-13T16:45:39.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:39 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f93581d-1da2-4ff7-a4ae-81991f10c2d3"}]': finished 2024-09-13T16:45:39.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:39 smithi144 ceph-mon[35328]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T16:45:39.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:39 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:39.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:39 smithi018 ceph-mon[30981]: from='client.? 172.21.15.144:0/2026015309' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f93581d-1da2-4ff7-a4ae-81991f10c2d3"}]: dispatch 2024-09-13T16:45:39.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:39 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f93581d-1da2-4ff7-a4ae-81991f10c2d3"}]: dispatch 2024-09-13T16:45:39.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:39 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f93581d-1da2-4ff7-a4ae-81991f10c2d3"}]': finished 2024-09-13T16:45:39.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:39 smithi018 ceph-mon[30981]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T16:45:39.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:39 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:40.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:40 smithi094 ceph-mon[35259]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:40.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:40 smithi094 ceph-mon[35259]: from='client.? 172.21.15.144:0/348451924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:45:40.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:40 smithi018 ceph-mon[30981]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:40.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:40 smithi018 ceph-mon[30981]: from='client.? 172.21.15.144:0/348451924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:45:41.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:40 smithi144 ceph-mon[35328]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:41.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:40 smithi144 ceph-mon[35328]: from='client.? 172.21.15.144:0/348451924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:45:43.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:42 smithi144 ceph-mon[35328]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:43.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:42 smithi094 ceph-mon[35259]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:43.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:42 smithi018 ceph-mon[30981]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:45.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:44 smithi144 ceph-mon[35328]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:45.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:44 smithi094 ceph-mon[35259]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:45.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:44 smithi018 ceph-mon[30981]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:47.056 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:46 smithi144 ceph-mon[35328]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:47.056 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:46 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T16:45:47.056 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:46 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:47.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:46 smithi094 ceph-mon[35259]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:47.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:46 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T16:45:47.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:46 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:47.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:46 smithi018 ceph-mon[30981]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:47.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:46 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T16:45:47.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:46 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:48.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:47 smithi144 ceph-mon[35328]: Deploying daemon osd.5 on smithi144 2024-09-13T16:45:48.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:47 smithi018 ceph-mon[30981]: Deploying daemon osd.5 on smithi144 2024-09-13T16:45:48.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:47 smithi094 ceph-mon[35259]: Deploying daemon osd.5 on smithi144 2024-09-13T16:45:49.149 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:48 smithi144 ceph-mon[35328]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:49.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:48 smithi094 ceph-mon[35259]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:49.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:48 smithi018 ceph-mon[30981]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:50.072 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:49 smithi144 ceph-mon[35328]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:50.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:49 smithi094 ceph-mon[35259]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:50.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:49 smithi018 ceph-mon[30981]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:51.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:51.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:51.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:51.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:51.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:51.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:51.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:51.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:51.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:52.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:52 smithi144 ceph-mon[35328]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:52.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:52 smithi094 ceph-mon[35259]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:52.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:52 smithi018 ceph-mon[30981]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:54.863 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:54 smithi144 ceph-mon[35328]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:54.863 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:54.863 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:54.863 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:54.863 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:54.863 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:54.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.895+0000 7f818d7fa640 1 -- 172.21.15.144:0/1390387183 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8190068f20 con 0x7f817c0a1080 2024-09-13T16:45:54.897 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 5 on host 'smithi144' 2024-09-13T16:45:54.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 -- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f817c0a1080 msgr2=0x7f817c0a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:54.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f817c0a1080 0x7f817c0a3540 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81900ffd30 tx=0x7f818000b390 comp rx=0 tx=0).stop 2024-09-13T16:45:54.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 -- 172.21.15.144:0/1390387183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8190100890 msgr2=0x7f81901017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:45:54.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8190100890 0x7f81901017f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8188003ba0 tx=0x7f8188003bd0 comp rx=0 tx=0).stop 2024-09-13T16:45:54.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 -- 172.21.15.144:0/1390387183 shutdown_connections 2024-09-13T16:45:54.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f817c0a1080 0x7f817c0a3540 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:54.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81900ffed0 0x7f81901012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:54.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8190100890 0x7f81901017f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:54.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 --2- 172.21.15.144:0/1390387183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81900fecd0 0x7f8190102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:45:54.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 -- 172.21.15.144:0/1390387183 >> 172.21.15.144:0/1390387183 conn(0x7f81900fa480 msgr2=0x7f8190068810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:45:54.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 -- 172.21.15.144:0/1390387183 shutdown_connections 2024-09-13T16:45:54.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:45:54.897+0000 7f8196466640 1 -- 172.21.15.144:0/1390387183 wait complete. 2024-09-13T16:45:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:54 smithi094 ceph-mon[35259]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:55.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:54 smithi018 ceph-mon[30981]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:55.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:55.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:55.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:55.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:55.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:55.546 DEBUG:teuthology.orchestra.run.smithi144:osd.5> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T16:45:55.549 INFO:tasks.cephadm:Deploying osd.6 on smithi018 with /dev/vg_nvme/lv_2... 2024-09-13T16:45:55.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T16:45:55.872 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:45:55.884 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:55 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:55.884 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:55 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:55.884 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:55 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:55.884 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:55 smithi144 ceph-mon[35328]: from='osd.5 [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:45:55.884 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:55 smithi144 ceph-mon[35328]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:45:55.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:55 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:55.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:55 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:55.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:55 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:55.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:55 smithi018 ceph-mon[30981]: from='osd.5 [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:45:55.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:55 smithi018 ceph-mon[30981]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:45:56.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:55 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:45:56.064 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:55 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:56.064 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:55 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:56.064 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:55 smithi094 ceph-mon[35259]: from='osd.5 [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:45:56.064 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:55 smithi094 ceph-mon[35259]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T16:45:56.929 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:56 smithi144 ceph-mon[35328]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:56.929 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:56 smithi144 ceph-mon[35328]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T16:45:56.929 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:56 smithi144 ceph-mon[35328]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T16:45:56.929 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:56 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:56.930 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:56 smithi144 ceph-mon[35328]: from='osd.5 [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:45:56.930 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:56 smithi144 ceph-mon[35328]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:45:56.930 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 16:45:56 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T16:45:56.908+0000 7f5117f85640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T16:45:56.930 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 16:45:56 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T16:45:56.918+0000 7f5113dae640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:45:57.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:56 smithi018 ceph-mon[30981]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:57.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:56 smithi018 ceph-mon[30981]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T16:45:57.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:56 smithi018 ceph-mon[30981]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T16:45:57.059 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:56 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:57.060 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:56 smithi018 ceph-mon[30981]: from='osd.5 [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:45:57.060 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:56 smithi018 ceph-mon[30981]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:45:57.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:56 smithi094 ceph-mon[35259]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:57.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:56 smithi094 ceph-mon[35259]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T16:45:57.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:56 smithi094 ceph-mon[35259]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T16:45:57.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:56 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:57.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:56 smithi094 ceph-mon[35259]: from='osd.5 [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:45:57.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:56 smithi094 ceph-mon[35259]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:45:57.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:57 smithi018 ceph-mon[30981]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:45:57.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:57 smithi018 ceph-mon[30981]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T16:45:57.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:57 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:57 smithi094 ceph-mon[35259]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:45:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:57 smithi094 ceph-mon[35259]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T16:45:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:57 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:57 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:57 smithi094 ceph-mon[35259]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:58.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:57 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:58.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:57 smithi018 ceph-mon[30981]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:58.215 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:57 smithi144 ceph-mon[35328]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:45:58.215 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:57 smithi144 ceph-mon[35328]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T16:45:58.215 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:57 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:58.215 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:57 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:58.215 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:57 smithi144 ceph-mon[35328]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T16:45:58.361 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T16:45:58.491 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T16:45:58.524 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-09-13T16:45:58.525 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-09-13T16:45:58.525 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.028278 s, 371 MB/s 2024-09-13T16:45:58.525 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-09-13T16:45:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:45:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:45:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: osd.5 [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] boot 2024-09-13T16:45:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T16:45:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi144 2024-09-13T16:45:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:59.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:59.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-13T16:45:59.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:59.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:59.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: osd.5 [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] boot 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi144 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-13T16:45:59.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:59.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:59.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:45:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:45:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: osd.5 [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] boot 2024-09-13T16:45:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T16:45:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T16:45:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi144 2024-09-13T16:45:59.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:59.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:45:59.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-13T16:45:59.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:45:59.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:45:59.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:45:59.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_2 2024-09-13T16:45:59.681 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:46:00.123 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:59 smithi018 ceph-mon[30981]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T16:46:00.123 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:45:59 smithi018 ceph-mon[30981]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:00.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:59 smithi144 ceph-mon[35328]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T16:46:00.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:45:59 smithi144 ceph-mon[35328]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:00.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:59 smithi094 ceph-mon[35259]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T16:46:00.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:45:59 smithi094 ceph-mon[35259]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:01.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:00 smithi018 ceph-mon[30981]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T16:46:01.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:00 smithi144 ceph-mon[35328]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T16:46:01.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:00 smithi094 ceph-mon[35259]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T16:46:01.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.593+0000 7f70c5000640 1 -- 172.21.15.18:0/2252938710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c0101e50 msgr2=0x7f70c0102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:01.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.593+0000 7f70c5000640 1 --2- 172.21.15.18:0/2252938710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c0101e50 0x7f70c0102250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009900 tx=0x7f70b002a410 comp rx=0 tx=0).stop 2024-09-13T16:46:01.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.593+0000 7f70c5000640 1 -- 172.21.15.18:0/2252938710 shutdown_connections 2024-09-13T16:46:01.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.593+0000 7f70c5000640 1 --2- 172.21.15.18:0/2252938710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70c0103970 0x7f70c010a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:01.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.593+0000 7f70c5000640 1 --2- 172.21.15.18:0/2252938710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c0102fb0 0x7f70c0103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:01.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.593+0000 7f70c5000640 1 --2- 172.21.15.18:0/2252938710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c0101e50 0x7f70c0102250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.593+0000 7f70c5000640 1 -- 172.21.15.18:0/2252938710 >> 172.21.15.18:0/2252938710 conn(0x7f70c00fd5e0 msgr2=0x7f70c00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.593+0000 7f70c5000640 1 -- 172.21.15.18:0/2252938710 shutdown_connections 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.593+0000 7f70c5000640 1 -- 172.21.15.18:0/2252938710 wait complete. 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.594+0000 7f70c5000640 1 Processor -- start 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70c5000640 1 -- start start 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70c5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c0101e50 0x7f70c0197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70c5000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c0102fb0 0x7f70c0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70c5000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70c0103970 0x7f70c019f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70c5000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c019f8d0 con 0x7f70c0102fb0 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70c5000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c019fa40 con 0x7f70c0103970 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70c5000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c019fc00 con 0x7f70c0101e50 2024-09-13T16:46:01.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70b6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c0102fb0 0x7f70c0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70b6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c0102fb0 0x7f70c0198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45744/0 (socket says 172.21.15.18:45744) 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70b6a00640 1 -- 172.21.15.18:0/2789923369 learned_addr learned my addr 172.21.15.18:0/2789923369 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70bf400640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c0101e50 0x7f70c0197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.595+0000 7f70bfe00640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70c0103970 0x7f70c019f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70b6a00640 1 -- 172.21.15.18:0/2789923369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c0101e50 msgr2=0x7f70c0197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70b6a00640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c0101e50 0x7f70c0197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70b6a00640 1 -- 172.21.15.18:0/2789923369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70c0103970 msgr2=0x7f70c019f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70b6a00640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70c0103970 0x7f70c019f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70b6a00640 1 -- 172.21.15.18:0/2789923369 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b0009560 con 0x7f70c0102fb0 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70b6a00640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c0102fb0 0x7f70c0198360 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f70a800d770 tx=0x7f70a800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70bcc00640 1 -- 172.21.15.18:0/2789923369 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8009c30 con 0x7f70c0102fb0 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70bcc00640 1 -- 172.21.15.18:0/2789923369 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70a800de80 con 0x7f70c0102fb0 2024-09-13T16:46:01.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70bcc00640 1 -- 172.21.15.18:0/2789923369 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8003e20 con 0x7f70c0102fb0 2024-09-13T16:46:01.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70c5000640 1 -- 172.21.15.18:0/2789923369 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c019fee0 con 0x7f70c0102fb0 2024-09-13T16:46:01.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.596+0000 7f70c5000640 1 -- 172.21.15.18:0/2789923369 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c01a0350 con 0x7f70c0102fb0 2024-09-13T16:46:01.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.598+0000 7f70c5000640 1 -- 172.21.15.18:0/2789923369 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c0109240 con 0x7f70c0102fb0 2024-09-13T16:46:01.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.600+0000 7f70bcc00640 1 -- 172.21.15.18:0/2789923369 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f70a8003f80 con 0x7f70c0102fb0 2024-09-13T16:46:01.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.601+0000 7f70bcc00640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f70a40a1120 0x7f70a40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:01.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.602+0000 7f70bcc00640 1 -- 172.21.15.18:0/2789923369 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4533+0+0 (secure 0 0 0) 0x7f70a80cb7a0 con 0x7f70c0102fb0 2024-09-13T16:46:01.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.602+0000 7f70bf400640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f70a40a1120 0x7f70a40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:01.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.603+0000 7f70bf400640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f70a40a1120 0x7f70a40a35e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70b0005ab0 tx=0x7f70b0005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:46:01.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.604+0000 7f70bcc00640 1 -- 172.21.15.18:0/2789923369 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f70a8095e80 con 0x7f70c0102fb0 2024-09-13T16:46:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:01.793+0000 7f70c5000640 1 -- 172.21.15.18:0/2789923369 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f70c002c520 con 0x7f70a40a1120 2024-09-13T16:46:02.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:01 smithi018 ceph-mon[30981]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T16:46:02.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:01 smithi018 ceph-mon[30981]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:02.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:46:02.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:46:02.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:02.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:01 smithi144 ceph-mon[35328]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T16:46:02.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:01 smithi144 ceph-mon[35328]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:02.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:46:02.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:46:02.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:02.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:01 smithi094 ceph-mon[35259]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T16:46:02.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:01 smithi094 ceph-mon[35259]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:02.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:46:02.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:46:02.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:03.180 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:02 smithi018 ceph-mon[30981]: from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:46:03.180 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:02 smithi018 ceph-mon[30981]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T16:46:03.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:02 smithi144 ceph-mon[35328]: from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:46:03.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:02 smithi144 ceph-mon[35328]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T16:46:03.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:02 smithi094 ceph-mon[35259]: from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:46:03.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:02 smithi094 ceph-mon[35259]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T16:46:04.024 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:03 smithi018 ceph-mon[30981]: pgmap v148: 1 pgs: 1 peering; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-13T16:46:04.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:03 smithi144 ceph-mon[35328]: pgmap v148: 1 pgs: 1 peering; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-13T16:46:04.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:03 smithi094 ceph-mon[35259]: pgmap v148: 1 pgs: 1 peering; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-13T16:46:05.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:04 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2054790996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c20ed6ea-c9fa-4693-9f2d-085ce33538f4"}]: dispatch 2024-09-13T16:46:05.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:04 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2054790996' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c20ed6ea-c9fa-4693-9f2d-085ce33538f4"}]': finished 2024-09-13T16:46:05.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:04 smithi018 ceph-mon[30981]: osdmap e43: 7 total, 6 up, 7 in 2024-09-13T16:46:05.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:05.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:04 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2054790996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c20ed6ea-c9fa-4693-9f2d-085ce33538f4"}]: dispatch 2024-09-13T16:46:05.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:04 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2054790996' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c20ed6ea-c9fa-4693-9f2d-085ce33538f4"}]': finished 2024-09-13T16:46:05.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:04 smithi144 ceph-mon[35328]: osdmap e43: 7 total, 6 up, 7 in 2024-09-13T16:46:05.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:05.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:04 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2054790996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c20ed6ea-c9fa-4693-9f2d-085ce33538f4"}]: dispatch 2024-09-13T16:46:05.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:04 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2054790996' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c20ed6ea-c9fa-4693-9f2d-085ce33538f4"}]': finished 2024-09-13T16:46:05.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:04 smithi094 ceph-mon[35259]: osdmap e43: 7 total, 6 up, 7 in 2024-09-13T16:46:05.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:06.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:05 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1980234162' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:46:06.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:05 smithi018 ceph-mon[30981]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-13T16:46:06.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:05 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1980234162' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:46:06.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:05 smithi144 ceph-mon[35328]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-13T16:46:06.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:05 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1980234162' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:46:06.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:05 smithi094 ceph-mon[35259]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-13T16:46:08.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:08 smithi018 ceph-mon[30981]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-13T16:46:09.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:08 smithi144 ceph-mon[35328]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-13T16:46:09.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:08 smithi094 ceph-mon[35259]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-13T16:46:11.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:10 smithi018 ceph-mon[30981]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T16:46:11.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:10 smithi094 ceph-mon[35259]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T16:46:11.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:10 smithi144 ceph-mon[35328]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T16:46:13.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:12 smithi094 ceph-mon[35259]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:13.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:12 smithi018 ceph-mon[30981]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:13.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:12 smithi144 ceph-mon[35328]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:14.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T16:46:14.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:14.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T16:46:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:14.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T16:46:14.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:15.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:14 smithi094 ceph-mon[35259]: Deploying daemon osd.6 on smithi018 2024-09-13T16:46:15.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:14 smithi094 ceph-mon[35259]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:14 smithi018 ceph-mon[30981]: Deploying daemon osd.6 on smithi018 2024-09-13T16:46:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:14 smithi018 ceph-mon[30981]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:15.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:14 smithi144 ceph-mon[35328]: Deploying daemon osd.6 on smithi018 2024-09-13T16:46:15.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:14 smithi144 ceph-mon[35328]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:16.069 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:15 smithi018 ceph-mon[30981]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:16.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:15 smithi094 ceph-mon[35259]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:16.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:15 smithi144 ceph-mon[35328]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:19.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:18 smithi094 ceph-mon[35259]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:19.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:18 smithi018 ceph-mon[30981]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:19.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:18 smithi144 ceph-mon[35328]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:20.925 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:20 smithi018 ceph-mon[30981]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:20.925 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:20.925 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:20.925 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:21.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:20 smithi094 ceph-mon[35259]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:21.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:21.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:21.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:21.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:20 smithi144 ceph-mon[35328]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:21.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:21.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:21.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:23.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:22 smithi018 ceph-mon[30981]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:23.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:22 smithi094 ceph-mon[35259]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:23.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:22 smithi144 ceph-mon[35328]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:24.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.482+0000 7f70bcc00640 1 -- 172.21.15.18:0/2789923369 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f70c002c520 con 0x7f70a40a1120 2024-09-13T16:46:24.484 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 6 on host 'smithi018' 2024-09-13T16:46:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 -- 172.21.15.18:0/2789923369 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f70a40a1120 msgr2=0x7f70a40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f70a40a1120 0x7f70a40a35e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70b0005ab0 tx=0x7f70b0005780 comp rx=0 tx=0).stop 2024-09-13T16:46:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 -- 172.21.15.18:0/2789923369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c0102fb0 msgr2=0x7f70c0198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c0102fb0 0x7f70c0198360 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f70a800d770 tx=0x7f70a800dc30 comp rx=0 tx=0).stop 2024-09-13T16:46:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 -- 172.21.15.18:0/2789923369 shutdown_connections 2024-09-13T16:46:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f70a40a1120 0x7f70a40a35e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c0102fb0 0x7f70c0198360 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70c0103970 0x7f70c019f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 --2- 172.21.15.18:0/2789923369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c0101e50 0x7f70c0197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 -- 172.21.15.18:0/2789923369 >> 172.21.15.18:0/2789923369 conn(0x7f70c00fd5e0 msgr2=0x7f70c0106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:46:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 -- 172.21.15.18:0/2789923369 shutdown_connections 2024-09-13T16:46:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:46:24.484+0000 7f70c5000640 1 -- 172.21.15.18:0/2789923369 wait complete. 2024-09-13T16:46:25.073 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:24 smithi144 ceph-mon[35328]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:25.073 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:24 smithi144 ceph-mon[35328]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T16:46:25.073 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:25.073 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:25.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:24 smithi094 ceph-mon[35259]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:25.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:24 smithi094 ceph-mon[35259]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T16:46:25.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:25.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:25.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:24 smithi018 ceph-mon[30981]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:25.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:24 smithi018 ceph-mon[30981]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T16:46:25.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:25.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:25.404 DEBUG:teuthology.orchestra.run.smithi018:osd.6> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.6.service 2024-09-13T16:46:25.409 INFO:tasks.cephadm:Deploying osd.7 on smithi094 with /dev/vg_nvme/lv_2... 2024-09-13T16:46:25.409 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T16:46:25.615 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:46:26.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:25 smithi094 ceph-mon[35259]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T16:46:26.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:25 smithi094 ceph-mon[35259]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T16:46:26.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:25 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:26.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:25 smithi094 ceph-mon[35259]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:46:26.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:25 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:26.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:25 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:26.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:25 smithi094 ceph-mon[35259]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:26.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:25 smithi144 ceph-mon[35328]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T16:46:26.086 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:25 smithi144 ceph-mon[35328]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T16:46:26.086 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:25 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:26.086 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:25 smithi144 ceph-mon[35328]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:46:26.086 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:25 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:26.086 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:25 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:26.086 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:25 smithi144 ceph-mon[35328]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:26.116 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:25 smithi018 ceph-mon[30981]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T16:46:26.116 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:25 smithi018 ceph-mon[30981]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T16:46:26.116 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:25 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:26.116 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:25 smithi018 ceph-mon[30981]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:46:26.116 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:25 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:26.116 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:25 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:26.116 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:25 smithi018 ceph-mon[30981]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:26.117 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 16:46:25 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T16:46:25.806+0000 7fedf2200640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T16:46:26.117 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 16:46:25 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T16:46:25.823+0000 7feded200640 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:46:27.086 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:26 smithi094 ceph-mon[35259]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:46:27.086 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:26 smithi094 ceph-mon[35259]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T16:46:27.086 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:27.086 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:27.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:26 smithi018 ceph-mon[30981]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:46:27.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:26 smithi018 ceph-mon[30981]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T16:46:27.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:27.166 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:27.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:26 smithi144 ceph-mon[35328]: from='osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:46:27.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:26 smithi144 ceph-mon[35328]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T16:46:27.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:27.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:27.473 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T16:46:27.557 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T16:46:27.568 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2024-09-13T16:46:27.568 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2024-09-13T16:46:27.568 INFO:teuthology.orchestra.run.smithi094.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00920512 s, 1.1 GB/s 2024-09-13T16:46:27.568 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2024-09-13T16:46:27.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:27 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:46:27.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:27 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:46:27.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:27 smithi018 ceph-mon[30981]: osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] boot 2024-09-13T16:46:27.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:27 smithi018 ceph-mon[30981]: osdmap e46: 7 total, 7 up, 7 in 2024-09-13T16:46:27.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:27 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:27.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:27 smithi018 ceph-mon[30981]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:28.146 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:27 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:46:28.146 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:27 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:46:28.146 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:27 smithi094 ceph-mon[35259]: osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] boot 2024-09-13T16:46:28.146 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:27 smithi094 ceph-mon[35259]: osdmap e46: 7 total, 7 up, 7 in 2024-09-13T16:46:28.146 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:27 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:28.146 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:27 smithi094 ceph-mon[35259]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:28.166 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi094:vg_nvme/lv_2 2024-09-13T16:46:28.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:27 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:46:28.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:27 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:46:28.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:27 smithi144 ceph-mon[35328]: osd.6 [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] boot 2024-09-13T16:46:28.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:27 smithi144 ceph-mon[35328]: osdmap e46: 7 total, 7 up, 7 in 2024-09-13T16:46:28.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:27 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T16:46:28.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:27 smithi144 ceph-mon[35328]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T16:46:28.365 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:46:29.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:28 smithi094 ceph-mon[35259]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T16:46:29.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:28 smithi018 ceph-mon[30981]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T16:46:29.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:28 smithi144 ceph-mon[35328]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T16:46:29.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 -- 172.21.15.94:0/1499298133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3241031a0 msgr2=0x7fa324105590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:29.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 --2- 172.21.15.94:0/1499298133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3241031a0 0x7fa324105590 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa318009900 tx=0x7fa31802a410 comp rx=0 tx=0).stop 2024-09-13T16:46:29.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 -- 172.21.15.94:0/1499298133 shutdown_connections 2024-09-13T16:46:29.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 --2- 172.21.15.94:0/1499298133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324105ad0 0x7fa324107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:29.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 --2- 172.21.15.94:0/1499298133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3241031a0 0x7fa324105590 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:29.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 --2- 172.21.15.94:0/1499298133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa324100870 0x7fa324102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 -- 172.21.15.94:0/1499298133 >> 172.21.15.94:0/1499298133 conn(0x7fa3240fa490 msgr2=0x7fa3240fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 -- 172.21.15.94:0/1499298133 shutdown_connections 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 -- 172.21.15.94:0/1499298133 wait complete. 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 Processor -- start 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.990+0000 7fa32896c640 1 -- start start 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa32896c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324100870 0x7fa3241001d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa32896c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3241031a0 0x7fa3240fe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa32896c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa324105ad0 0x7fa3240fed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa32896c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240ff4f0 con 0x7fa324100870 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa32896c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240ff660 con 0x7fa3241031a0 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa32896c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32419fdf0 con 0x7fa324105ad0 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa321d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3241031a0 0x7fa3240fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa321d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3241031a0 0x7fa3240fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59124/0 (socket says 172.21.15.94:59124) 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa321d9b640 1 -- 172.21.15.94:0/635276262 learned_addr learned my addr 172.21.15.94:0/635276262 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa32259c640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324100870 0x7fa3241001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa322d9d640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa324105ad0 0x7fa3240fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa321d9b640 1 -- 172.21.15.94:0/635276262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa324105ad0 msgr2=0x7fa3240fed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa321d9b640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa324105ad0 0x7fa3240fed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa321d9b640 1 -- 172.21.15.94:0/635276262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324100870 msgr2=0x7fa3241001d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa321d9b640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324100870 0x7fa3241001d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa321d9b640 1 -- 172.21.15.94:0/635276262 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318009560 con 0x7fa3241031a0 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa321d9b640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3241031a0 0x7fa3240fe820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa318009230 tx=0x7fa3180045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa3137fe640 1 -- 172.21.15.94:0/635276262 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318004c50 con 0x7fa3241031a0 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.991+0000 7fa32896c640 1 -- 172.21.15.94:0/635276262 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3241a0040 con 0x7fa3241031a0 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.992+0000 7fa3137fe640 1 -- 172.21.15.94:0/635276262 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa318004db0 con 0x7fa3241031a0 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.992+0000 7fa3137fe640 1 -- 172.21.15.94:0/635276262 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318031b60 con 0x7fa3241031a0 2024-09-13T16:46:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.992+0000 7fa32896c640 1 -- 172.21.15.94:0/635276262 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3241a04e0 con 0x7fa3241031a0 2024-09-13T16:46:29.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.993+0000 7fa32896c640 1 -- 172.21.15.94:0/635276262 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3240fbf80 con 0x7fa3241031a0 2024-09-13T16:46:29.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.994+0000 7fa3137fe640 1 -- 172.21.15.94:0/635276262 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa318003d00 con 0x7fa3241031a0 2024-09-13T16:46:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.994+0000 7fa3137fe640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa30c0a1080 0x7fa30c0a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.995+0000 7fa3137fe640 1 -- 172.21.15.94:0/635276262 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fa3180ecf90 con 0x7fa3241031a0 2024-09-13T16:46:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.995+0000 7fa32259c640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa30c0a1080 0x7fa30c0a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.995+0000 7fa32259c640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa30c0a1080 0x7fa30c0a3540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa31400bbe0 tx=0x7fa31400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:46:29.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:29.998+0000 7fa3137fe640 1 -- 172.21.15.94:0/635276262 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa3180b74e0 con 0x7fa3241031a0 2024-09-13T16:46:30.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:29 smithi094 ceph-mon[35259]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:30.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:30.170+0000 7fa32896c640 1 -- 172.21.15.94:0/635276262 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa32402c450 con 0x7fa30c0a1080 2024-09-13T16:46:30.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:29 smithi018 ceph-mon[30981]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:30.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:29 smithi144 ceph-mon[35328]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi018 2024-09-13T16:46:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi018 to 5698M 2024-09-13T16:46:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:31.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:31.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:31.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:46:31.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:46:31.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:46:31.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:31.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:31.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:31.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi018 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi018 to 5698M 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:31.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:46:31.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:46:31.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:46:31.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:31.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:31.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:31.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi018 2024-09-13T16:46:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi018 to 5698M 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:31.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:32.135 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:31 smithi094 ceph-mon[35259]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:32.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:31 smithi018 ceph-mon[30981]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:32.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:31 smithi144 ceph-mon[35328]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:32 smithi094 ceph-mon[35259]: from='client.? 172.21.15.94:0/3211451414' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f3039b-06ae-4447-bf57-464bfda06871"}]: dispatch 2024-09-13T16:46:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:32 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f3039b-06ae-4447-bf57-464bfda06871"}]: dispatch 2024-09-13T16:46:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:32 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5f3039b-06ae-4447-bf57-464bfda06871"}]': finished 2024-09-13T16:46:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:32 smithi094 ceph-mon[35259]: osdmap e48: 8 total, 7 up, 8 in 2024-09-13T16:46:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:33.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:32 smithi018 ceph-mon[30981]: from='client.? 172.21.15.94:0/3211451414' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f3039b-06ae-4447-bf57-464bfda06871"}]: dispatch 2024-09-13T16:46:33.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:32 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f3039b-06ae-4447-bf57-464bfda06871"}]: dispatch 2024-09-13T16:46:33.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:32 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5f3039b-06ae-4447-bf57-464bfda06871"}]': finished 2024-09-13T16:46:33.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:32 smithi018 ceph-mon[30981]: osdmap e48: 8 total, 7 up, 8 in 2024-09-13T16:46:33.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:33.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:32 smithi144 ceph-mon[35328]: from='client.? 172.21.15.94:0/3211451414' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f3039b-06ae-4447-bf57-464bfda06871"}]: dispatch 2024-09-13T16:46:33.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:32 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f3039b-06ae-4447-bf57-464bfda06871"}]: dispatch 2024-09-13T16:46:33.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:32 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5f3039b-06ae-4447-bf57-464bfda06871"}]': finished 2024-09-13T16:46:33.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:32 smithi144 ceph-mon[35328]: osdmap e48: 8 total, 7 up, 8 in 2024-09-13T16:46:33.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:34.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.94:0/2295969813' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:46:34.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:33 smithi094 ceph-mon[35259]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:34.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.94:0/2295969813' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:46:34.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:33 smithi018 ceph-mon[30981]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:34.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.94:0/2295969813' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:46:34.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:33 smithi144 ceph-mon[35328]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:37.107 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:36 smithi094 ceph-mon[35259]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:37.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:36 smithi018 ceph-mon[30981]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:37.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:36 smithi144 ceph-mon[35328]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:39.010 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:38 smithi094 ceph-mon[35259]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:39.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:38 smithi018 ceph-mon[30981]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:39.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:38 smithi144 ceph-mon[35328]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:40.040 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:39 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T16:46:40.041 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:39 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:40.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:39 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T16:46:40.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:39 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:40.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:39 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T16:46:40.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:39 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:41.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:40 smithi094 ceph-mon[35259]: Deploying daemon osd.7 on smithi094 2024-09-13T16:46:41.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:40 smithi094 ceph-mon[35259]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:41.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:40 smithi018 ceph-mon[30981]: Deploying daemon osd.7 on smithi094 2024-09-13T16:46:41.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:40 smithi018 ceph-mon[30981]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:41.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:40 smithi144 ceph-mon[35328]: Deploying daemon osd.7 on smithi094 2024-09-13T16:46:41.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:40 smithi144 ceph-mon[35328]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:42.144 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:41 smithi094 ceph-mon[35259]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:42.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:41 smithi018 ceph-mon[30981]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:42.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:41 smithi144 ceph-mon[35328]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:45.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:44 smithi094 ceph-mon[35259]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:45.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:45.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:45.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:45.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:44 smithi018 ceph-mon[30981]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:45.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:45.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:45.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:45.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:44 smithi144 ceph-mon[35328]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:45.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:45.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:45.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:46.905 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:46 smithi094 ceph-mon[35259]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:47.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:46 smithi018 ceph-mon[30981]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:47.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:46 smithi144 ceph-mon[35328]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:47.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.795+0000 7fa3137fe640 1 -- 172.21.15.94:0/635276262 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa32402c450 con 0x7fa30c0a1080 2024-09-13T16:46:47.797 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 7 on host 'smithi094' 2024-09-13T16:46:47.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 -- 172.21.15.94:0/635276262 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa30c0a1080 msgr2=0x7fa30c0a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa30c0a1080 0x7fa30c0a3540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa31400bbe0 tx=0x7fa31400b390 comp rx=0 tx=0).stop 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 -- 172.21.15.94:0/635276262 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3241031a0 msgr2=0x7fa3240fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3241031a0 0x7fa3240fe820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa318009230 tx=0x7fa3180045e0 comp rx=0 tx=0).stop 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 -- 172.21.15.94:0/635276262 shutdown_connections 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa324105ad0 0x7fa3240fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3241031a0 0x7fa3240fe820 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa30c0a1080 0x7fa30c0a3540 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 --2- 172.21.15.94:0/635276262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324100870 0x7fa3241001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 -- 172.21.15.94:0/635276262 >> 172.21.15.94:0/635276262 conn(0x7fa3240fa490 msgr2=0x7fa3241012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 -- 172.21.15.94:0/635276262 shutdown_connections 2024-09-13T16:46:47.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:46:47.798+0000 7fa32896c640 1 -- 172.21.15.94:0/635276262 wait complete. 2024-09-13T16:46:48.479 DEBUG:teuthology.orchestra.run.smithi094:osd.7> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.7.service 2024-09-13T16:46:48.481 INFO:tasks.cephadm:Deploying osd.8 on smithi144 with /dev/vg_nvme/lv_2... 2024-09-13T16:46:48.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T16:46:48.691 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:46:48.784 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 16:46:48 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T16:46:48.509+0000 7fcd21f26640 -1 osd.7 0 log_to_monitors true 2024-09-13T16:46:49.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:48 smithi018 ceph-mon[30981]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:49.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:48 smithi018 ceph-mon[30981]: from='osd.7 [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:46:49.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:48 smithi018 ceph-mon[30981]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:46:49.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.065 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:48 smithi094 ceph-mon[35259]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:49.065 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.065 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:48 smithi094 ceph-mon[35259]: from='osd.7 [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:46:49.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:48 smithi094 ceph-mon[35259]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:46:49.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.114 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:48 smithi144 ceph-mon[35328]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:49.114 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.114 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.114 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:48 smithi144 ceph-mon[35328]: from='osd.7 [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:46:49.114 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:48 smithi144 ceph-mon[35328]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T16:46:49.114 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.114 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:49.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:49 smithi018 ceph-mon[30981]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T16:46:49.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:49 smithi018 ceph-mon[30981]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T16:46:49.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:49 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:49.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:49 smithi018 ceph-mon[30981]: from='osd.7 [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:46:49.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:49 smithi018 ceph-mon[30981]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:46:49.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:49 smithi018 ceph-mon[30981]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:50.076 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:49 smithi094 ceph-mon[35259]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T16:46:50.076 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:49 smithi094 ceph-mon[35259]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T16:46:50.076 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:49 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:50.076 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:49 smithi094 ceph-mon[35259]: from='osd.7 [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:46:50.076 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:49 smithi094 ceph-mon[35259]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:46:50.077 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:49 smithi094 ceph-mon[35259]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:50.161 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:49 smithi144 ceph-mon[35328]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T16:46:50.161 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:49 smithi144 ceph-mon[35328]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T16:46:50.161 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:49 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:50.161 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:49 smithi144 ceph-mon[35328]: from='osd.7 [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:46:50.161 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:49 smithi144 ceph-mon[35328]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:46:50.161 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:49 smithi144 ceph-mon[35328]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:50.369 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 16:46:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T16:46:50.307+0000 7fcd1dea7640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T16:46:50.369 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 16:46:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T16:46:50.316+0000 7fcd15cc8640 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:46:50.663 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T16:46:50.748 INFO:teuthology.orchestra.run.smithi144.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T16:46:50.762 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10+0 records in 2024-09-13T16:46:50.762 INFO:teuthology.orchestra.run.smithi144.stderr:10+0 records out 2024-09-13T16:46:50.762 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115926 s, 905 MB/s 2024-09-13T16:46:50.762 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping successful for: 2024-09-13T16:46:51.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:50 smithi144 ceph-mon[35328]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:46:51.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:50 smithi144 ceph-mon[35328]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T16:46:51.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:50 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:51.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:50 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:51.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:50 smithi144 ceph-mon[35328]: from='osd.7 ' entity='osd.7' 2024-09-13T16:46:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:50 smithi094 ceph-mon[35259]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:46:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:50 smithi094 ceph-mon[35259]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T16:46:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:50 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:50 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:50 smithi094 ceph-mon[35259]: from='osd.7 ' entity='osd.7' 2024-09-13T16:46:51.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:50 smithi018 ceph-mon[30981]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:46:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:50 smithi018 ceph-mon[30981]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T16:46:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:50 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:51.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:50 smithi018 ceph-mon[30981]: from='osd.7 ' entity='osd.7' 2024-09-13T16:46:51.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi144:vg_nvme/lv_2 2024-09-13T16:46:51.598 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:46:51.954 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:46:51.954 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:46:51.954 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: osd.7 [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] boot 2024-09-13T16:46:51.954 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: osdmap e51: 8 total, 8 up, 8 in 2024-09-13T16:46:51.954 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:51.955 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:51.955 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:51.955 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:51.955 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:51.955 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:51.955 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:51.955 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:46:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:46:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: osd.7 [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] boot 2024-09-13T16:46:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: osdmap e51: 8 total, 8 up, 8 in 2024-09-13T16:46:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:52.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:52.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:52.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:52.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:52.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:46:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:46:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: osd.7 [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] boot 2024-09-13T16:46:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: osdmap e51: 8 total, 8 up, 8 in 2024-09-13T16:46:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T16:46:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-13T16:46:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:52.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:46:52.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:53.015 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:52 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi094 2024-09-13T16:46:53.016 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:52 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi094 to 5696M 2024-09-13T16:46:53.016 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:53.016 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:52 smithi144 ceph-mon[35328]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T16:46:53.016 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:53.016 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:53.016 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:53.016 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:53.016 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:53.016 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:52 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi094 2024-09-13T16:46:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:52 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi094 to 5696M 2024-09-13T16:46:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:52 smithi094 ceph-mon[35259]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T16:46:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:53.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:53.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 -- 172.21.15.144:0/1125836448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e980fff10 msgr2=0x7f5e98100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:53.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 --2- 172.21.15.144:0/1125836448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e980fff10 0x7f5e98100390 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009900 tx=0x7f5e8802a410 comp rx=0 tx=0).stop 2024-09-13T16:46:53.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 -- 172.21.15.144:0/1125836448 shutdown_connections 2024-09-13T16:46:53.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 --2- 172.21.15.144:0/1125836448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e981008d0 0x7f5e98107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:53.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 --2- 172.21.15.144:0/1125836448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e980fff10 0x7f5e98100390 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:53.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 --2- 172.21.15.144:0/1125836448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e980fed10 0x7f5e980ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 -- 172.21.15.144:0/1125836448 >> 172.21.15.144:0/1125836448 conn(0x7f5e980fa4c0 msgr2=0x7f5e980fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 -- 172.21.15.144:0/1125836448 shutdown_connections 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 -- 172.21.15.144:0/1125836448 wait complete. 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 Processor -- start 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 -- start start 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e980fed10 0x7f5e98102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e980fff10 0x7f5e981012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e981008d0 0x7f5e98101830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98101fc0 con 0x7f5e980fff10 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98102130 con 0x7f5e980fed10 2024-09-13T16:46:53.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.200+0000 7f5e9eb96640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9819fe40 con 0x7f5e981008d0 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9d133640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e981008d0 0x7f5e98101830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9d133640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e981008d0 0x7f5e98101830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41992/0 (socket says 172.21.15.144:41992) 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9d133640 1 -- 172.21.15.144:0/3165173040 learned_addr learned my addr 172.21.15.144:0/3165173040 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9c932640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e980fed10 0x7f5e98102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e8ffff640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e980fff10 0x7f5e981012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9d133640 1 -- 172.21.15.144:0/3165173040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e980fed10 msgr2=0x7f5e98102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9d133640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e980fed10 0x7f5e98102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9d133640 1 -- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e980fff10 msgr2=0x7f5e981012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9d133640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e980fff10 0x7f5e981012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9d133640 1 -- 172.21.15.144:0/3165173040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e88009560 con 0x7f5e981008d0 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e8ffff640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e980fff10 0x7f5e981012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9d133640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e981008d0 0x7f5e98101830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000cd10 tx=0x7f5e9000a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:46:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e8dffb640 1 -- 172.21.15.144:0/3165173040 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000f450 con 0x7f5e981008d0 2024-09-13T16:46:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e8dffb640 1 -- 172.21.15.144:0/3165173040 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e9000fa70 con 0x7f5e981008d0 2024-09-13T16:46:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e9eb96640 1 -- 172.21.15.144:0/3165173040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e981a00f0 con 0x7f5e981008d0 2024-09-13T16:46:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.201+0000 7f5e8dffb640 1 -- 172.21.15.144:0/3165173040 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90018a60 con 0x7f5e981008d0 2024-09-13T16:46:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.202+0000 7f5e9eb96640 1 -- 172.21.15.144:0/3165173040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e981a0620 con 0x7f5e981008d0 2024-09-13T16:46:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.202+0000 7f5e9eb96640 1 -- 172.21.15.144:0/3165173040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9810a650 con 0x7f5e981008d0 2024-09-13T16:46:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.204+0000 7f5e8dffb640 1 -- 172.21.15.144:0/3165173040 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5e9000fbe0 con 0x7f5e981008d0 2024-09-13T16:46:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.204+0000 7f5e8dffb640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1080 0x7f5e800a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:46:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.204+0000 7f5e8dffb640 1 -- 172.21.15.144:0/3165173040 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f5e900cc230 con 0x7f5e981008d0 2024-09-13T16:46:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.205+0000 7f5e9c932640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1080 0x7f5e800a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:46:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.205+0000 7f5e9c932640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1080 0x7f5e800a3540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5e980ffd70 tx=0x7f5e94009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:46:53.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:52 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi094 2024-09-13T16:46:53.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:52 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi094 to 5696M 2024-09-13T16:46:53.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:53.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:52 smithi018 ceph-mon[30981]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T16:46:53.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:53.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:53.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:46:53.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:53.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:46:53.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:46:53.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.208+0000 7f5e8dffb640 1 -- 172.21.15.144:0/3165173040 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5e90096500 con 0x7f5e981008d0 2024-09-13T16:46:53.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:46:53.379+0000 7f5e9eb96640 1 -- 172.21.15.144:0/3165173040 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e98068e60 con 0x7f5e800a1080 2024-09-13T16:46:54.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:53 smithi144 ceph-mon[35328]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T16:46:54.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:53 smithi144 ceph-mon[35328]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:46:54.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:53 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:46:54.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:53 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:46:54.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:53 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:54.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:53 smithi144 ceph-mon[35328]: pgmap v184: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T16:46:54.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:53 smithi094 ceph-mon[35259]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T16:46:54.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:53 smithi094 ceph-mon[35259]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:46:54.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:53 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:46:54.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:53 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:46:54.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:53 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:54.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:53 smithi094 ceph-mon[35259]: pgmap v184: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T16:46:54.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:53 smithi018 ceph-mon[30981]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T16:46:54.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:53 smithi018 ceph-mon[30981]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:46:54.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:53 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:46:54.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:53 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:46:54.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:53 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:46:54.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:53 smithi018 ceph-mon[30981]: pgmap v184: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T16:46:54.981 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:54 smithi144 ceph-mon[35328]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-13T16:46:54.981 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:54 smithi144 ceph-mon[35328]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T16:46:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:54 smithi094 ceph-mon[35259]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-13T16:46:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:54 smithi094 ceph-mon[35259]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T16:46:55.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:54 smithi018 ceph-mon[30981]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-13T16:46:55.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:54 smithi018 ceph-mon[30981]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T16:46:56.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:55 smithi094 ceph-mon[35259]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T16:46:56.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:55 smithi094 ceph-mon[35259]: from='client.? 172.21.15.144:0/1375605008' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "125a9e98-8193-4f8e-a548-c15d5127629c"}]: dispatch 2024-09-13T16:46:56.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:55 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "125a9e98-8193-4f8e-a548-c15d5127629c"}]: dispatch 2024-09-13T16:46:56.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:55 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "125a9e98-8193-4f8e-a548-c15d5127629c"}]': finished 2024-09-13T16:46:56.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:55 smithi094 ceph-mon[35259]: osdmap e56: 9 total, 8 up, 9 in 2024-09-13T16:46:56.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:55 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:46:56.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:55 smithi094 ceph-mon[35259]: pgmap v188: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T16:46:56.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:55 smithi018 ceph-mon[30981]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T16:46:56.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:55 smithi018 ceph-mon[30981]: from='client.? 172.21.15.144:0/1375605008' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "125a9e98-8193-4f8e-a548-c15d5127629c"}]: dispatch 2024-09-13T16:46:56.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:55 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "125a9e98-8193-4f8e-a548-c15d5127629c"}]: dispatch 2024-09-13T16:46:56.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:55 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "125a9e98-8193-4f8e-a548-c15d5127629c"}]': finished 2024-09-13T16:46:56.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:55 smithi018 ceph-mon[30981]: osdmap e56: 9 total, 8 up, 9 in 2024-09-13T16:46:56.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:55 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:46:56.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:55 smithi018 ceph-mon[30981]: pgmap v188: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T16:46:56.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:55 smithi144 ceph-mon[35328]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T16:46:56.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:55 smithi144 ceph-mon[35328]: from='client.? 172.21.15.144:0/1375605008' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "125a9e98-8193-4f8e-a548-c15d5127629c"}]: dispatch 2024-09-13T16:46:56.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:55 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "125a9e98-8193-4f8e-a548-c15d5127629c"}]: dispatch 2024-09-13T16:46:56.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:55 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "125a9e98-8193-4f8e-a548-c15d5127629c"}]': finished 2024-09-13T16:46:56.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:55 smithi144 ceph-mon[35328]: osdmap e56: 9 total, 8 up, 9 in 2024-09-13T16:46:56.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:55 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:46:56.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:55 smithi144 ceph-mon[35328]: pgmap v188: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T16:46:57.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:56 smithi094 ceph-mon[35259]: from='client.? 172.21.15.144:0/1804399120' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:46:57.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:56 smithi018 ceph-mon[30981]: from='client.? 172.21.15.144:0/1804399120' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:46:57.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:56 smithi144 ceph-mon[35328]: from='client.? 172.21.15.144:0/1804399120' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:46:58.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:57 smithi094 ceph-mon[35259]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:46:58.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:57 smithi018 ceph-mon[30981]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:46:58.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:57 smithi144 ceph-mon[35328]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:46:59.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:58 smithi094 ceph-mon[35259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-13T16:46:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:58 smithi094 ceph-mon[35259]: Cluster is now healthy 2024-09-13T16:46:59.196 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:58 smithi144 ceph-mon[35328]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-13T16:46:59.196 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:58 smithi144 ceph-mon[35328]: Cluster is now healthy 2024-09-13T16:46:59.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:58 smithi018 ceph-mon[30981]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-13T16:46:59.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:58 smithi018 ceph-mon[30981]: Cluster is now healthy 2024-09-13T16:46:59.895 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:46:59 smithi144 ceph-mon[35328]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:00.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:46:59 smithi094 ceph-mon[35259]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:00.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:46:59 smithi018 ceph-mon[30981]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:03.048 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:02 smithi144 ceph-mon[35328]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:03.048 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:02 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T16:47:03.048 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:02 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:03.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:02 smithi094 ceph-mon[35259]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:03.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:02 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T16:47:03.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:02 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:03.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:02 smithi018 ceph-mon[30981]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:03.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:02 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T16:47:03.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:02 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:03.860 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:03 smithi144 ceph-mon[35328]: Deploying daemon osd.8 on smithi144 2024-09-13T16:47:04.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:03 smithi094 ceph-mon[35259]: Deploying daemon osd.8 on smithi144 2024-09-13T16:47:04.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:03 smithi018 ceph-mon[30981]: Deploying daemon osd.8 on smithi144 2024-09-13T16:47:05.143 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:04 smithi144 ceph-mon[35328]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:05.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:04 smithi094 ceph-mon[35259]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:05.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:04 smithi018 ceph-mon[30981]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:06.094 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:05 smithi144 ceph-mon[35328]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:06.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:05 smithi094 ceph-mon[35259]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:06.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:05 smithi018 ceph-mon[30981]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:07.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:07 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:07.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:07 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:07.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:07 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:08.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:07 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:08.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:07 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:08.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:07 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:08.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:07 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:08.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:07 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:08.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:07 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:08.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:08 smithi018 ceph-mon[30981]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:09.013 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:08 smithi144 ceph-mon[35328]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:08 smithi094 ceph-mon[35259]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:10.883 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:10 smithi144 ceph-mon[35328]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:10.883 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:10 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:10.883 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:10 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:10.883 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:10 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:10.884 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:10 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:10.884 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:10 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:10.917 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 8 on host 'smithi144' 2024-09-13T16:47:10.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.915+0000 7f5e8dffb640 1 -- 172.21.15.144:0/3165173040 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5e98068e60 con 0x7f5e800a1080 2024-09-13T16:47:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 -- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1080 msgr2=0x7f5e800a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:47:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1080 0x7f5e800a3540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5e980ffd70 tx=0x7f5e94009110 comp rx=0 tx=0).stop 2024-09-13T16:47:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 -- 172.21.15.144:0/3165173040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e981008d0 msgr2=0x7f5e98101830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:47:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e981008d0 0x7f5e98101830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000cd10 tx=0x7f5e9000a620 comp rx=0 tx=0).stop 2024-09-13T16:47:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 -- 172.21.15.144:0/3165173040 shutdown_connections 2024-09-13T16:47:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1080 0x7f5e800a3540 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e980fff10 0x7f5e981012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e981008d0 0x7f5e98101830 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 --2- 172.21.15.144:0/3165173040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e980fed10 0x7f5e98102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 -- 172.21.15.144:0/3165173040 >> 172.21.15.144:0/3165173040 conn(0x7f5e980fa4c0 msgr2=0x7f5e98068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:47:10.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 -- 172.21.15.144:0/3165173040 shutdown_connections 2024-09-13T16:47:10.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:47:10.917+0000 7f5e9eb96640 1 -- 172.21.15.144:0/3165173040 wait complete. 2024-09-13T16:47:11.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:10 smithi094 ceph-mon[35259]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:11.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:10 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:11.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:10 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:11.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:10 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:11.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:10 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:11.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:10 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:11.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:10 smithi018 ceph-mon[30981]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:11.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:10 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:11.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:10 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:11.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:10 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:11.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:10 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:11.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:10 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:11.575 DEBUG:teuthology.orchestra.run.smithi144:osd.8> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.8.service 2024-09-13T16:47:11.579 INFO:tasks.cephadm:Deploying osd.9 on smithi018 with /dev/vg_nvme/lv_1... 2024-09-13T16:47:11.579 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T16:47:11.908 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:47:11.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:11.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:11.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:11.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:11 smithi018 ceph-mon[30981]: from='osd.8 [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:47:11.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:11 smithi018 ceph-mon[30981]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:47:12.116 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:12.116 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:12.116 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:12.116 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:11 smithi144 ceph-mon[35328]: from='osd.8 [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:47:12.116 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:11 smithi144 ceph-mon[35328]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:47:12.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:12.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:12.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:12.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:11 smithi094 ceph-mon[35259]: from='osd.8 [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:47:12.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:11 smithi094 ceph-mon[35259]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T16:47:13.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:12 smithi144 ceph-mon[35328]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:12 smithi144 ceph-mon[35328]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T16:47:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:12 smithi144 ceph-mon[35328]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T16:47:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:12 smithi144 ceph-mon[35328]: from='osd.8 [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:47:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:12 smithi144 ceph-mon[35328]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:47:13.022 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 16:47:12 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T16:47:12.927+0000 7f2b1fdb1640 -1 osd.8 0 waiting for initial osdmap 2024-09-13T16:47:13.022 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 16:47:12 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T16:47:12.938+0000 7f2b1bbda640 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:47:13.087 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:12 smithi018 ceph-mon[30981]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:13.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:12 smithi018 ceph-mon[30981]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T16:47:13.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:12 smithi018 ceph-mon[30981]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T16:47:13.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:13.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:12 smithi018 ceph-mon[30981]: from='osd.8 [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:47:13.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:12 smithi018 ceph-mon[30981]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:47:13.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:12 smithi094 ceph-mon[35259]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:13.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:12 smithi094 ceph-mon[35259]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T16:47:13.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:12 smithi094 ceph-mon[35259]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T16:47:13.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:13.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:12 smithi094 ceph-mon[35259]: from='osd.8 [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:47:13.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:12 smithi094 ceph-mon[35259]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:47:14.010 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:13 smithi144 ceph-mon[35328]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:47:14.010 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:13 smithi144 ceph-mon[35328]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T16:47:14.010 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:14.010 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:14.010 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:13 smithi144 ceph-mon[35328]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:14.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:13 smithi018 ceph-mon[30981]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:47:14.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:13 smithi018 ceph-mon[30981]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T16:47:14.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:14.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:14.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:13 smithi018 ceph-mon[30981]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:14.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:13 smithi094 ceph-mon[35259]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:47:14.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:13 smithi094 ceph-mon[35259]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T16:47:14.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:14.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:14.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:13 smithi094 ceph-mon[35259]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-13T16:47:14.539 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T16:47:14.685 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T16:47:14.720 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-09-13T16:47:14.721 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-09-13T16:47:14.721 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0279751 s, 375 MB/s 2024-09-13T16:47:14.721 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-09-13T16:47:15.187 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:47:15.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:47:15.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: osd.8 [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] boot 2024-09-13T16:47:15.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: osdmap e59: 9 total, 9 up, 9 in 2024-09-13T16:47:15.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:15.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi144 2024-09-13T16:47:15.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:15.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:15.189 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:15.189 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-13T16:47:15.189 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.189 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:15.189 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:15.189 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.189 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:14 smithi018 ceph-mon[30981]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: osd.8 [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] boot 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: osdmap e59: 9 total, 9 up, 9 in 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi144 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-13T16:47:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:14 smithi144 ceph-mon[35328]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T16:47:15.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:47:15.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:47:15.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: osd.8 [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] boot 2024-09-13T16:47:15.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: osdmap e59: 9 total, 9 up, 9 in 2024-09-13T16:47:15.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T16:47:15.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi144 2024-09-13T16:47:15.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:15.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:15.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:15.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-13T16:47:15.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:15.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:15.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:15.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:14 smithi094 ceph-mon[35259]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T16:47:15.695 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_1 2024-09-13T16:47:16.013 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:47:16.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:16 smithi018 ceph-mon[30981]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:16.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:16 smithi018 ceph-mon[30981]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T16:47:17.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:16 smithi144 ceph-mon[35328]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:17.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:16 smithi144 ceph-mon[35328]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T16:47:17.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:16 smithi094 ceph-mon[35259]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:17.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:16 smithi094 ceph-mon[35259]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T16:47:18.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:17 smithi018 ceph-mon[30981]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T16:47:18.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:17 smithi018 ceph-mon[30981]: pgmap v205: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:47:18.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:17 smithi144 ceph-mon[35328]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T16:47:18.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:17 smithi144 ceph-mon[35328]: pgmap v205: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:47:18.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.386+0000 7fb4bf200640 1 -- 172.21.15.18:0/2943034663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4c0101e30 msgr2=0x7fb4c0102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:47:18.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.386+0000 7fb4bf200640 1 --2- 172.21.15.18:0/2943034663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4c0101e30 0x7fb4c0102230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0009860 tx=0x7fb4b002a340 comp rx=0 tx=0).stop 2024-09-13T16:47:18.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.386+0000 7fb4bf200640 1 -- 172.21.15.18:0/2943034663 shutdown_connections 2024-09-13T16:47:18.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.386+0000 7fb4bf200640 1 --2- 172.21.15.18:0/2943034663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4c0103950 0x7fb4c010a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:18.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.386+0000 7fb4bf200640 1 --2- 172.21.15.18:0/2943034663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4c0102f90 0x7fb4c0103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:18.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.386+0000 7fb4bf200640 1 --2- 172.21.15.18:0/2943034663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4c0101e30 0x7fb4c0102230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:18.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.386+0000 7fb4bf200640 1 -- 172.21.15.18:0/2943034663 >> 172.21.15.18:0/2943034663 conn(0x7fb4c00fd5e0 msgr2=0x7fb4c00ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:47:18.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.386+0000 7fb4bf200640 1 -- 172.21.15.18:0/2943034663 shutdown_connections 2024-09-13T16:47:18.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.386+0000 7fb4bf200640 1 -- 172.21.15.18:0/2943034663 wait complete. 2024-09-13T16:47:18.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.387+0000 7fb4bf200640 1 Processor -- start 2024-09-13T16:47:18.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.387+0000 7fb4bf200640 1 -- start start 2024-09-13T16:47:18.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4bf200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4c0101e30 0x7fb4c0197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:47:18.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4bf200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4c0102f90 0x7fb4c0198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4bf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4c0103950 0x7fb4c019f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4bf200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c019f830 con 0x7fb4c0101e30 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4bf200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c019f9a0 con 0x7fb4c0102f90 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4bf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c019fb60 con 0x7fb4c0103950 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4bde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4c0101e30 0x7fb4c0197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4bde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4c0101e30 0x7fb4c0197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60656/0 (socket says 172.21.15.18:60656) 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4bde00640 1 -- 172.21.15.18:0/549874767 learned_addr learned my addr 172.21.15.18:0/549874767 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4be800640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4c0103950 0x7fb4c019f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4b7e00640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4c0102f90 0x7fb4c0198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4be800640 1 -- 172.21.15.18:0/549874767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4c0102f90 msgr2=0x7fb4c0198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4be800640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4c0102f90 0x7fb4c0198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4be800640 1 -- 172.21.15.18:0/549874767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4c0101e30 msgr2=0x7fb4c0197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:47:18.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4be800640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4c0101e30 0x7fb4c0197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:18.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.388+0000 7fb4be800640 1 -- 172.21.15.18:0/549874767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0009490 con 0x7fb4c0103950 2024-09-13T16:47:18.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.389+0000 7fb4be800640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4c0103950 0x7fb4c019f2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800ed70 tx=0x7fb4b800c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:47:18.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.389+0000 7fb4b6a00640 1 -- 172.21.15.18:0/549874767 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8003b70 con 0x7fb4c0103950 2024-09-13T16:47:18.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.389+0000 7fb4b6a00640 1 -- 172.21.15.18:0/549874767 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4b800ee60 con 0x7fb4c0103950 2024-09-13T16:47:18.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.389+0000 7fb4bf200640 1 -- 172.21.15.18:0/549874767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c019fe40 con 0x7fb4c0103950 2024-09-13T16:47:18.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.389+0000 7fb4b6a00640 1 -- 172.21.15.18:0/549874767 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80177b0 con 0x7fb4c0103950 2024-09-13T16:47:18.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.389+0000 7fb4bf200640 1 -- 172.21.15.18:0/549874767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c01a02b0 con 0x7fb4c0103950 2024-09-13T16:47:18.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.390+0000 7fb4bf200640 1 -- 172.21.15.18:0/549874767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c0109240 con 0x7fb4c0103950 2024-09-13T16:47:18.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.392+0000 7fb4b6a00640 1 -- 172.21.15.18:0/549874767 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb4b800a040 con 0x7fb4c0103950 2024-09-13T16:47:18.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.393+0000 7fb4b6a00640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb4a40a1120 0x7fb4a40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:47:18.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.394+0000 7fb4b6a00640 1 -- 172.21.15.18:0/549874767 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5829+0+0 (secure 0 0 0) 0x7fb4b80cbd80 con 0x7fb4c0103950 2024-09-13T16:47:18.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.394+0000 7fb4bde00640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb4a40a1120 0x7fb4a40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:47:18.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.394+0000 7fb4bde00640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb4a40a1120 0x7fb4a40a35e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb4b002a930 tx=0x7fb4b00058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:47:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.398+0000 7fb4b6a00640 1 -- 172.21.15.18:0/549874767 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb4b8095ed0 con 0x7fb4c0103950 2024-09-13T16:47:18.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:17 smithi094 ceph-mon[35259]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T16:47:18.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:17 smithi094 ceph-mon[35259]: pgmap v205: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:47:18.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:18.587+0000 7fb4bf200640 1 -- 172.21.15.18:0/549874767 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4c002c4f0 con 0x7fb4a40a1120 2024-09-13T16:47:19.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:18 smithi018 ceph-mon[30981]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T16:47:19.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:18 smithi018 ceph-mon[30981]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:47:19.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:18 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:47:19.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:18 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:47:19.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:18 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:19.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:18 smithi144 ceph-mon[35328]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T16:47:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:18 smithi144 ceph-mon[35328]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:47:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:18 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:47:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:18 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:47:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:18 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:19.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:18 smithi094 ceph-mon[35259]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T16:47:19.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:18 smithi094 ceph-mon[35259]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:47:19.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:18 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:47:19.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:18 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:47:19.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:18 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:20.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:19 smithi018 ceph-mon[30981]: pgmap v207: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-13T16:47:20.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:19 smithi144 ceph-mon[35328]: pgmap v207: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-13T16:47:20.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:19 smithi094 ceph-mon[35259]: pgmap v207: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-13T16:47:22.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:22 smithi018 ceph-mon[30981]: pgmap v208: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:47:22.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:22 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2622916649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b40b786-9a18-4702-9db8-be1fa45b58d7"}]: dispatch 2024-09-13T16:47:22.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:22 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2622916649' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b40b786-9a18-4702-9db8-be1fa45b58d7"}]': finished 2024-09-13T16:47:22.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:22 smithi018 ceph-mon[30981]: osdmap e64: 10 total, 9 up, 10 in 2024-09-13T16:47:22.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:22 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:22.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:22 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4196507082' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:47:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:22 smithi094 ceph-mon[35259]: pgmap v208: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:47:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:22 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2622916649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b40b786-9a18-4702-9db8-be1fa45b58d7"}]: dispatch 2024-09-13T16:47:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:22 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2622916649' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b40b786-9a18-4702-9db8-be1fa45b58d7"}]': finished 2024-09-13T16:47:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:22 smithi094 ceph-mon[35259]: osdmap e64: 10 total, 9 up, 10 in 2024-09-13T16:47:23.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:22 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:23.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:22 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/4196507082' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:47:23.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:22 smithi144 ceph-mon[35328]: pgmap v208: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:47:23.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:22 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2622916649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b40b786-9a18-4702-9db8-be1fa45b58d7"}]: dispatch 2024-09-13T16:47:23.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:22 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2622916649' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b40b786-9a18-4702-9db8-be1fa45b58d7"}]': finished 2024-09-13T16:47:23.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:22 smithi144 ceph-mon[35328]: osdmap e64: 10 total, 9 up, 10 in 2024-09-13T16:47:23.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:22 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:23.273 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:22 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/4196507082' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:47:25.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:24 smithi144 ceph-mon[35328]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:25.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:24 smithi094 ceph-mon[35259]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:25.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:24 smithi018 ceph-mon[30981]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:26.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:26 smithi018 ceph-mon[30981]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:27.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:26 smithi144 ceph-mon[35328]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:27.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:26 smithi094 ceph-mon[35259]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:29.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:28 smithi018 ceph-mon[30981]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:29.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:28 smithi094 ceph-mon[35259]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:29.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:28 smithi144 ceph-mon[35328]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:29.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:29 smithi018 ceph-mon[30981]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:30.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:29 smithi094 ceph-mon[35259]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:30.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:29 smithi144 ceph-mon[35328]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:30.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T16:47:30.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:30.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:30 smithi018 ceph-mon[30981]: Deploying daemon osd.9 on smithi018 2024-09-13T16:47:31.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T16:47:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:30 smithi094 ceph-mon[35259]: Deploying daemon osd.9 on smithi018 2024-09-13T16:47:31.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T16:47:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:30 smithi144 ceph-mon[35328]: Deploying daemon osd.9 on smithi018 2024-09-13T16:47:32.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:31 smithi094 ceph-mon[35259]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:32.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:31 smithi018 ceph-mon[30981]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:32.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:31 smithi144 ceph-mon[35328]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:34.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:34 smithi018 ceph-mon[30981]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:35.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:34 smithi094 ceph-mon[35259]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:35.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:34 smithi144 ceph-mon[35328]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:36.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:36 smithi018 ceph-mon[30981]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:37.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:36 smithi094 ceph-mon[35259]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:37.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:36 smithi144 ceph-mon[35328]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:39.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:38 smithi094 ceph-mon[35259]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:39.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:38 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:39.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:38 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:39.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:38 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:39.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:38 smithi018 ceph-mon[30981]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:39.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:38 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:39.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:38 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:39.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:38 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:39.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:38 smithi144 ceph-mon[35328]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:39.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:38 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:39.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:38 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:39.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:38 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:41.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:40 smithi094 ceph-mon[35259]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:41.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:40 smithi018 ceph-mon[30981]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:41.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:40 smithi144 ceph-mon[35328]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.290+0000 7fb4b6a00640 1 -- 172.21.15.18:0/549874767 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb4c002c4f0 con 0x7fb4a40a1120 2024-09-13T16:47:42.292 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 9 on host 'smithi018' 2024-09-13T16:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 -- 172.21.15.18:0/549874767 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb4a40a1120 msgr2=0x7fb4a40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb4a40a1120 0x7fb4a40a35e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb4b002a930 tx=0x7fb4b00058b0 comp rx=0 tx=0).stop 2024-09-13T16:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 -- 172.21.15.18:0/549874767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4c0103950 msgr2=0x7fb4c019f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4c0103950 0x7fb4c019f2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800ed70 tx=0x7fb4b800c6e0 comp rx=0 tx=0).stop 2024-09-13T16:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 -- 172.21.15.18:0/549874767 shutdown_connections 2024-09-13T16:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4c0103950 0x7fb4c019f2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4c0102f90 0x7fb4c0198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb4a40a1120 0x7fb4a40a35e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 --2- 172.21.15.18:0/549874767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4c0101e30 0x7fb4c0197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 -- 172.21.15.18:0/549874767 >> 172.21.15.18:0/549874767 conn(0x7fb4c00fd5e0 msgr2=0x7fb4c0106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:47:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.293+0000 7fb4bf200640 1 -- 172.21.15.18:0/549874767 shutdown_connections 2024-09-13T16:47:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:47:42.294+0000 7fb4bf200640 1 -- 172.21.15.18:0/549874767 wait complete. 2024-09-13T16:47:42.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:42 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:42 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:42 smithi094 ceph-mon[35259]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:42.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:42 smithi094 ceph-mon[35259]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T16:47:42.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:42 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:42.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:42 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:42.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:42 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:42 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:42.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:42 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:42 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:42 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:42 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:42 smithi018 ceph-mon[30981]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:42.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:42 smithi018 ceph-mon[30981]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T16:47:42.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:42 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:42.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:42 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:42.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:42 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:42 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:42.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:42 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.700 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:42 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:42 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:42 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:42 smithi144 ceph-mon[35328]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:42.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:42 smithi144 ceph-mon[35328]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T16:47:42.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:42 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:42.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:42 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:42.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:42 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:42 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:47:42.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:42 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:42.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:42 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:43.142 DEBUG:teuthology.orchestra.run.smithi018:osd.9> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.9.service 2024-09-13T16:47:43.147 INFO:tasks.cephadm:Deploying osd.10 on smithi094 with /dev/vg_nvme/lv_1... 2024-09-13T16:47:43.147 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T16:47:43.353 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:47:43.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:43 smithi018 ceph-mon[30981]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T16:47:43.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:43 smithi018 ceph-mon[30981]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T16:47:43.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:43 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:43.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:43 smithi018 ceph-mon[30981]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:47:43.474 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:43 smithi094 ceph-mon[35259]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T16:47:43.474 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:43 smithi094 ceph-mon[35259]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T16:47:43.474 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:43 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:43.474 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:43 smithi094 ceph-mon[35259]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:47:43.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:43 smithi144 ceph-mon[35328]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T16:47:43.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:43 smithi144 ceph-mon[35328]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T16:47:43.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:43 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:43.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:43 smithi144 ceph-mon[35328]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-13T16:47:43.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 16:47:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T16:47:43.888+0000 7f1d07a00640 -1 osd.9 0 waiting for initial osdmap 2024-09-13T16:47:43.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 16:47:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T16:47:43.914+0000 7f1cfda00640 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:47:44.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:44 smithi018 ceph-mon[30981]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:47:44.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:44 smithi018 ceph-mon[30981]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T16:47:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:44 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:44 smithi018 ceph-mon[30981]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:44.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:44 smithi018 ceph-mon[30981]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' 2024-09-13T16:47:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:44 smithi094 ceph-mon[35259]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:47:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:44 smithi094 ceph-mon[35259]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T16:47:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:44 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:44 smithi094 ceph-mon[35259]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:44.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:44 smithi094 ceph-mon[35259]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' 2024-09-13T16:47:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:44 smithi144 ceph-mon[35328]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-13T16:47:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:44 smithi144 ceph-mon[35328]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T16:47:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:44 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:44 smithi144 ceph-mon[35328]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-13T16:47:44.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:44 smithi144 ceph-mon[35328]: from='osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466]' entity='osd.9' 2024-09-13T16:47:45.228 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T16:47:45.315 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T16:47:45.325 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2024-09-13T16:47:45.325 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2024-09-13T16:47:45.325 INFO:teuthology.orchestra.run.smithi094.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00877828 s, 1.2 GB/s 2024-09-13T16:47:45.325 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 2024-09-13T16:47:45.326 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2024-09-13T16:47:45.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:45 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:47:45.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:45 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:47:45.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:45 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:45.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:45 smithi018 ceph-mon[30981]: osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] boot 2024-09-13T16:47:45.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:45 smithi018 ceph-mon[30981]: osdmap e67: 10 total, 10 up, 10 in 2024-09-13T16:47:45.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:45 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:45.619 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:45 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:47:45.620 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:45 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:47:45.620 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:45 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:45.620 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:45 smithi094 ceph-mon[35259]: osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] boot 2024-09-13T16:47:45.620 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:45 smithi094 ceph-mon[35259]: osdmap e67: 10 total, 10 up, 10 in 2024-09-13T16:47:45.620 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:45 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:45.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:45 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:47:45.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:45 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:47:45.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:45 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:45.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:45 smithi144 ceph-mon[35328]: osd.9 [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] boot 2024-09-13T16:47:45.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:45 smithi144 ceph-mon[35328]: osdmap e67: 10 total, 10 up, 10 in 2024-09-13T16:47:45.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:45 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T16:47:45.974 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi094:vg_nvme/lv_1 2024-09-13T16:47:46.180 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:47:46.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:46 smithi018 ceph-mon[30981]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:46.564 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:46 smithi094 ceph-mon[35259]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:46.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:46 smithi144 ceph-mon[35328]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:47.627 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:47 smithi094 ceph-mon[35259]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T16:47:47.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:47 smithi018 ceph-mon[30981]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T16:47:47.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:47 smithi144 ceph-mon[35328]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T16:47:47.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.837+0000 7ffa2e191640 1 -- 172.21.15.94:0/2616735450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa280fece0 msgr2=0x7ffa280ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:47:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.837+0000 7ffa2e191640 1 --2- 172.21.15.94:0/2616735450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa280fece0 0x7ffa280ff0e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009900 tx=0x7ffa1802a410 comp rx=0 tx=0).stop 2024-09-13T16:47:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.838+0000 7ffa2e191640 1 -- 172.21.15.94:0/2616735450 shutdown_connections 2024-09-13T16:47:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.838+0000 7ffa2e191640 1 --2- 172.21.15.94:0/2616735450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa281008a0 0x7ffa28107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.838+0000 7ffa2e191640 1 --2- 172.21.15.94:0/2616735450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa280ffee0 0x7ffa28100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:47.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.838+0000 7ffa2e191640 1 --2- 172.21.15.94:0/2616735450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa280fece0 0x7ffa280ff0e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:47.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.838+0000 7ffa2e191640 1 -- 172.21.15.94:0/2616735450 >> 172.21.15.94:0/2616735450 conn(0x7ffa280fa490 msgr2=0x7ffa280fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:47:47.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.838+0000 7ffa2e191640 1 -- 172.21.15.94:0/2616735450 shutdown_connections 2024-09-13T16:47:47.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.838+0000 7ffa2e191640 1 -- 172.21.15.94:0/2616735450 wait complete. 2024-09-13T16:47:47.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.838+0000 7ffa2e191640 1 Processor -- start 2024-09-13T16:47:47.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.838+0000 7ffa2e191640 1 -- start start 2024-09-13T16:47:47.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa2e191640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa280fece0 0x7ffa28068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:47:47.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa2e191640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa280ffee0 0x7ffa2819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:47:47.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa2e191640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa281008a0 0x7ffa2819d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:47:47.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa2e191640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2819d9c0 con 0x7ffa280fece0 2024-09-13T16:47:47.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa2e191640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2819db30 con 0x7ffa281008a0 2024-09-13T16:47:47.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa2e191640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2819dcf0 con 0x7ffa280ffee0 2024-09-13T16:47:47.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa27fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa281008a0 0x7ffa2819d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:47:47.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa27fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa281008a0 0x7ffa2819d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60690/0 (socket says 172.21.15.94:60690) 2024-09-13T16:47:47.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa27fff640 1 -- 172.21.15.94:0/2740722008 learned_addr learned my addr 172.21.15.94:0/2740722008 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T16:47:47.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa277fe640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa280fece0 0x7ffa28068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:47:47.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa1effd640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa280ffee0 0x7ffa2819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:47:47.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa27fff640 1 -- 172.21.15.94:0/2740722008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa280ffee0 msgr2=0x7ffa2819abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:47:47.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa27fff640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa280ffee0 0x7ffa2819abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:47.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa27fff640 1 -- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa280fece0 msgr2=0x7ffa28068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:47:47.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa27fff640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa280fece0 0x7ffa28068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:47:47.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa27fff640 1 -- 172.21.15.94:0/2740722008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18009560 con 0x7ffa281008a0 2024-09-13T16:47:47.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa277fe640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa280fece0 0x7ffa28068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:47:47.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa1effd640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa280ffee0 0x7ffa2819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:47:47.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa27fff640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa281008a0 0x7ffa2819d1e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000cad0 tx=0x7ffa2000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:47:47.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.839+0000 7ffa257fa640 1 -- 172.21.15.94:0/2740722008 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000ae20 con 0x7ffa281008a0 2024-09-13T16:47:47.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.840+0000 7ffa257fa640 1 -- 172.21.15.94:0/2740722008 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa20005020 con 0x7ffa281008a0 2024-09-13T16:47:47.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.840+0000 7ffa2e191640 1 -- 172.21.15.94:0/2740722008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2819df70 con 0x7ffa281008a0 2024-09-13T16:47:47.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.840+0000 7ffa257fa640 1 -- 172.21.15.94:0/2740722008 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000f6b0 con 0x7ffa281008a0 2024-09-13T16:47:47.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.840+0000 7ffa2e191640 1 -- 172.21.15.94:0/2740722008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2819e4c0 con 0x7ffa281008a0 2024-09-13T16:47:47.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.841+0000 7ffa2e191640 1 -- 172.21.15.94:0/2740722008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa281061a0 con 0x7ffa281008a0 2024-09-13T16:47:47.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.842+0000 7ffa257fa640 1 -- 172.21.15.94:0/2740722008 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ffa20005190 con 0x7ffa281008a0 2024-09-13T16:47:47.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.842+0000 7ffa257fa640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffa140a1100 0x7ffa140a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:47:47.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.842+0000 7ffa257fa640 1 -- 172.21.15.94:0/2740722008 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6261+0+0 (secure 0 0 0) 0x7ffa200cc570 con 0x7ffa281008a0 2024-09-13T16:47:47.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.843+0000 7ffa277fe640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffa140a1100 0x7ffa140a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:47:47.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.843+0000 7ffa277fe640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffa140a1100 0x7ffa140a35c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa18006010 tx=0x7ffa18005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:47:47.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:47.846+0000 7ffa257fa640 1 -- 172.21.15.94:0/2740722008 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffa20096580 con 0x7ffa281008a0 2024-09-13T16:47:48.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:47:48.019+0000 7ffa2e191640 1 -- 172.21.15.94:0/2740722008 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa2802c4f0 con 0x7ffa140a1100 2024-09-13T16:47:48.644 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi018 2024-09-13T16:47:48.644 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.644 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:47:48.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:48.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi018 2024-09-13T16:47:48.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-13T16:47:48.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:48.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:48.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:48.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:47:48.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:47:48.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:48.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi018 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:47:48.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:48.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:47:48.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:47:48.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:49.499 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:49 smithi094 ceph-mon[35259]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:47:49.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:49 smithi018 ceph-mon[30981]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:47:49.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:49 smithi144 ceph-mon[35328]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:47:50.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:50 smithi094 ceph-mon[35259]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:50.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:50 smithi018 ceph-mon[30981]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:50.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:50 smithi144 ceph-mon[35328]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:51.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:51 smithi094 ceph-mon[35259]: from='client.? 172.21.15.94:0/3006547125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb72e047-4488-48a5-801c-24e24423bbc5"}]: dispatch 2024-09-13T16:47:51.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:51 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb72e047-4488-48a5-801c-24e24423bbc5"}]: dispatch 2024-09-13T16:47:51.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:51 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb72e047-4488-48a5-801c-24e24423bbc5"}]': finished 2024-09-13T16:47:51.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:51 smithi094 ceph-mon[35259]: osdmap e69: 11 total, 10 up, 11 in 2024-09-13T16:47:51.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:51 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:47:51.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:51 smithi094 ceph-mon[35259]: from='client.? 172.21.15.94:0/3178434580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:47:51.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:51 smithi018 ceph-mon[30981]: from='client.? 172.21.15.94:0/3006547125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb72e047-4488-48a5-801c-24e24423bbc5"}]: dispatch 2024-09-13T16:47:51.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:51 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb72e047-4488-48a5-801c-24e24423bbc5"}]: dispatch 2024-09-13T16:47:51.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:51 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb72e047-4488-48a5-801c-24e24423bbc5"}]': finished 2024-09-13T16:47:51.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:51 smithi018 ceph-mon[30981]: osdmap e69: 11 total, 10 up, 11 in 2024-09-13T16:47:51.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:51 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:47:51.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:51 smithi018 ceph-mon[30981]: from='client.? 172.21.15.94:0/3178434580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:47:51.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:51 smithi144 ceph-mon[35328]: from='client.? 172.21.15.94:0/3006547125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb72e047-4488-48a5-801c-24e24423bbc5"}]: dispatch 2024-09-13T16:47:51.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:51 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb72e047-4488-48a5-801c-24e24423bbc5"}]: dispatch 2024-09-13T16:47:51.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:51 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb72e047-4488-48a5-801c-24e24423bbc5"}]': finished 2024-09-13T16:47:51.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:51 smithi144 ceph-mon[35328]: osdmap e69: 11 total, 10 up, 11 in 2024-09-13T16:47:51.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:51 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:47:51.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:51 smithi144 ceph-mon[35328]: from='client.? 172.21.15.94:0/3178434580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:47:52.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:52 smithi094 ceph-mon[35259]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:52.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:52 smithi018 ceph-mon[30981]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:52.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:52 smithi144 ceph-mon[35328]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:55.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:54 smithi094 ceph-mon[35259]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:55.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:54 smithi018 ceph-mon[30981]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:55.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:54 smithi144 ceph-mon[35328]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:56.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:56 smithi094 ceph-mon[35259]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:57.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:56 smithi018 ceph-mon[30981]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:57.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:56 smithi144 ceph-mon[35328]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:57.875 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:57 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T16:47:57.875 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:57 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:58.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:57 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T16:47:58.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:57 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:58.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:57 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T16:47:58.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:57 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:47:59.006 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:58 smithi094 ceph-mon[35259]: Deploying daemon osd.10 on smithi094 2024-09-13T16:47:59.006 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:58 smithi094 ceph-mon[35259]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:58 smithi018 ceph-mon[30981]: Deploying daemon osd.10 on smithi094 2024-09-13T16:47:59.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:58 smithi018 ceph-mon[30981]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:59.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:58 smithi144 ceph-mon[35328]: Deploying daemon osd.10 on smithi094 2024-09-13T16:47:59.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:58 smithi144 ceph-mon[35328]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:59.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:47:59 smithi094 ceph-mon[35259]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:47:59.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:47:59 smithi018 ceph-mon[30981]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:00.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:47:59 smithi144 ceph-mon[35328]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:03.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:02 smithi094 ceph-mon[35259]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:03.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:02 smithi018 ceph-mon[30981]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:03.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:02 smithi144 ceph-mon[35328]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:04.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:04.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:04.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:04.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:04.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:04.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:04.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:04.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:04.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:05.099 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:04 smithi094 ceph-mon[35259]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:05.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:04 smithi018 ceph-mon[30981]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:05.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:04 smithi144 ceph-mon[35328]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:06.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.121+0000 7ffa257fa640 1 -- 172.21.15.94:0/2740722008 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7ffa2802c4f0 con 0x7ffa140a1100 2024-09-13T16:48:06.124 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 10 on host 'smithi094' 2024-09-13T16:48:06.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 -- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffa140a1100 msgr2=0x7ffa140a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:06.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffa140a1100 0x7ffa140a35c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa18006010 tx=0x7ffa18005760 comp rx=0 tx=0).stop 2024-09-13T16:48:06.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 -- 172.21.15.94:0/2740722008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa281008a0 msgr2=0x7ffa2819d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:06.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa281008a0 0x7ffa2819d1e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000cad0 tx=0x7ffa2000cf90 comp rx=0 tx=0).stop 2024-09-13T16:48:06.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 -- 172.21.15.94:0/2740722008 shutdown_connections 2024-09-13T16:48:06.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa281008a0 0x7ffa2819d1e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:06.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa280ffee0 0x7ffa2819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:06.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffa140a1100 0x7ffa140a35c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:06.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 --2- 172.21.15.94:0/2740722008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa280fece0 0x7ffa28068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:06.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 -- 172.21.15.94:0/2740722008 >> 172.21.15.94:0/2740722008 conn(0x7ffa280fa490 msgr2=0x7ffa28103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:06.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 -- 172.21.15.94:0/2740722008 shutdown_connections 2024-09-13T16:48:06.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T16:48:06.123+0000 7ffa2e191640 1 -- 172.21.15.94:0/2740722008 wait complete. 2024-09-13T16:48:06.832 DEBUG:teuthology.orchestra.run.smithi094:osd.10> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.10.service 2024-09-13T16:48:06.835 INFO:tasks.cephadm:Deploying osd.11 on smithi144 with /dev/vg_nvme/lv_1... 2024-09-13T16:48:06.835 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T16:48:06.862 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:06 smithi144 ceph-mon[35328]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:06.862 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:06.862 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:06.862 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:06 smithi144 ceph-mon[35328]: from='osd.10 [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:48:06.862 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:06 smithi144 ceph-mon[35328]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:48:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:48:07.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:06 smithi094 ceph-mon[35259]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:07.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:07.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:07.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:06 smithi094 ceph-mon[35259]: from='osd.10 [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:48:07.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:06 smithi094 ceph-mon[35259]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:48:07.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:06 smithi018 ceph-mon[30981]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:07.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:07.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:07.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:06 smithi018 ceph-mon[30981]: from='osd.10 [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:48:07.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:06 smithi018 ceph-mon[30981]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T16:48:08.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:07 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:08.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:07 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:08.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:07 smithi144 ceph-mon[35328]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T16:48:08.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:07 smithi144 ceph-mon[35328]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T16:48:08.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:07 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:08.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:07 smithi144 ceph-mon[35328]: from='osd.10 [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:48:08.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:07 smithi144 ceph-mon[35328]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:48:08.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:07 smithi144 ceph-mon[35328]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:08.350 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:07 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:08.351 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:07 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:08.351 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:07 smithi094 ceph-mon[35259]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T16:48:08.351 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:07 smithi094 ceph-mon[35259]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T16:48:08.351 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:07 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:08.351 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:07 smithi094 ceph-mon[35259]: from='osd.10 [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:48:08.351 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:07 smithi094 ceph-mon[35259]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:48:08.352 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:07 smithi094 ceph-mon[35259]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:08.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:07 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:08.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:07 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:08.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:07 smithi018 ceph-mon[30981]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T16:48:08.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:07 smithi018 ceph-mon[30981]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T16:48:08.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:07 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:08.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:07 smithi018 ceph-mon[30981]: from='osd.10 [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:48:08.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:07 smithi018 ceph-mon[30981]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2024-09-13T16:48:08.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:07 smithi018 ceph-mon[30981]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:08.882 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 16:48:08 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T16:48:08.667+0000 7fd7abc64640 -1 osd.10 0 waiting for initial osdmap 2024-09-13T16:48:08.882 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 16:48:08 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T16:48:08.679+0000 7fd7a3a85640 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:48:08.982 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T16:48:09.072 INFO:teuthology.orchestra.run.smithi144.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T16:48:09.086 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10+0 records in 2024-09-13T16:48:09.086 INFO:teuthology.orchestra.run.smithi144.stderr:10+0 records out 2024-09-13T16:48:09.087 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128345 s, 817 MB/s 2024-09-13T16:48:09.087 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping successful for: 2024-09-13T16:48:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:09 smithi094 ceph-mon[35259]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:48:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:09 smithi094 ceph-mon[35259]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T16:48:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:09 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:09 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:09 smithi094 ceph-mon[35259]: from='osd.10 ' entity='osd.10' 2024-09-13T16:48:09.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:09 smithi144 ceph-mon[35328]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:48:09.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:09 smithi144 ceph-mon[35328]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T16:48:09.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:09 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:09.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:09 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:09.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:09 smithi144 ceph-mon[35328]: from='osd.10 ' entity='osd.10' 2024-09-13T16:48:09.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:09 smithi018 ceph-mon[30981]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2024-09-13T16:48:09.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:09 smithi018 ceph-mon[30981]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T16:48:09.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:09 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:09.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:09 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:09.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:09 smithi018 ceph-mon[30981]: from='osd.10 ' entity='osd.10' 2024-09-13T16:48:09.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi144:vg_nvme/lv_1 2024-09-13T16:48:10.140 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:48:10.393 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:10 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:48:10.393 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:10 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:48:10.393 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:10 smithi144 ceph-mon[35328]: osd.10 [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] boot 2024-09-13T16:48:10.393 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:10 smithi144 ceph-mon[35328]: osdmap e72: 11 total, 11 up, 11 in 2024-09-13T16:48:10.393 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:10 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:10.393 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:10 smithi144 ceph-mon[35328]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:10.394 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:10 smithi144 ceph-mon[35328]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T16:48:10.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:10 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:48:10.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:10 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:48:10.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:10 smithi094 ceph-mon[35259]: osd.10 [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] boot 2024-09-13T16:48:10.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:10 smithi094 ceph-mon[35259]: osdmap e72: 11 total, 11 up, 11 in 2024-09-13T16:48:10.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:10 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:10.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:10 smithi094 ceph-mon[35259]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:10.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:10 smithi094 ceph-mon[35259]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T16:48:10.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:10 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:48:10.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:10 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:48:10.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:10 smithi018 ceph-mon[30981]: osd.10 [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] boot 2024-09-13T16:48:10.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:10 smithi018 ceph-mon[30981]: osdmap e72: 11 total, 11 up, 11 in 2024-09-13T16:48:10.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:10 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T16:48:10.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:10 smithi018 ceph-mon[30981]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T16:48:10.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:10 smithi018 ceph-mon[30981]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T16:48:11.458 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi094 2024-09-13T16:48:11.458 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.458 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi094 to 4272M 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:11.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.460 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:11 smithi144 ceph-mon[35328]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T16:48:11.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi094 2024-09-13T16:48:11.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi094 to 4272M 2024-09-13T16:48:11.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:11.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:11.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:11.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:11.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:11.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:11 smithi018 ceph-mon[30981]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T16:48:11.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi094 2024-09-13T16:48:11.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:11.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi094 to 4272M 2024-09-13T16:48:11.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:11.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:11.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:11.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:11.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:11.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:11.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:11 smithi094 ceph-mon[35259]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T16:48:11.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.792+0000 7fece8c96640 1 -- 172.21.15.144:0/733706492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece40ff680 msgr2=0x7fece40ffb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:11.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.792+0000 7fece8c96640 1 --2- 172.21.15.144:0/733706492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece40ff680 0x7fece40ffb00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feccc009900 tx=0x7feccc02a410 comp rx=0 tx=0).stop 2024-09-13T16:48:11.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.792+0000 7fece8c96640 1 -- 172.21.15.144:0/733706492 shutdown_connections 2024-09-13T16:48:11.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.792+0000 7fece8c96640 1 --2- 172.21.15.144:0/733706492 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fece4100040 0x7fece41068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:11.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.792+0000 7fece8c96640 1 --2- 172.21.15.144:0/733706492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece40ff680 0x7fece40ffb00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:11.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.792+0000 7fece8c96640 1 --2- 172.21.15.144:0/733706492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fece40fe480 0x7fece40fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:11.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.792+0000 7fece8c96640 1 -- 172.21.15.144:0/733706492 >> 172.21.15.144:0/733706492 conn(0x7fece40f9c10 msgr2=0x7fece40fc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:11.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.792+0000 7fece8c96640 1 -- 172.21.15.144:0/733706492 shutdown_connections 2024-09-13T16:48:11.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.792+0000 7fece8c96640 1 -- 172.21.15.144:0/733706492 wait complete. 2024-09-13T16:48:11.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fece8c96640 1 Processor -- start 2024-09-13T16:48:11.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fece8c96640 1 -- start start 2024-09-13T16:48:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fece8c96640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fece40fe480 0x7fece4195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fece8c96640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece40ff680 0x7fece4196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fece8c96640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fece4100040 0x7fece419d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fece8c96640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece419d890 con 0x7fece40fe480 2024-09-13T16:48:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fece8c96640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece419da00 con 0x7fece4100040 2024-09-13T16:48:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fece8c96640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece419dbc0 con 0x7fece40ff680 2024-09-13T16:48:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fecdbfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece40ff680 0x7fece4196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fecdbfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece40ff680 0x7fece4196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40010/0 (socket says 172.21.15.144:40010) 2024-09-13T16:48:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.793+0000 7fecdbfff640 1 -- 172.21.15.144:0/3759418458 learned_addr learned my addr 172.21.15.144:0/3759418458 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:48:11.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fece2d9d640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fece4100040 0x7fece419d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fecdbfff640 1 -- 172.21.15.144:0/3759418458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fece4100040 msgr2=0x7fece419d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fecdbfff640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fece4100040 0x7fece419d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fecdbfff640 1 -- 172.21.15.144:0/3759418458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fece40fe480 msgr2=0x7fece4195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fecdbfff640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fece40fe480 0x7fece4195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fecdbfff640 1 -- 172.21.15.144:0/3759418458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc009560 con 0x7fece40ff680 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fecdbfff640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece40ff680 0x7fece4196330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feccc009a20 tx=0x7feccc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fecdb7fe640 1 -- 172.21.15.144:0/3759418458 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc004d80 con 0x7fece40ff680 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fece8c96640 1 -- 172.21.15.144:0/3759418458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece419de40 con 0x7fece40ff680 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fecdb7fe640 1 -- 172.21.15.144:0/3759418458 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feccc003ab0 con 0x7fece40ff680 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fecdb7fe640 1 -- 172.21.15.144:0/3759418458 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc031c40 con 0x7fece40ff680 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.794+0000 7fece8c96640 1 -- 172.21.15.144:0/3759418458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece419e2d0 con 0x7fece40ff680 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.795+0000 7fece8c96640 1 -- 172.21.15.144:0/3759418458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece41058d0 con 0x7fece40ff680 2024-09-13T16:48:11.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.796+0000 7fecdb7fe640 1 -- 172.21.15.144:0/3759418458 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7feccc003c20 con 0x7fece40ff680 2024-09-13T16:48:11.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.797+0000 7fecdb7fe640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecd00a1080 0x7fecd00a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:11.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.797+0000 7fecdb7fe640 1 -- 172.21.15.144:0/3759418458 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6694+0+0 (secure 0 0 0) 0x7feccc0ed4f0 con 0x7fece40ff680 2024-09-13T16:48:11.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.797+0000 7fece259c640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecd00a1080 0x7fecd00a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:11.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.798+0000 7fece259c640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecd00a1080 0x7fecd00a3540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fece4197280 tx=0x7fecd4006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:11.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.801+0000 7fecdb7fe640 1 -- 172.21.15.144:0/3759418458 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feccc0b72d0 con 0x7fece40ff680 2024-09-13T16:48:11.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:11.974+0000 7fece8c96640 1 -- 172.21.15.144:0/3759418458 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fece402c450 con 0x7fecd00a1080 2024-09-13T16:48:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:12 smithi144 ceph-mon[35328]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:12 smithi144 ceph-mon[35328]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T16:48:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:48:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:48:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:13.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:12 smithi094 ceph-mon[35259]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:13.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:12 smithi094 ceph-mon[35259]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T16:48:13.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:48:13.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:48:13.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:13.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:12 smithi018 ceph-mon[30981]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:13.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:12 smithi018 ceph-mon[30981]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T16:48:13.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:48:13.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:48:13.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:13.965 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:13 smithi144 ceph-mon[35328]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:48:13.965 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:13 smithi144 ceph-mon[35328]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T16:48:14.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:13 smithi094 ceph-mon[35259]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:48:14.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:13 smithi094 ceph-mon[35259]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T16:48:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:13 smithi018 ceph-mon[30981]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:48:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:13 smithi018 ceph-mon[30981]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T16:48:15.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:14 smithi094 ceph-mon[35259]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:48:15.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:14 smithi094 ceph-mon[35259]: from='client.? 172.21.15.144:0/3799923981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d65a22d5-6e7a-4000-a463-59ed1f22518c"}]: dispatch 2024-09-13T16:48:15.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:14 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d65a22d5-6e7a-4000-a463-59ed1f22518c"}]: dispatch 2024-09-13T16:48:15.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:14 smithi094 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d65a22d5-6e7a-4000-a463-59ed1f22518c"}]': finished 2024-09-13T16:48:15.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:14 smithi094 ceph-mon[35259]: osdmap e77: 12 total, 11 up, 12 in 2024-09-13T16:48:15.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:15.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:14 smithi018 ceph-mon[30981]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:48:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:14 smithi018 ceph-mon[30981]: from='client.? 172.21.15.144:0/3799923981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d65a22d5-6e7a-4000-a463-59ed1f22518c"}]: dispatch 2024-09-13T16:48:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:14 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d65a22d5-6e7a-4000-a463-59ed1f22518c"}]: dispatch 2024-09-13T16:48:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:14 smithi018 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d65a22d5-6e7a-4000-a463-59ed1f22518c"}]': finished 2024-09-13T16:48:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:14 smithi018 ceph-mon[30981]: osdmap e77: 12 total, 11 up, 12 in 2024-09-13T16:48:15.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:14 smithi144 ceph-mon[35328]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T16:48:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:14 smithi144 ceph-mon[35328]: from='client.? 172.21.15.144:0/3799923981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d65a22d5-6e7a-4000-a463-59ed1f22518c"}]: dispatch 2024-09-13T16:48:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:14 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d65a22d5-6e7a-4000-a463-59ed1f22518c"}]: dispatch 2024-09-13T16:48:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:14 smithi144 ceph-mon[35328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d65a22d5-6e7a-4000-a463-59ed1f22518c"}]': finished 2024-09-13T16:48:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:14 smithi144 ceph-mon[35328]: osdmap e77: 12 total, 11 up, 12 in 2024-09-13T16:48:15.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:16.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:15 smithi094 ceph-mon[35259]: from='client.? 172.21.15.144:0/2361243795' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:48:16.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:15 smithi018 ceph-mon[30981]: from='client.? 172.21.15.144:0/2361243795' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:48:16.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:15 smithi144 ceph-mon[35328]: from='client.? 172.21.15.144:0/2361243795' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:48:17.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:16 smithi094 ceph-mon[35259]: pgmap v249: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-13T16:48:17.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:16 smithi018 ceph-mon[30981]: pgmap v249: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-13T16:48:17.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:16 smithi144 ceph-mon[35328]: pgmap v249: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-13T16:48:19.096 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:18 smithi144 ceph-mon[35328]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:48:19.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:18 smithi094 ceph-mon[35259]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:48:19.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:18 smithi018 ceph-mon[30981]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T16:48:20.886 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:20 smithi144 ceph-mon[35328]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T16:48:21.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:20 smithi094 ceph-mon[35259]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T16:48:21.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:20 smithi018 ceph-mon[30981]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T16:48:21.957 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T16:48:21.958 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:22.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T16:48:22.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:22.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T16:48:22.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:22.973 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:22 smithi144 ceph-mon[35328]: Deploying daemon osd.11 on smithi144 2024-09-13T16:48:22.973 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:22 smithi144 ceph-mon[35328]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:23.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:22 smithi094 ceph-mon[35259]: Deploying daemon osd.11 on smithi144 2024-09-13T16:48:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:22 smithi094 ceph-mon[35259]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:23.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:22 smithi018 ceph-mon[30981]: Deploying daemon osd.11 on smithi144 2024-09-13T16:48:23.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:22 smithi018 ceph-mon[30981]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:24.952 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:24 smithi144 ceph-mon[35328]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:25.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:24 smithi094 ceph-mon[35259]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:25.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:24 smithi018 ceph-mon[30981]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:26.014 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:25 smithi144 ceph-mon[35328]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:26.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:25 smithi094 ceph-mon[35259]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:26.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:25 smithi018 ceph-mon[30981]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:27.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:27.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:27.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:27.114 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:27.114 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:27.114 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:27.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:27.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:27.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:28.018 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:27 smithi144 ceph-mon[35328]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:28.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:27 smithi094 ceph-mon[35259]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:28.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:27 smithi018 ceph-mon[30981]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:30.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.132+0000 7fecdb7fe640 1 -- 172.21.15.144:0/3759418458 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fece402c450 con 0x7fecd00a1080 2024-09-13T16:48:30.133 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 11 on host 'smithi144' 2024-09-13T16:48:30.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 -- 172.21.15.144:0/3759418458 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecd00a1080 msgr2=0x7fecd00a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:30.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecd00a1080 0x7fecd00a3540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fece4197280 tx=0x7fecd4006c90 comp rx=0 tx=0).stop 2024-09-13T16:48:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 -- 172.21.15.144:0/3759418458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece40ff680 msgr2=0x7fece4196330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece40ff680 0x7fece4196330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feccc009a20 tx=0x7feccc0046c0 comp rx=0 tx=0).stop 2024-09-13T16:48:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 -- 172.21.15.144:0/3759418458 shutdown_connections 2024-09-13T16:48:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fece4100040 0x7fece419d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece40ff680 0x7fece4196330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecd00a1080 0x7fecd00a3540 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 --2- 172.21.15.144:0/3759418458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fece40fe480 0x7fece4195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 -- 172.21.15.144:0/3759418458 >> 172.21.15.144:0/3759418458 conn(0x7fece40f9c10 msgr2=0x7fece4102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 -- 172.21.15.144:0/3759418458 shutdown_connections 2024-09-13T16:48:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:30.134+0000 7fece8c96640 1 -- 172.21.15.144:0/3759418458 wait complete. 2024-09-13T16:48:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:30 smithi018 ceph-mon[30981]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:30 smithi144 ceph-mon[35328]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.798 DEBUG:teuthology.orchestra.run.smithi144:osd.11> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.11.service 2024-09-13T16:48:30.800 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-13T16:48:30.800 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T16:48:30.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:30.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:30.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:30 smithi094 ceph-mon[35259]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:30.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:30.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:30.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:31.129 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:48:31.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:31 smithi018 ceph-mon[30981]: from='osd.11 [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:48:31.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:31 smithi018 ceph-mon[30981]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:48:31.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:31 smithi144 ceph-mon[35328]: from='osd.11 [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:48:31.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:31 smithi144 ceph-mon[35328]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:48:31.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:31 smithi094 ceph-mon[35259]: from='osd.11 [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:48:31.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:31 smithi094 ceph-mon[35259]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T16:48:32.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:32 smithi144 ceph-mon[35328]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T16:48:32.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:32 smithi144 ceph-mon[35328]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T16:48:32.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:32 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:32.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:32 smithi144 ceph-mon[35328]: from='osd.11 [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:48:32.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:32 smithi144 ceph-mon[35328]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:48:32.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:32 smithi144 ceph-mon[35328]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:32.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:32 smithi018 ceph-mon[30981]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T16:48:32.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:32 smithi018 ceph-mon[30981]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T16:48:32.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:32 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:32.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:32 smithi018 ceph-mon[30981]: from='osd.11 [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:48:32.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:32 smithi018 ceph-mon[30981]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:48:32.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:32 smithi018 ceph-mon[30981]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:32 smithi094 ceph-mon[35259]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T16:48:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:32 smithi094 ceph-mon[35259]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T16:48:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:32 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:32 smithi094 ceph-mon[35259]: from='osd.11 [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:48:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:32 smithi094 ceph-mon[35259]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2024-09-13T16:48:32.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:32 smithi094 ceph-mon[35259]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.322+0000 7f0d5a200640 1 -- 172.21.15.18:0/2836730448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d540ffc30 msgr2=0x7f0d54100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.322+0000 7f0d5a200640 1 --2- 172.21.15.18:0/2836730448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d540ffc30 0x7f0d54100030 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009900 tx=0x7f0d4802a410 comp rx=0 tx=0).stop 2024-09-13T16:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.322+0000 7f0d5a200640 1 -- 172.21.15.18:0/2836730448 shutdown_connections 2024-09-13T16:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.322+0000 7f0d5a200640 1 --2- 172.21.15.18:0/2836730448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d541017f0 0x7f0d54108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.322+0000 7f0d5a200640 1 --2- 172.21.15.18:0/2836730448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d54100e30 0x7f0d541012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.322+0000 7f0d5a200640 1 --2- 172.21.15.18:0/2836730448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d540ffc30 0x7f0d54100030 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.322+0000 7f0d5a200640 1 -- 172.21.15.18:0/2836730448 >> 172.21.15.18:0/2836730448 conn(0x7f0d540fb3c0 msgr2=0x7f0d540fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.322+0000 7f0d5a200640 1 -- 172.21.15.18:0/2836730448 shutdown_connections 2024-09-13T16:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.322+0000 7f0d5a200640 1 -- 172.21.15.18:0/2836730448 wait complete. 2024-09-13T16:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.323+0000 7f0d5a200640 1 Processor -- start 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.323+0000 7f0d5a200640 1 -- start start 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d5a200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d540ffc30 0x7f0d54197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d5a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d54100e30 0x7f0d54198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d5a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d541017f0 0x7f0d5419f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d5a200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5419f8a0 con 0x7f0d54100e30 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d5a200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5419fa10 con 0x7f0d540ffc30 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d5a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5419fbd0 con 0x7f0d541017f0 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d58e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d540ffc30 0x7f0d54197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d58e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d540ffc30 0x7f0d54197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:45622/0 (socket says 172.21.15.18:45622) 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d58e00640 1 -- 172.21.15.18:0/735707516 learned_addr learned my addr 172.21.15.18:0/735707516 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d59800640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d541017f0 0x7f0d5419f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d53e00640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d54100e30 0x7f0d54198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d58e00640 1 -- 172.21.15.18:0/735707516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d541017f0 msgr2=0x7f0d5419f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d58e00640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d541017f0 0x7f0d5419f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d58e00640 1 -- 172.21.15.18:0/735707516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d54100e30 msgr2=0x7f0d54198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.324+0000 7f0d58e00640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d54100e30 0x7f0d54198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.325+0000 7f0d58e00640 1 -- 172.21.15.18:0/735707516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48009560 con 0x7f0d540ffc30 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.325+0000 7f0d58e00640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d540ffc30 0x7f0d54197df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0d480057c0 tx=0x7f0d480055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.325+0000 7f0d51600640 1 -- 172.21.15.18:0/735707516 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48004b50 con 0x7f0d540ffc30 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.325+0000 7f0d51600640 1 -- 172.21.15.18:0/735707516 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d48004cb0 con 0x7f0d540ffc30 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.325+0000 7f0d51600640 1 -- 172.21.15.18:0/735707516 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48031ae0 con 0x7f0d540ffc30 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.325+0000 7f0d5a200640 1 -- 172.21.15.18:0/735707516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5419fe50 con 0x7f0d540ffc30 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.325+0000 7f0d5a200640 1 -- 172.21.15.18:0/735707516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d541a0210 con 0x7f0d540ffc30 2024-09-13T16:48:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.326+0000 7f0d5a200640 1 -- 172.21.15.18:0/735707516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5410b500 con 0x7f0d540ffc30 2024-09-13T16:48:33.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.328+0000 7f0d51600640 1 -- 172.21.15.18:0/735707516 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0d48003c40 con 0x7f0d540ffc30 2024-09-13T16:48:33.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.330+0000 7f0d51600640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1120 0x7f0d3c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:33.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.330+0000 7f0d51600640 1 -- 172.21.15.18:0/735707516 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f0d480ed190 con 0x7f0d540ffc30 2024-09-13T16:48:33.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.331+0000 7f0d53e00640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1120 0x7f0d3c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:33.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.331+0000 7f0d53e00640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1120 0x7f0d3c0a35e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0d541992c0 tx=0x7f0d40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:33.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.333+0000 7f0d51600640 1 -- 172.21.15.18:0/735707516 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0d480b6ef0 con 0x7f0d540ffc30 2024-09-13T16:48:33.377 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 16:48:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T16:48:33.199+0000 7f054b968640 -1 osd.11 0 waiting for initial osdmap 2024-09-13T16:48:33.418 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 16:48:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T16:48:33.213+0000 7f0542f72640 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T16:48:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.523+0000 7f0d5a200640 1 -- 172.21.15.18:0/735707516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f0d5410b710 con 0x7f0d540ffc30 2024-09-13T16:48:33.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.524+0000 7f0d51600640 1 -- 172.21.15.18:0/735707516 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7f0d480ba510 con 0x7f0d540ffc30 2024-09-13T16:48:33.526 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:48:33.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.526+0000 7f0d5a200640 1 -- 172.21.15.18:0/735707516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1120 msgr2=0x7f0d3c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:33.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.526+0000 7f0d5a200640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1120 0x7f0d3c0a35e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0d541992c0 tx=0x7f0d40005f90 comp rx=0 tx=0).stop 2024-09-13T16:48:33.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.526+0000 7f0d5a200640 1 -- 172.21.15.18:0/735707516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d540ffc30 msgr2=0x7f0d54197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:33.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.526+0000 7f0d5a200640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d540ffc30 0x7f0d54197df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0d480057c0 tx=0x7f0d480055a0 comp rx=0 tx=0).stop 2024-09-13T16:48:33.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.526+0000 7f0d5a200640 1 -- 172.21.15.18:0/735707516 shutdown_connections 2024-09-13T16:48:33.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.526+0000 7f0d5a200640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1120 0x7f0d3c0a35e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:33.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.526+0000 7f0d5a200640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d54100e30 0x7f0d54198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:33.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.526+0000 7f0d5a200640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d541017f0 0x7f0d5419f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:33.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.526+0000 7f0d5a200640 1 --2- 172.21.15.18:0/735707516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d540ffc30 0x7f0d54197df0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:33.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.526+0000 7f0d5a200640 1 -- 172.21.15.18:0/735707516 >> 172.21.15.18:0/735707516 conn(0x7f0d540fb3c0 msgr2=0x7f0d541066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:33.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.527+0000 7f0d5a200640 1 -- 172.21.15.18:0/735707516 shutdown_connections 2024-09-13T16:48:33.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:33.527+0000 7f0d5a200640 1 -- 172.21.15.18:0/735707516 wait complete. 2024-09-13T16:48:33.719 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:33 smithi144 ceph-mon[35328]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:48:33.720 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:33 smithi144 ceph-mon[35328]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T16:48:33.720 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:33 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:33.720 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:33 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:33.720 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:33 smithi144 ceph-mon[35328]: from='osd.11 ' entity='osd.11' 2024-09-13T16:48:33.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:33 smithi018 ceph-mon[30981]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:48:33.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:33 smithi018 ceph-mon[30981]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T16:48:33.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:33 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:33.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:33 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:33.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:33 smithi018 ceph-mon[30981]: from='osd.11 ' entity='osd.11' 2024-09-13T16:48:33.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:33 smithi094 ceph-mon[35259]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-13T16:48:33.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:33 smithi094 ceph-mon[35259]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T16:48:33.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:33 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:33.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:33 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:33.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:33 smithi094 ceph-mon[35259]: from='osd.11 ' entity='osd.11' 2024-09-13T16:48:34.364 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1726246089,"num_in_osds":12,"osd_in_since":1726246094,"num_remapped_pgs":0} 2024-09-13T16:48:34.607 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: purged_snaps scrub starts 2024-09-13T16:48:34.607 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: purged_snaps scrub ok 2024-09-13T16:48:34.607 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:34.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/735707516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:48:34.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: Detected new or changed devices on smithi144 2024-09-13T16:48:34.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:34.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-13T16:48:34.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:34.609 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:34.610 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.610 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: osd.11 [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] boot 2024-09-13T16:48:34.610 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: osdmap e80: 12 total, 12 up, 12 in 2024-09-13T16:48:34.610 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:34 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:34.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: purged_snaps scrub starts 2024-09-13T16:48:34.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: purged_snaps scrub ok 2024-09-13T16:48:34.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:34.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/735707516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:48:34.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: Detected new or changed devices on smithi144 2024-09-13T16:48:34.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:34.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-13T16:48:34.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:34.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:34.775 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.775 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: osd.11 [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] boot 2024-09-13T16:48:34.775 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: osdmap e80: 12 total, 12 up, 12 in 2024-09-13T16:48:34.775 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:34 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:34.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: purged_snaps scrub starts 2024-09-13T16:48:34.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: purged_snaps scrub ok 2024-09-13T16:48:34.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:34.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/735707516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:48:34.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: Detected new or changed devices on smithi144 2024-09-13T16:48:34.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-13T16:48:34.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: osd.11 [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] boot 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: osdmap e80: 12 total, 12 up, 12 in 2024-09-13T16:48:34.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:34 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T16:48:35.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T16:48:35.694 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:48:36.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:36 smithi144 ceph-mon[35328]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T16:48:36.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:36 smithi144 ceph-mon[35328]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:36.881 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:36 smithi018 ceph-mon[30981]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T16:48:36.881 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:36 smithi018 ceph-mon[30981]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:36.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:36 smithi094 ceph-mon[35259]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T16:48:36.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:36 smithi094 ceph-mon[35259]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:37.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.840+0000 7f56b0c00640 1 -- 172.21.15.18:0/3632256544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac1031f0 msgr2=0x7f56ac103670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:37.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.840+0000 7f56b0c00640 1 --2- 172.21.15.18:0/3632256544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac1031f0 0x7f56ac103670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5694009900 tx=0x7f569402a410 comp rx=0 tx=0).stop 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.840+0000 7f56b0c00640 1 -- 172.21.15.18:0/3632256544 shutdown_connections 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.840+0000 7f56b0c00640 1 --2- 172.21.15.18:0/3632256544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56ac103bb0 0x7f56ac10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.840+0000 7f56b0c00640 1 --2- 172.21.15.18:0/3632256544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac1031f0 0x7f56ac103670 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.840+0000 7f56b0c00640 1 --2- 172.21.15.18:0/3632256544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56ac101ff0 0x7f56ac1023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.840+0000 7f56b0c00640 1 -- 172.21.15.18:0/3632256544 >> 172.21.15.18:0/3632256544 conn(0x7f56ac0fd7a0 msgr2=0x7f56ac0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.840+0000 7f56b0c00640 1 -- 172.21.15.18:0/3632256544 shutdown_connections 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.840+0000 7f56b0c00640 1 -- 172.21.15.18:0/3632256544 wait complete. 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.841+0000 7f56b0c00640 1 Processor -- start 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.841+0000 7f56b0c00640 1 -- start start 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.841+0000 7f56b0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56ac101ff0 0x7f56ac197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.841+0000 7f56b0c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56ac1031f0 0x7f56ac198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.841+0000 7f56b0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac103bb0 0x7f56ac19f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.841+0000 7f56b0c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac19fac0 con 0x7f56ac101ff0 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.841+0000 7f56b0c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac19fc30 con 0x7f56ac1031f0 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.841+0000 7f56b0c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac19fdf0 con 0x7f56ac103bb0 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56a9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56ac101ff0 0x7f56ac197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56aa800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac103bb0 0x7f56ac19f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56a9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56ac101ff0 0x7f56ac197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40700/0 (socket says 172.21.15.18:40700) 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56a9e00640 1 -- 172.21.15.18:0/336884393 learned_addr learned my addr 172.21.15.18:0/336884393 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56aa800640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac103bb0 0x7f56ac19f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:53136/0 (socket says 172.21.15.18:53136) 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56a3e00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56ac1031f0 0x7f56ac198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56a9e00640 1 -- 172.21.15.18:0/336884393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac103bb0 msgr2=0x7f56ac19f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56a9e00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac103bb0 0x7f56ac19f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56a9e00640 1 -- 172.21.15.18:0/336884393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56ac1031f0 msgr2=0x7f56ac198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56a9e00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56ac1031f0 0x7f56ac198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56a9e00640 1 -- 172.21.15.18:0/336884393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a4009840 con 0x7f56ac101ff0 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.842+0000 7f56a9e00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56ac101ff0 0x7f56ac197fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f569c00d770 tx=0x7f569c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.843+0000 7f56a2a00640 1 -- 172.21.15.18:0/336884393 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c004220 con 0x7f56ac101ff0 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.843+0000 7f56a2a00640 1 -- 172.21.15.18:0/336884393 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f569c004380 con 0x7f56ac101ff0 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.843+0000 7f56a2a00640 1 -- 172.21.15.18:0/336884393 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c003da0 con 0x7f56ac101ff0 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.843+0000 7f56b0c00640 1 -- 172.21.15.18:0/336884393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5694009560 con 0x7f56ac101ff0 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.843+0000 7f56b0c00640 1 -- 172.21.15.18:0/336884393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac1a03c0 con 0x7f56ac101ff0 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.844+0000 7f56b0c00640 1 -- 172.21.15.18:0/336884393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac109530 con 0x7f56ac101ff0 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.846+0000 7f56a2a00640 1 -- 172.21.15.18:0/336884393 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f569c009820 con 0x7f56ac101ff0 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.847+0000 7f56a2a00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56900a10b0 0x7f56900a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.847+0000 7f56a2a00640 1 -- 172.21.15.18:0/336884393 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f569c0cbdf0 con 0x7f56ac101ff0 2024-09-13T16:48:37.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.847+0000 7f56a3e00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56900a10b0 0x7f56900a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:37.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.848+0000 7f56a3e00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56900a10b0 0x7f56900a3570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5694005ab0 tx=0x7f5694005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:37.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:37.851+0000 7f56a2a00640 1 -- 172.21.15.18:0/336884393 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f569c095980 con 0x7f56ac101ff0 2024-09-13T16:48:38.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.033+0000 7f56b0c00640 1 -- 172.21.15.18:0/336884393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f56ac10d8f0 con 0x7f56ac101ff0 2024-09-13T16:48:38.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.034+0000 7f56a2a00640 1 -- 172.21.15.18:0/336884393 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7f569c098fa0 con 0x7f56ac101ff0 2024-09-13T16:48:38.037 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.036+0000 7f56b0c00640 1 -- 172.21.15.18:0/336884393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56900a10b0 msgr2=0x7f56900a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.036+0000 7f56b0c00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56900a10b0 0x7f56900a3570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5694005ab0 tx=0x7f5694005780 comp rx=0 tx=0).stop 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.036+0000 7f56b0c00640 1 -- 172.21.15.18:0/336884393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56ac101ff0 msgr2=0x7f56ac197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.036+0000 7f56b0c00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56ac101ff0 0x7f56ac197fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f569c00d770 tx=0x7f569c00db70 comp rx=0 tx=0).stop 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.036+0000 7f56b0c00640 1 -- 172.21.15.18:0/336884393 shutdown_connections 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.036+0000 7f56b0c00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac103bb0 0x7f56ac19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.036+0000 7f56b0c00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56ac1031f0 0x7f56ac198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.036+0000 7f56b0c00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56900a10b0 0x7f56900a3570 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.036+0000 7f56b0c00640 1 --2- 172.21.15.18:0/336884393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56ac101ff0 0x7f56ac197fc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.036+0000 7f56b0c00640 1 -- 172.21.15.18:0/336884393 >> 172.21.15.18:0/336884393 conn(0x7f56ac0fd7a0 msgr2=0x7f56ac106700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.037+0000 7f56b0c00640 1 -- 172.21.15.18:0/336884393 shutdown_connections 2024-09-13T16:48:38.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:38.037+0000 7f56b0c00640 1 -- 172.21.15.18:0/336884393 wait complete. 2024-09-13T16:48:38.839 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1726246114,"num_in_osds":12,"osd_in_since":1726246094,"num_remapped_pgs":0} 2024-09-13T16:48:38.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T16:48:39.156 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:48:39.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:38 smithi094 ceph-mon[35259]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:39.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:38 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/336884393' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:48:39.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:38 smithi018 ceph-mon[30981]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:39.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:38 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/336884393' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:48:39.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:38 smithi144 ceph-mon[35328]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:39.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:38 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/336884393' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T16:48:41.052 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:40 smithi018 ceph-mon[30981]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:41.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:40 smithi094 ceph-mon[35259]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:41.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.155+0000 7fc292800640 1 -- 172.21.15.18:0/3850563562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc28c0ffff0 msgr2=0x7fc28c1003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:41.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.155+0000 7fc292800640 1 --2- 172.21.15.18:0/3850563562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc28c0ffff0 0x7fc28c1003d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009930 tx=0x7fc27c02a420 comp rx=0 tx=0).stop 2024-09-13T16:48:41.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.155+0000 7fc292800640 1 -- 172.21.15.18:0/3850563562 shutdown_connections 2024-09-13T16:48:41.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.155+0000 7fc292800640 1 --2- 172.21.15.18:0/3850563562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc28c105120 0x7fc28c10cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:41.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.155+0000 7fc292800640 1 --2- 172.21.15.18:0/3850563562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc28c1009a0 0x7fc28c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:41.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.155+0000 7fc292800640 1 --2- 172.21.15.18:0/3850563562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc28c0ffff0 0x7fc28c1003d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:41.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.155+0000 7fc292800640 1 -- 172.21.15.18:0/3850563562 >> 172.21.15.18:0/3850563562 conn(0x7fc28c0fba90 msgr2=0x7fc28c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:41.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.156+0000 7fc292800640 1 -- 172.21.15.18:0/3850563562 shutdown_connections 2024-09-13T16:48:41.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.156+0000 7fc292800640 1 -- 172.21.15.18:0/3850563562 wait complete. 2024-09-13T16:48:41.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.156+0000 7fc292800640 1 Processor -- start 2024-09-13T16:48:41.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc292800640 1 -- start start 2024-09-13T16:48:41.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc292800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc28c0ffff0 0x7fc28c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:41.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc292800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc28c1009a0 0x7fc28c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:41.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc292800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc28c105120 0x7fc28c19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:41.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc292800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c19d4a0 con 0x7fc28c0ffff0 2024-09-13T16:48:41.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc292800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c19d610 con 0x7fc28c105120 2024-09-13T16:48:41.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc292800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c19d780 con 0x7fc28c1009a0 2024-09-13T16:48:41.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc28b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc28c0ffff0 0x7fc28c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:41.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc28b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc28c0ffff0 0x7fc28c198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36592/0 (socket says 172.21.15.18:36592) 2024-09-13T16:48:41.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc28b400640 1 -- 172.21.15.18:0/3978475938 learned_addr learned my addr 172.21.15.18:0/3978475938 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:41.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.157+0000 7fc28be00640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc28c105120 0x7fc28c19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:41.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.158+0000 7fc28aa00640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc28c1009a0 0x7fc28c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:41.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.158+0000 7fc28b400640 1 -- 172.21.15.18:0/3978475938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc28c1009a0 msgr2=0x7fc28c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:41.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.158+0000 7fc28b400640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc28c1009a0 0x7fc28c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:41.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.158+0000 7fc28b400640 1 -- 172.21.15.18:0/3978475938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc28c105120 msgr2=0x7fc28c19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:41.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.158+0000 7fc28b400640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc28c105120 0x7fc28c19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:41.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.158+0000 7fc28b400640 1 -- 172.21.15.18:0/3978475938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c009560 con 0x7fc28c0ffff0 2024-09-13T16:48:41.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.158+0000 7fc28aa00640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc28c1009a0 0x7fc28c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:48:41.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.158+0000 7fc28b400640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc28c0ffff0 0x7fc28c198560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc27c005940 tx=0x7fc27c005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:41.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.158+0000 7fc283e00640 1 -- 172.21.15.18:0/3978475938 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c004c90 con 0x7fc28c0ffff0 2024-09-13T16:48:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.159+0000 7fc283e00640 1 -- 172.21.15.18:0/3978475938 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc27c004df0 con 0x7fc28c0ffff0 2024-09-13T16:48:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.159+0000 7fc292800640 1 -- 172.21.15.18:0/3978475938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c19da00 con 0x7fc28c0ffff0 2024-09-13T16:48:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.159+0000 7fc283e00640 1 -- 172.21.15.18:0/3978475938 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c0319d0 con 0x7fc28c0ffff0 2024-09-13T16:48:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.159+0000 7fc292800640 1 -- 172.21.15.18:0/3978475938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c1a5150 con 0x7fc28c0ffff0 2024-09-13T16:48:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.160+0000 7fc292800640 1 -- 172.21.15.18:0/3978475938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28c1014d0 con 0x7fc28c0ffff0 2024-09-13T16:48:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.162+0000 7fc283e00640 1 -- 172.21.15.18:0/3978475938 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc27c031b30 con 0x7fc28c0ffff0 2024-09-13T16:48:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.163+0000 7fc283e00640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc2700a1080 0x7fc2700a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.163+0000 7fc283e00640 1 -- 172.21.15.18:0/3978475938 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc27c0ed6b0 con 0x7fc28c0ffff0 2024-09-13T16:48:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.163+0000 7fc28aa00640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc2700a1080 0x7fc2700a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.164+0000 7fc28aa00640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc2700a1080 0x7fc2700a3540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc28c199b10 tx=0x7fc278005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.165+0000 7fc283e00640 1 -- 172.21.15.18:0/3978475938 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc27c0b72f0 con 0x7fc28c0ffff0 2024-09-13T16:48:41.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:40 smithi144 ceph-mon[35328]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:41.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.349+0000 7fc292800640 1 -- 172.21.15.18:0/3978475938 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc28c10fdb0 con 0x7fc28c0ffff0 2024-09-13T16:48:41.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.350+0000 7fc283e00640 1 -- 172.21.15.18:0/3978475938 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18336 (secure 0 0 0) 0x7fc27c0ba910 con 0x7fc28c0ffff0 2024-09-13T16:48:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:48:41.353 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:48:35.483958+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 -- 172.21.15.18:0/3978475938 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc2700a1080 msgr2=0x7fc2700a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc2700a1080 0x7fc2700a3540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc28c199b10 tx=0x7fc278005f90 comp rx=0 tx=0).stop 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 -- 172.21.15.18:0/3978475938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc28c0ffff0 msgr2=0x7fc28c198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc28c0ffff0 0x7fc28c198560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc27c005940 tx=0x7fc27c005690 comp rx=0 tx=0).stop 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 -- 172.21.15.18:0/3978475938 shutdown_connections 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc28c105120 0x7fc28c19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc28c1009a0 0x7fc28c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc2700a1080 0x7fc2700a3540 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 --2- 172.21.15.18:0/3978475938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc28c0ffff0 0x7fc28c198560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 -- 172.21.15.18:0/3978475938 >> 172.21.15.18:0/3978475938 conn(0x7fc28c0fba90 msgr2=0x7fc28c0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 -- 172.21.15.18:0/3978475938 shutdown_connections 2024-09-13T16:48:41.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:41.353+0000 7fc292800640 1 -- 172.21.15.18:0/3978475938 wait complete. 2024-09-13T16:48:42.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:41 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3978475938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:48:42.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:41 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3978475938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:48:42.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:41 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3978475938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:48:42.277 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:48:42.278 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T16:48:42.594 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:48:43.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:42 smithi018 ceph-mon[30981]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:43.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:42 smithi094 ceph-mon[35259]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:43.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:42 smithi144 ceph-mon[35328]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:44.071 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:43 smithi018 ceph-mon[30981]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:44.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:43 smithi094 ceph-mon[35259]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:44.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:43 smithi144 ceph-mon[35328]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.950+0000 7fe5fe400640 1 -- 172.21.15.18:0/2558832211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8107330 msgr2=0x7fe5f810eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.950+0000 7fe5fe400640 1 --2- 172.21.15.18:0/2558832211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8107330 0x7fe5f810eeb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009cd0 tx=0x7fe5f002a8e0 comp rx=0 tx=0).stop 2024-09-13T16:48:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.950+0000 7fe5fe400640 1 -- 172.21.15.18:0/2558832211 shutdown_connections 2024-09-13T16:48:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.950+0000 7fe5fe400640 1 --2- 172.21.15.18:0/2558832211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8107330 0x7fe5f810eeb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.950+0000 7fe5fe400640 1 --2- 172.21.15.18:0/2558832211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5f8102bb0 0x7fe5f8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.950+0000 7fe5fe400640 1 --2- 172.21.15.18:0/2558832211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8102200 0x7fe5f81025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.950+0000 7fe5fe400640 1 -- 172.21.15.18:0/2558832211 >> 172.21.15.18:0/2558832211 conn(0x7fe5f80fdc60 msgr2=0x7fe5f8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.950+0000 7fe5fe400640 1 -- 172.21.15.18:0/2558832211 shutdown_connections 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.950+0000 7fe5fe400640 1 -- 172.21.15.18:0/2558832211 wait complete. 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.951+0000 7fe5fe400640 1 Processor -- start 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.951+0000 7fe5fe400640 1 -- start start 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.951+0000 7fe5fe400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8102200 0x7fe5f8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.951+0000 7fe5fe400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5f8102bb0 0x7fe5f81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.951+0000 7fe5fe400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8107330 0x7fe5f819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.951+0000 7fe5fe400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f819d3d0 con 0x7fe5f8102200 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.951+0000 7fe5fe400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f819d540 con 0x7fe5f8102bb0 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.951+0000 7fe5fe400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f819d6b0 con 0x7fe5f8107330 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5f7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8102200 0x7fe5f8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5f7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8102200 0x7fe5f8198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36610/0 (socket says 172.21.15.18:36610) 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5f7400640 1 -- 172.21.15.18:0/3703278874 learned_addr learned my addr 172.21.15.18:0/3703278874 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5f7e00640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8107330 0x7fe5f819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5efe00640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5f8102bb0 0x7fe5f81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5f7400640 1 -- 172.21.15.18:0/3703278874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8107330 msgr2=0x7fe5f819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5f7400640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8107330 0x7fe5f819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5f7400640 1 -- 172.21.15.18:0/3703278874 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5f8102bb0 msgr2=0x7fe5f81989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5f7400640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5f8102bb0 0x7fe5f81989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5f7400640 1 -- 172.21.15.18:0/3703278874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e0009490 con 0x7fe5f8102200 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.952+0000 7fe5f7400640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8102200 0x7fe5f8198490 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e9f0 tx=0x7fe5e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.953+0000 7fe5f4c00640 1 -- 172.21.15.18:0/3703278874 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8009700 con 0x7fe5f8102200 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.953+0000 7fe5f4c00640 1 -- 172.21.15.18:0/3703278874 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5e800cd80 con 0x7fe5f8102200 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.953+0000 7fe5fe400640 1 -- 172.21.15.18:0/3703278874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f0009900 con 0x7fe5f8102200 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.953+0000 7fe5f4c00640 1 -- 172.21.15.18:0/3703278874 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8018860 con 0x7fe5f8102200 2024-09-13T16:48:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.953+0000 7fe5fe400640 1 -- 172.21.15.18:0/3703278874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f81a5080 con 0x7fe5f8102200 2024-09-13T16:48:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.954+0000 7fe5fe400640 1 -- 172.21.15.18:0/3703278874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f81036e0 con 0x7fe5f8102200 2024-09-13T16:48:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.956+0000 7fe5f4c00640 1 -- 172.21.15.18:0/3703278874 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe5e80189c0 con 0x7fe5f8102200 2024-09-13T16:48:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.957+0000 7fe5f4c00640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5dc0a1100 0x7fe5dc0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.957+0000 7fe5f4c00640 1 -- 172.21.15.18:0/3703278874 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe5e8014070 con 0x7fe5f8102200 2024-09-13T16:48:44.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.957+0000 7fe5efe00640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5dc0a1100 0x7fe5dc0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:44.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.958+0000 7fe5efe00640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5dc0a1100 0x7fe5dc0a35c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8199a40 tx=0x7fe5e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:44.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:44.961+0000 7fe5f4c00640 1 -- 172.21.15.18:0/3703278874 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe5e8052e20 con 0x7fe5f8102200 2024-09-13T16:48:45.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.140+0000 7fe5fe400640 1 -- 172.21.15.18:0/3703278874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5f81997f0 con 0x7fe5f8102200 2024-09-13T16:48:45.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.140+0000 7fe5f4c00640 1 -- 172.21.15.18:0/3703278874 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5e8096410 con 0x7fe5f8102200 2024-09-13T16:48:45.142 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T16:48:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.142+0000 7fe5fe400640 1 -- 172.21.15.18:0/3703278874 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5dc0a1100 msgr2=0x7fe5dc0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.142+0000 7fe5fe400640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5dc0a1100 0x7fe5dc0a35c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8199a40 tx=0x7fe5e0005f90 comp rx=0 tx=0).stop 2024-09-13T16:48:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.142+0000 7fe5fe400640 1 -- 172.21.15.18:0/3703278874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8102200 msgr2=0x7fe5f8198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.142+0000 7fe5fe400640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8102200 0x7fe5f8198490 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e9f0 tx=0x7fe5e800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:48:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.143+0000 7fe5fe400640 1 -- 172.21.15.18:0/3703278874 shutdown_connections 2024-09-13T16:48:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.143+0000 7fe5fe400640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8107330 0x7fe5f819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.143+0000 7fe5fe400640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5f8102bb0 0x7fe5f81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:45.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.143+0000 7fe5fe400640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5dc0a1100 0x7fe5dc0a35c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:45.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.143+0000 7fe5fe400640 1 --2- 172.21.15.18:0/3703278874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8102200 0x7fe5f8198490 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:45.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.143+0000 7fe5fe400640 1 -- 172.21.15.18:0/3703278874 >> 172.21.15.18:0/3703278874 conn(0x7fe5f80fdc60 msgr2=0x7fe5f80ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:45.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.143+0000 7fe5fe400640 1 -- 172.21.15.18:0/3703278874 shutdown_connections 2024-09-13T16:48:45.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:45.143+0000 7fe5fe400640 1 -- 172.21.15.18:0/3703278874 wait complete. 2024-09-13T16:48:45.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:45 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3703278874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:48:45.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:45 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3703278874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:48:45.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:45 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3703278874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.a on smithi018 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.d on smithi018 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.g on smithi018 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.j on smithi018 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.b on smithi094 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.e on smithi094 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.h on smithi094 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.k on smithi094 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.c on smithi144 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.f on smithi144 2024-09-13T16:48:46.068 INFO:tasks.cephadm:Adding mds.i on smithi144 2024-09-13T16:48:46.069 INFO:tasks.cephadm:Adding mds.l on smithi144 2024-09-13T16:48:46.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l' 2024-09-13T16:48:46.284 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:48:46.404 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:46 smithi144 ceph-mon[35328]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:46.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:46 smithi018 ceph-mon[30981]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:46.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:46 smithi094 ceph-mon[35259]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:47.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.945+0000 7f8312742640 1 -- 172.21.15.144:0/1656113426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c100870 msgr2=0x7f830c102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:47.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.945+0000 7f8312742640 1 --2- 172.21.15.144:0/1656113426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c100870 0x7f830c102c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009900 tx=0x7f82fc02a410 comp rx=0 tx=0).stop 2024-09-13T16:48:47.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.945+0000 7f8312742640 1 -- 172.21.15.144:0/1656113426 shutdown_connections 2024-09-13T16:48:47.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.945+0000 7f8312742640 1 --2- 172.21.15.144:0/1656113426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830c105ad0 0x7f830c107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:47.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.945+0000 7f8312742640 1 --2- 172.21.15.144:0/1656113426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f830c1031a0 0x7f830c105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:47.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.945+0000 7f8312742640 1 --2- 172.21.15.144:0/1656113426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c100870 0x7f830c102c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:47.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.945+0000 7f8312742640 1 -- 172.21.15.144:0/1656113426 >> 172.21.15.144:0/1656113426 conn(0x7f830c0fa490 msgr2=0x7f830c0fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.946+0000 7f8312742640 1 -- 172.21.15.144:0/1656113426 shutdown_connections 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.946+0000 7f8312742640 1 -- 172.21.15.144:0/1656113426 wait complete. 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.946+0000 7f8312742640 1 Processor -- start 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.946+0000 7f8312742640 1 -- start start 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.946+0000 7f8312742640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830c100870 0x7f830c1001d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.946+0000 7f8312742640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c1031a0 0x7f830c0fe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.946+0000 7f8312742640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f830c105ad0 0x7f830c0fed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f8312742640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0ff4f0 con 0x7f830c100870 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f8312742640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0ff660 con 0x7f830c105ad0 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f8312742640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c19fe40 con 0x7f830c1031a0 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f830b7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c1031a0 0x7f830c0fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f830b7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c1031a0 0x7f830c0fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43320/0 (socket says 172.21.15.144:43320) 2024-09-13T16:48:47.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f830b7fe640 1 -- 172.21.15.144:0/667047904 learned_addr learned my addr 172.21.15.144:0/667047904 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f830b7fe640 1 -- 172.21.15.144:0/667047904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f830c105ad0 msgr2=0x7f830c0fed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f830bfff640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830c100870 0x7f830c1001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f830b7fe640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f830c105ad0 0x7f830c0fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f830b7fe640 1 -- 172.21.15.144:0/667047904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830c100870 msgr2=0x7f830c1001d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f830b7fe640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830c100870 0x7f830c1001d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f830b7fe640 1 -- 172.21.15.144:0/667047904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc009560 con 0x7f830c1031a0 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f830b7fe640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c1031a0 0x7f830c0fe820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f830000d770 tx=0x7f830000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f83097fa640 1 -- 172.21.15.144:0/667047904 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300009c30 con 0x7f830c1031a0 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f83097fa640 1 -- 172.21.15.144:0/667047904 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f830000de80 con 0x7f830c1031a0 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f8312742640 1 -- 172.21.15.144:0/667047904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c1a00f0 con 0x7f830c1031a0 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f83097fa640 1 -- 172.21.15.144:0/667047904 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300004ea0 con 0x7f830c1031a0 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.947+0000 7f8312742640 1 -- 172.21.15.144:0/667047904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c1a0670 con 0x7f830c1031a0 2024-09-13T16:48:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.948+0000 7f8312742640 1 -- 172.21.15.144:0/667047904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c0fbf80 con 0x7f830c1031a0 2024-09-13T16:48:47.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.949+0000 7f83097fa640 1 -- 172.21.15.144:0/667047904 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8300005020 con 0x7f830c1031a0 2024-09-13T16:48:47.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.950+0000 7f83097fa640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82f40a1100 0x7f82f40a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:47.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.950+0000 7f83097fa640 1 -- 172.21.15.144:0/667047904 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f83000cbef0 con 0x7f830c1031a0 2024-09-13T16:48:47.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.950+0000 7f830bfff640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82f40a1100 0x7f82f40a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:47.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.951+0000 7f830bfff640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82f40a1100 0x7f82f40a35c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0057c0 tx=0x7f82fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:47.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:47.954+0000 7f83097fa640 1 -- 172.21.15.144:0/667047904 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8300095a80 con 0x7f830c1031a0 2024-09-13T16:48:48.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.134+0000 7f8312742640 1 -- 172.21.15.144:0/667047904 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f830c02c5f0 con 0x7f82f40a1100 2024-09-13T16:48:48.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.142+0000 7f83097fa640 1 -- 172.21.15.144:0/667047904 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f830c02c5f0 con 0x7f82f40a1100 2024-09-13T16:48:48.144 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mds.all update... 2024-09-13T16:48:48.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.144+0000 7f8312742640 1 -- 172.21.15.144:0/667047904 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82f40a1100 msgr2=0x7f82f40a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:48.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.144+0000 7f8312742640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82f40a1100 0x7f82f40a35c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0057c0 tx=0x7f82fc000bc0 comp rx=0 tx=0).stop 2024-09-13T16:48:48.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.144+0000 7f8312742640 1 -- 172.21.15.144:0/667047904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c1031a0 msgr2=0x7f830c0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:48.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.144+0000 7f8312742640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c1031a0 0x7f830c0fe820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f830000d770 tx=0x7f830000dc30 comp rx=0 tx=0).stop 2024-09-13T16:48:48.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.144+0000 7f8312742640 1 -- 172.21.15.144:0/667047904 shutdown_connections 2024-09-13T16:48:48.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.144+0000 7f8312742640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f830c105ad0 0x7f830c0fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:48.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.144+0000 7f8312742640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f830c1031a0 0x7f830c0fe820 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:48.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.144+0000 7f8312742640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82f40a1100 0x7f82f40a35c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:48.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.144+0000 7f8312742640 1 --2- 172.21.15.144:0/667047904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830c100870 0x7f830c1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:48.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.144+0000 7f8312742640 1 -- 172.21.15.144:0/667047904 >> 172.21.15.144:0/667047904 conn(0x7f830c0fa490 msgr2=0x7f830c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:48.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.145+0000 7f8312742640 1 -- 172.21.15.144:0/667047904 shutdown_connections 2024-09-13T16:48:48.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T16:48:48.145+0000 7f8312742640 1 -- 172.21.15.144:0/667047904 wait complete. 2024-09-13T16:48:48.798 DEBUG:teuthology.orchestra.run.smithi018:mds.a> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.a.service 2024-09-13T16:48:48.802 DEBUG:teuthology.orchestra.run.smithi018:mds.d> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.d.service 2024-09-13T16:48:48.848 DEBUG:teuthology.orchestra.run.smithi018:mds.g> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.g.service 2024-09-13T16:48:48.893 DEBUG:teuthology.orchestra.run.smithi018:mds.j> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.j.service 2024-09-13T16:48:48.938 DEBUG:teuthology.orchestra.run.smithi094:mds.b> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.b.service 2024-09-13T16:48:48.942 DEBUG:teuthology.orchestra.run.smithi094:mds.e> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.e.service 2024-09-13T16:48:48.987 DEBUG:teuthology.orchestra.run.smithi094:mds.h> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.h.service 2024-09-13T16:48:49.030 DEBUG:teuthology.orchestra.run.smithi094:mds.k> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.k.service 2024-09-13T16:48:49.073 DEBUG:teuthology.orchestra.run.smithi144:mds.c> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.c.service 2024-09-13T16:48:49.075 DEBUG:teuthology.orchestra.run.smithi144:mds.f> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.f.service 2024-09-13T16:48:49.092 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:48 smithi094 ceph-mon[35259]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:49.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:49.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:49.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:49.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:49.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:49.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:49.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:49.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:48 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:49.095 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:48 smithi144 ceph-mon[35328]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:49.095 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:49.095 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:49.095 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:49.095 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:49.095 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:49.095 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:49.095 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:49.096 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:48 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:49.096 DEBUG:teuthology.orchestra.run.smithi144:mds.i> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.i.service 2024-09-13T16:48:49.140 DEBUG:teuthology.orchestra.run.smithi144:mds.l> sudo journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.l.service 2024-09-13T16:48:49.163 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:48 smithi018 ceph-mon[30981]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:49.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:49.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:48:49.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:49.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:48:49.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:49.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:49.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:49.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:48 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:49.183 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-13T16:48:49.183 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:48:49.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.352+0000 7f4a0a600640 1 -- 172.21.15.18:0/3803593392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a04103150 msgr2=0x7f4a04105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:49.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.352+0000 7f4a0a600640 1 --2- 172.21.15.18:0/3803593392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a04103150 0x7f4a04105540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009860 tx=0x7f49f002a340 comp rx=0 tx=0).stop 2024-09-13T16:48:49.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.352+0000 7f4a0a600640 1 -- 172.21.15.18:0/3803593392 shutdown_connections 2024-09-13T16:48:49.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.352+0000 7f4a0a600640 1 --2- 172.21.15.18:0/3803593392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a04105a80 0x7f4a04107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.352+0000 7f4a0a600640 1 --2- 172.21.15.18:0/3803593392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a04103150 0x7f4a04105540 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.352+0000 7f4a0a600640 1 --2- 172.21.15.18:0/3803593392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a04100820 0x7f4a04102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.352+0000 7f4a0a600640 1 -- 172.21.15.18:0/3803593392 >> 172.21.15.18:0/3803593392 conn(0x7f4a040fa420 msgr2=0x7f4a040fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:49.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.353+0000 7f4a0a600640 1 -- 172.21.15.18:0/3803593392 shutdown_connections 2024-09-13T16:48:49.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.353+0000 7f4a0a600640 1 -- 172.21.15.18:0/3803593392 wait complete. 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a0a600640 1 Processor -- start 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a0a600640 1 -- start start 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a0a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a04100820 0x7f4a04195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a0a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a04103150 0x7f4a04196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a0a600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a04105a80 0x7f4a0419d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a0a600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0419d9d0 con 0x7f4a04103150 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a0a600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0419db40 con 0x7f4a04105a80 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a0a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0419dd00 con 0x7f4a04100820 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a02a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a04103150 0x7f4a04196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a03e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a04105a80 0x7f4a0419d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:49.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a02a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a04103150 0x7f4a04196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36624/0 (socket says 172.21.15.18:36624) 2024-09-13T16:48:49.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a02a00640 1 -- 172.21.15.18:0/417134427 learned_addr learned my addr 172.21.15.18:0/417134427 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:49.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.354+0000 7f4a03400640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a04100820 0x7f4a04195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:49.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f4a02a00640 1 -- 172.21.15.18:0/417134427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a04100820 msgr2=0x7f4a04195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:49.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f4a02a00640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a04100820 0x7f4a04195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f4a02a00640 1 -- 172.21.15.18:0/417134427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a04105a80 msgr2=0x7f4a0419d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:49.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f4a02a00640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a04105a80 0x7f4a0419d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f4a02a00640 1 -- 172.21.15.18:0/417134427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc009900 con 0x7f4a04103150 2024-09-13T16:48:49.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f4a02a00640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a04103150 0x7f4a04196420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f49f0005940 tx=0x7f49f0032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:49.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f49fbe00640 1 -- 172.21.15.18:0/417134427 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0004040 con 0x7f4a04103150 2024-09-13T16:48:49.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f49fbe00640 1 -- 172.21.15.18:0/417134427 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49f00035f0 con 0x7f4a04103150 2024-09-13T16:48:49.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f4a0a600640 1 -- 172.21.15.18:0/417134427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f0009490 con 0x7f4a04103150 2024-09-13T16:48:49.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f49fbe00640 1 -- 172.21.15.18:0/417134427 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f003e670 con 0x7f4a04103150 2024-09-13T16:48:49.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.355+0000 7f4a0a600640 1 -- 172.21.15.18:0/417134427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0419e240 con 0x7f4a04103150 2024-09-13T16:48:49.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.356+0000 7f4a0a600640 1 -- 172.21.15.18:0/417134427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a040fbf10 con 0x7f4a04103150 2024-09-13T16:48:49.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.360+0000 7f49fbe00640 1 -- 172.21.15.18:0/417134427 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f49f00039b0 con 0x7f4a04103150 2024-09-13T16:48:49.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.361+0000 7f49fbe00640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f49e80a1090 0x7f49e80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:49.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.361+0000 7f49fbe00640 1 -- 172.21.15.18:0/417134427 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f49f00ecf50 con 0x7f4a04103150 2024-09-13T16:48:49.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.361+0000 7f4a03400640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f49e80a1090 0x7f49e80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:49.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.362+0000 7f4a03400640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f49e80a1090 0x7f49e80a3550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009bd0 tx=0x7f49f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:49.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.365+0000 7f49fbe00640 1 -- 172.21.15.18:0/417134427 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f49f00b6ae0 con 0x7f4a04103150 2024-09-13T16:48:49.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.549+0000 7f4a0a600640 1 -- 172.21.15.18:0/417134427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a0402c3e0 con 0x7f4a04103150 2024-09-13T16:48:49.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.550+0000 7f49fbe00640 1 -- 172.21.15.18:0/417134427 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18336 (secure 0 0 0) 0x7f49f00ba100 con 0x7f4a04103150 2024-09-13T16:48:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:48:49.552 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:48:35.483958+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:48:49.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 -- 172.21.15.18:0/417134427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f49e80a1090 msgr2=0x7f49e80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:49.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f49e80a1090 0x7f49e80a3550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009bd0 tx=0x7f49f4005f90 comp rx=0 tx=0).stop 2024-09-13T16:48:49.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 -- 172.21.15.18:0/417134427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a04103150 msgr2=0x7f4a04196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:49.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a04103150 0x7f4a04196420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f49f0005940 tx=0x7f49f0032d20 comp rx=0 tx=0).stop 2024-09-13T16:48:49.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 -- 172.21.15.18:0/417134427 shutdown_connections 2024-09-13T16:48:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f49e80a1090 0x7f49e80a3550 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a04103150 0x7f4a04196420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a04105a80 0x7f4a0419d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 --2- 172.21.15.18:0/417134427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a04100820 0x7f4a04195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 -- 172.21.15.18:0/417134427 >> 172.21.15.18:0/417134427 conn(0x7f4a040fa420 msgr2=0x7f4a041010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 -- 172.21.15.18:0/417134427 shutdown_connections 2024-09-13T16:48:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.553+0000 7f4a0a600640 1 -- 172.21.15.18:0/417134427 wait complete. 2024-09-13T16:48:49.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:48:49.572 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:48:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.732+0000 7f047d000640 1 -- 172.21.15.18:0/2911043209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0478101f80 msgr2=0x7f0478102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.732+0000 7f047d000640 1 --2- 172.21.15.18:0/2911043209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0478101f80 0x7f0478102380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0468009900 tx=0x7f046802a410 comp rx=0 tx=0).stop 2024-09-13T16:48:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.732+0000 7f047d000640 1 -- 172.21.15.18:0/2911043209 shutdown_connections 2024-09-13T16:48:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.733+0000 7f047d000640 1 --2- 172.21.15.18:0/2911043209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0478103b30 0x7f047810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.733+0000 7f047d000640 1 --2- 172.21.15.18:0/2911043209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478103170 0x7f04781035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.733+0000 7f047d000640 1 --2- 172.21.15.18:0/2911043209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0478101f80 0x7f0478102380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.733+0000 7f047d000640 1 -- 172.21.15.18:0/2911043209 >> 172.21.15.18:0/2911043209 conn(0x7f04780fd700 msgr2=0x7f04780ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.733+0000 7f047d000640 1 -- 172.21.15.18:0/2911043209 shutdown_connections 2024-09-13T16:48:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.733+0000 7f047d000640 1 -- 172.21.15.18:0/2911043209 wait complete. 2024-09-13T16:48:49.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.733+0000 7f047d000640 1 Processor -- start 2024-09-13T16:48:49.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f047d000640 1 -- start start 2024-09-13T16:48:49.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f047d000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0478101f80 0x7f0478197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:49.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f047d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0478103170 0x7f0478198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:49.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f047d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478103b30 0x7f047819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:49.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f047d000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047819fab0 con 0x7f0478103170 2024-09-13T16:48:49.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f047d000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047819fc20 con 0x7f0478101f80 2024-09-13T16:48:49.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f047d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047819fde0 con 0x7f0478103b30 2024-09-13T16:48:49.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f0475e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0478101f80 0x7f0478197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f0475400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0478103170 0x7f0478198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f0475e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0478101f80 0x7f0478197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:37054/0 (socket says 172.21.15.18:37054) 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f0475e00640 1 -- 172.21.15.18:0/2896735981 learned_addr learned my addr 172.21.15.18:0/2896735981 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.734+0000 7f0476800640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478103b30 0x7f047819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f0475e00640 1 -- 172.21.15.18:0/2896735981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478103b30 msgr2=0x7f047819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f0475e00640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478103b30 0x7f047819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f0475e00640 1 -- 172.21.15.18:0/2896735981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0478103170 msgr2=0x7f0478198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f0475e00640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0478103170 0x7f0478198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f0475e00640 1 -- 172.21.15.18:0/2896735981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0468009560 con 0x7f0478101f80 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f0476800640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478103b30 0x7f047819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f0475e00640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0478101f80 0x7f0478197fc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0468031500 tx=0x7f0468003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:49.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f046ea00640 1 -- 172.21.15.18:0/2896735981 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468003e00 con 0x7f0478101f80 2024-09-13T16:48:49.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f046ea00640 1 -- 172.21.15.18:0/2896735981 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0468031c70 con 0x7f0478101f80 2024-09-13T16:48:49.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f047d000640 1 -- 172.21.15.18:0/2896735981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04781a0060 con 0x7f0478101f80 2024-09-13T16:48:49.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f046ea00640 1 -- 172.21.15.18:0/2896735981 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046803bdc0 con 0x7f0478101f80 2024-09-13T16:48:49.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.735+0000 7f047d000640 1 -- 172.21.15.18:0/2896735981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04781a0510 con 0x7f0478101f80 2024-09-13T16:48:49.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.736+0000 7f047d000640 1 -- 172.21.15.18:0/2896735981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0478109410 con 0x7f0478101f80 2024-09-13T16:48:49.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.740+0000 7f046ea00640 1 -- 172.21.15.18:0/2896735981 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f046803b4f0 con 0x7f0478101f80 2024-09-13T16:48:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.741+0000 7f046ea00640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f045c0a1090 0x7f045c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.741+0000 7f046ea00640 1 -- 172.21.15.18:0/2896735981 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f04680ece70 con 0x7f0478101f80 2024-09-13T16:48:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.742+0000 7f0475400640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f045c0a1090 0x7f045c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:49.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.742+0000 7f046ea00640 1 -- 172.21.15.18:0/2896735981 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f04680ba490 con 0x7f0478101f80 2024-09-13T16:48:49.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.742+0000 7f0475400640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f045c0a1090 0x7f045c0a3550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f04781994d0 tx=0x7f0464005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.926+0000 7f047d000640 1 -- 172.21.15.18:0/2896735981 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f047810d890 con 0x7f0478101f80 2024-09-13T16:48:49.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.926+0000 7f046ea00640 1 -- 172.21.15.18:0/2896735981 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04680ba020 con 0x7f0478101f80 2024-09-13T16:48:49.928 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T16:48:49.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.928+0000 7f047d000640 1 -- 172.21.15.18:0/2896735981 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f045c0a1090 msgr2=0x7f045c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:49.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.928+0000 7f047d000640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f045c0a1090 0x7f045c0a3550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f04781994d0 tx=0x7f0464005f90 comp rx=0 tx=0).stop 2024-09-13T16:48:49.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.928+0000 7f047d000640 1 -- 172.21.15.18:0/2896735981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0478101f80 msgr2=0x7f0478197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:49.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.928+0000 7f047d000640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0478101f80 0x7f0478197fc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0468031500 tx=0x7f0468003c10 comp rx=0 tx=0).stop 2024-09-13T16:48:49.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.928+0000 7f047d000640 1 -- 172.21.15.18:0/2896735981 shutdown_connections 2024-09-13T16:48:49.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.928+0000 7f047d000640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f045c0a1090 0x7f045c0a3550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.928+0000 7f047d000640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0478103170 0x7f0478198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.928+0000 7f047d000640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478103b30 0x7f047819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.928+0000 7f047d000640 1 --2- 172.21.15.18:0/2896735981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0478101f80 0x7f0478197fc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:49.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.928+0000 7f047d000640 1 -- 172.21.15.18:0/2896735981 >> 172.21.15.18:0/2896735981 conn(0x7f04780fd700 msgr2=0x7f04781065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:49.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.929+0000 7f047d000640 1 -- 172.21.15.18:0/2896735981 shutdown_connections 2024-09-13T16:48:49.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:49.929+0000 7f047d000640 1 -- 172.21.15.18:0/2896735981 wait complete. 2024-09-13T16:48:49.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:48:50.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.104+0000 7ff9ad600640 1 -- 172.21.15.18:0/3724427531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a8103190 msgr2=0x7ff9a8103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.104+0000 7ff9ad600640 1 --2- 172.21.15.18:0/3724427531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a8103190 0x7ff9a8103610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff990009900 tx=0x7ff99002a410 comp rx=0 tx=0).stop 2024-09-13T16:48:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.104+0000 7ff9ad600640 1 -- 172.21.15.18:0/3724427531 shutdown_connections 2024-09-13T16:48:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.104+0000 7ff9ad600640 1 --2- 172.21.15.18:0/3724427531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a8103190 0x7ff9a8103610 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.104+0000 7ff9ad600640 1 --2- 172.21.15.18:0/3724427531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a8103b50 0x7ff9a810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.104+0000 7ff9ad600640 1 --2- 172.21.15.18:0/3724427531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9a8101fa0 0x7ff9a81023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.104+0000 7ff9ad600640 1 -- 172.21.15.18:0/3724427531 >> 172.21.15.18:0/3724427531 conn(0x7ff9a80fd700 msgr2=0x7ff9a80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.104+0000 7ff9ad600640 1 -- 172.21.15.18:0/3724427531 shutdown_connections 2024-09-13T16:48:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.104+0000 7ff9ad600640 1 -- 172.21.15.18:0/3724427531 wait complete. 2024-09-13T16:48:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.105+0000 7ff9ad600640 1 Processor -- start 2024-09-13T16:48:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.105+0000 7ff9ad600640 1 -- start start 2024-09-13T16:48:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.105+0000 7ff9ad600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a8101fa0 0x7ff9a8197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.105+0000 7ff9ad600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a8103190 0x7ff9a81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.105+0000 7ff9ad600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9a8103b50 0x7ff9a819f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.105+0000 7ff9ad600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a819fa50 con 0x7ff9a8101fa0 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.105+0000 7ff9ad600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a819fbc0 con 0x7ff9a8103b50 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.105+0000 7ff9ad600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a819fd80 con 0x7ff9a8103190 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.105+0000 7ff9a6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a8101fa0 0x7ff9a8197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff9a6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a8101fa0 0x7ff9a8197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36670/0 (socket says 172.21.15.18:36670) 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff9a6a00640 1 -- 172.21.15.18:0/2714569340 learned_addr learned my addr 172.21.15.18:0/2714569340 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff99fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a8103190 0x7ff9a81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff9a7400640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9a8103b50 0x7ff9a819f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff9a6a00640 1 -- 172.21.15.18:0/2714569340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a8103190 msgr2=0x7ff9a81984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff9a6a00640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a8103190 0x7ff9a81984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff9a6a00640 1 -- 172.21.15.18:0/2714569340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9a8103b50 msgr2=0x7ff9a819f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff9a6a00640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9a8103b50 0x7ff9a819f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff9a6a00640 1 -- 172.21.15.18:0/2714569340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff990009560 con 0x7ff9a8101fa0 2024-09-13T16:48:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff9a6a00640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a8101fa0 0x7ff9a8197f60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff99800e9c0 tx=0x7ff99800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff99f400640 1 -- 172.21.15.18:0/2714569340 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998009700 con 0x7ff9a8101fa0 2024-09-13T16:48:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.106+0000 7ff99f400640 1 -- 172.21.15.18:0/2714569340 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9980044e0 con 0x7ff9a8101fa0 2024-09-13T16:48:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.107+0000 7ff9ad600640 1 -- 172.21.15.18:0/2714569340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a81a0060 con 0x7ff9a8101fa0 2024-09-13T16:48:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.107+0000 7ff99f400640 1 -- 172.21.15.18:0/2714569340 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998010430 con 0x7ff9a8101fa0 2024-09-13T16:48:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.107+0000 7ff9ad600640 1 -- 172.21.15.18:0/2714569340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a81a0540 con 0x7ff9a8101fa0 2024-09-13T16:48:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.108+0000 7ff9ad600640 1 -- 172.21.15.18:0/2714569340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a8109430 con 0x7ff9a8101fa0 2024-09-13T16:48:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.110+0000 7ff99f400640 1 -- 172.21.15.18:0/2714569340 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff998003f60 con 0x7ff9a8101fa0 2024-09-13T16:48:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.111+0000 7ff99f400640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff98c0a1090 0x7ff98c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.111+0000 7ff99f400640 1 -- 172.21.15.18:0/2714569340 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff998014070 con 0x7ff9a8101fa0 2024-09-13T16:48:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.111+0000 7ff99fe00640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff98c0a1090 0x7ff98c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:50.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.112+0000 7ff99fe00640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff98c0a1090 0x7ff98c0a3550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff99002aa00 tx=0x7ff9900314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:50.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.115+0000 7ff99f400640 1 -- 172.21.15.18:0/2714569340 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff998096510 con 0x7ff9a8101fa0 2024-09-13T16:48:50.153 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:49 smithi144 ceph-mon[35328]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:48:50.153 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:49 smithi144 ceph-mon[35328]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-13T16:48:50.153 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:49 smithi144 ceph-mon[35328]: Deploying daemon mds.l on smithi144 2024-09-13T16:48:50.153 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:49 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/417134427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:48:50.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:49 smithi094 ceph-mon[35259]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:48:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:49 smithi094 ceph-mon[35259]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-13T16:48:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:49 smithi094 ceph-mon[35259]: Deploying daemon mds.l on smithi144 2024-09-13T16:48:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:49 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/417134427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:48:50.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:49 smithi018 ceph-mon[30981]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:48:50.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:49 smithi018 ceph-mon[30981]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-13T16:48:50.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:49 smithi018 ceph-mon[30981]: Deploying daemon mds.l on smithi144 2024-09-13T16:48:50.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:49 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/417134427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:48:50.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.333+0000 7ff9ad600640 1 -- 172.21.15.18:0/2714569340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9a810d860 con 0x7ff9a8101fa0 2024-09-13T16:48:50.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.333+0000 7ff99f400640 1 -- 172.21.15.18:0/2714569340 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7ff998099b30 con 0x7ff9a8101fa0 2024-09-13T16:48:50.335 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:48:50.335 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-13T16:48:50.335 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 1 2024-09-13T16:48:50.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.335+0000 7ff9ad600640 1 -- 172.21.15.18:0/2714569340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff98c0a1090 msgr2=0x7ff98c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:50.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.335+0000 7ff9ad600640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff98c0a1090 0x7ff98c0a3550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff99002aa00 tx=0x7ff9900314a0 comp rx=0 tx=0).stop 2024-09-13T16:48:50.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.335+0000 7ff9ad600640 1 -- 172.21.15.18:0/2714569340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a8101fa0 msgr2=0x7ff9a8197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:50.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.335+0000 7ff9ad600640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a8101fa0 0x7ff9a8197f60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff99800e9c0 tx=0x7ff99800ee80 comp rx=0 tx=0).stop 2024-09-13T16:48:50.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.335+0000 7ff9ad600640 1 -- 172.21.15.18:0/2714569340 shutdown_connections 2024-09-13T16:48:50.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.335+0000 7ff9ad600640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9a8103b50 0x7ff9a819f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:50.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.335+0000 7ff9ad600640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a8103190 0x7ff9a81984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:50.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.335+0000 7ff9ad600640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff98c0a1090 0x7ff98c0a3550 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:50.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.335+0000 7ff9ad600640 1 --2- 172.21.15.18:0/2714569340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a8101fa0 0x7ff9a8197f60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:50.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.335+0000 7ff9ad600640 1 -- 172.21.15.18:0/2714569340 >> 172.21.15.18:0/2714569340 conn(0x7ff9a80fd700 msgr2=0x7ff9a8106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:50.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.336+0000 7ff9ad600640 1 -- 172.21.15.18:0/2714569340 shutdown_connections 2024-09-13T16:48:50.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:50.336+0000 7ff9ad600640 1 -- 172.21.15.18:0/2714569340 wait complete. 2024-09-13T16:48:50.772 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 16:48:50 smithi144 systemd[1]: Starting Ceph mds.l for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:48:50.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:50 smithi018 ceph-mon[30981]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:50.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:50 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2896735981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:48:50.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:50 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2714569340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:51.062 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:50 smithi144 ceph-mon[35328]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:51.062 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:50 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2896735981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:48:51.062 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:50 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2714569340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:51.062 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 16:48:50 smithi144 podman[65064]: 2024-09-13 16:48:50.715893051 +0000 UTC m=+0.016177559 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:48:51.063 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 16:48:50 smithi144 podman[65064]: 2024-09-13 16:48:50.828954174 +0000 UTC m=+0.129238670 container create 9c1475af95463a135afefb19e076e8cb0cdf77a181219578dd961ebd7271a2b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T16:48:51.063 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 16:48:51 smithi144 podman[65064]: 2024-09-13 16:48:51.058759876 +0000 UTC m=+0.359044386 container init 9c1475af95463a135afefb19e076e8cb0cdf77a181219578dd961ebd7271a2b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T16:48:51.063 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 16:48:51 smithi144 podman[65064]: 2024-09-13 16:48:51.061606774 +0000 UTC m=+0.361891272 container start 9c1475af95463a135afefb19e076e8cb0cdf77a181219578dd961ebd7271a2b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-l, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T16:48:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:50 smithi094 ceph-mon[35259]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:50 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2896735981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:48:51.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:50 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2714569340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:51.522 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 16:48:51 smithi144 ceph-mds[65083]: -- 172.21.15.144:0/2870333043 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564f65960d00 con 0x564f65935000 2024-09-13T16:48:51.522 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 16:48:51 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-l[65079]: starting mds.l at 2024-09-13T16:48:51.522 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 16:48:51 smithi144 bash[65064]: 9c1475af95463a135afefb19e076e8cb0cdf77a181219578dd961ebd7271a2b9 2024-09-13T16:48:51.522 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 16:48:51 smithi144 systemd[1]: Started Ceph mds.l for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:48:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.144:6832/813398687,v1:172.21.15.144:6833/813398687] up:boot 2024-09-13T16:48:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: fsmap 1 up:standby 2024-09-13T16:48:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T16:48:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:52.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:52.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:52.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: Deploying daemon mds.k on smithi094 2024-09-13T16:48:52.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:52 smithi094 ceph-mon[35259]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:52.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:48:52.409 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.144:6832/813398687,v1:172.21.15.144:6833/813398687] up:boot 2024-09-13T16:48:52.409 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: fsmap 1 up:standby 2024-09-13T16:48:52.409 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T16:48:52.409 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:52.409 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:52.410 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:52.410 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:52.410 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:52.410 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:52.410 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: Deploying daemon mds.k on smithi094 2024-09-13T16:48:52.410 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:52 smithi018 ceph-mon[30981]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:52.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.144:6832/813398687,v1:172.21.15.144:6833/813398687] up:boot 2024-09-13T16:48:52.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: fsmap 1 up:standby 2024-09-13T16:48:52.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T16:48:52.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:52.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:52.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:52.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:52.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:52.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:52.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: Deploying daemon mds.k on smithi094 2024-09-13T16:48:52.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:52 smithi144 ceph-mon[35328]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:52.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.522+0000 7ff72d800640 1 -- 172.21.15.18:0/347105145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff728103190 msgr2=0x7ff728103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:52.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.522+0000 7ff72d800640 1 --2- 172.21.15.18:0/347105145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff728103190 0x7ff728103610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff710009900 tx=0x7ff71002a400 comp rx=0 tx=0).stop 2024-09-13T16:48:52.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.522+0000 7ff72d800640 1 -- 172.21.15.18:0/347105145 shutdown_connections 2024-09-13T16:48:52.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.522+0000 7ff72d800640 1 --2- 172.21.15.18:0/347105145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728103b50 0x7ff72810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:52.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.522+0000 7ff72d800640 1 --2- 172.21.15.18:0/347105145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff728103190 0x7ff728103610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:52.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.522+0000 7ff72d800640 1 --2- 172.21.15.18:0/347105145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff728101fa0 0x7ff7281023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:52.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.522+0000 7ff72d800640 1 -- 172.21.15.18:0/347105145 >> 172.21.15.18:0/347105145 conn(0x7ff7280fd700 msgr2=0x7ff7280ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:52.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.522+0000 7ff72d800640 1 -- 172.21.15.18:0/347105145 shutdown_connections 2024-09-13T16:48:52.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.522+0000 7ff72d800640 1 -- 172.21.15.18:0/347105145 wait complete. 2024-09-13T16:48:52.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.523+0000 7ff72d800640 1 Processor -- start 2024-09-13T16:48:52.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.523+0000 7ff72d800640 1 -- start start 2024-09-13T16:48:52.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff72d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728101fa0 0x7ff728197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:52.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff72d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff728103190 0x7ff728198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff72d800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff728103b50 0x7ff72819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff72d800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72819fa20 con 0x7ff728103190 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff72d800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72819fb90 con 0x7ff728103b50 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff72d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72819fd50 con 0x7ff728101fa0 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff71fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff728103190 0x7ff728198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff727400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff728103b50 0x7ff72819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff726a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728101fa0 0x7ff728197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff71fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff728103190 0x7ff728198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57472/0 (socket says 172.21.15.18:57472) 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff71fe00640 1 -- 172.21.15.18:0/788610768 learned_addr learned my addr 172.21.15.18:0/788610768 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff727400640 1 -- 172.21.15.18:0/788610768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728101fa0 msgr2=0x7ff728197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff727400640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728101fa0 0x7ff728197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff727400640 1 -- 172.21.15.18:0/788610768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff728103190 msgr2=0x7ff728198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff727400640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff728103190 0x7ff728198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff727400640 1 -- 172.21.15.18:0/788610768 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff710009560 con 0x7ff728103b50 2024-09-13T16:48:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.524+0000 7ff726a00640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728101fa0 0x7ff728197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:48:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.525+0000 7ff727400640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff728103b50 0x7ff72819f4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff72000e940 tx=0x7ff72000ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.525+0000 7ff71f400640 1 -- 172.21.15.18:0/788610768 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720004d20 con 0x7ff728103b50 2024-09-13T16:48:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.525+0000 7ff71f400640 1 -- 172.21.15.18:0/788610768 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff720004e80 con 0x7ff728103b50 2024-09-13T16:48:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.525+0000 7ff71f400640 1 -- 172.21.15.18:0/788610768 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720011470 con 0x7ff728103b50 2024-09-13T16:48:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.525+0000 7ff72d800640 1 -- 172.21.15.18:0/788610768 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72819ffd0 con 0x7ff728103b50 2024-09-13T16:48:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.525+0000 7ff72d800640 1 -- 172.21.15.18:0/788610768 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7281a0460 con 0x7ff728103b50 2024-09-13T16:48:52.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.526+0000 7ff72d800640 1 -- 172.21.15.18:0/788610768 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff728109430 con 0x7ff728103b50 2024-09-13T16:48:52.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.528+0000 7ff71f400640 1 -- 172.21.15.18:0/788610768 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff72000cb20 con 0x7ff728103b50 2024-09-13T16:48:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.529+0000 7ff71f400640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff70c0a1110 0x7ff70c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.529+0000 7ff71f400640 1 -- 172.21.15.18:0/788610768 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff7200cc470 con 0x7ff728103b50 2024-09-13T16:48:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.529+0000 7ff726a00640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff70c0a1110 0x7ff70c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:52.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.530+0000 7ff726a00640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff70c0a1110 0x7ff70c0a35d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff728102ff0 tx=0x7ff718005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:52.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.533+0000 7ff71f400640 1 -- 172.21.15.18:0/788610768 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff7200960b0 con 0x7ff728103b50 2024-09-13T16:48:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.753+0000 7ff72d800640 1 -- 172.21.15.18:0/788610768 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff72810d860 con 0x7ff728103b50 2024-09-13T16:48:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.754+0000 7ff71f400640 1 -- 172.21.15.18:0/788610768 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1257 (secure 0 0 0) 0x7ff72001f500 con 0x7ff728103b50 2024-09-13T16:48:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:48:52.755 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T16:48:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 2 2024-09-13T16:48:52.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 -- 172.21.15.18:0/788610768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff70c0a1110 msgr2=0x7ff70c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff70c0a1110 0x7ff70c0a35d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff728102ff0 tx=0x7ff718005f90 comp rx=0 tx=0).stop 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 -- 172.21.15.18:0/788610768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff728103b50 msgr2=0x7ff72819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff728103b50 0x7ff72819f4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff72000e940 tx=0x7ff72000ee00 comp rx=0 tx=0).stop 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 -- 172.21.15.18:0/788610768 shutdown_connections 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff70c0a1110 0x7ff70c0a35d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff728103190 0x7ff728198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff728103b50 0x7ff72819f4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 --2- 172.21.15.18:0/788610768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728101fa0 0x7ff728197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 -- 172.21.15.18:0/788610768 >> 172.21.15.18:0/788610768 conn(0x7ff7280fd700 msgr2=0x7ff728106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 -- 172.21.15.18:0/788610768 shutdown_connections 2024-09-13T16:48:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:52.756+0000 7ff72d800640 1 -- 172.21.15.18:0/788610768 wait complete. 2024-09-13T16:48:53.239 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 16:48:53 smithi094 systemd[1]: Starting Ceph mds.k for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:48:53.513 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:53 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/788610768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:53.514 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 16:48:53 smithi094 podman[64716]: 2024-09-13 16:48:53.277429349 +0000 UTC m=+0.015532627 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:48:53.514 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 16:48:53 smithi094 podman[64716]: 2024-09-13 16:48:53.396870917 +0000 UTC m=+0.134974184 container create 8b97e1e7e352b572c19b6715bb67340a868fa73ad976331e964bbf4a19974421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T16:48:53.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:53 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/788610768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:53.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:53 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/788610768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:53.911 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 16:48:53 smithi094 podman[64716]: 2024-09-13 16:48:53.642164514 +0000 UTC m=+0.380267778 container init 8b97e1e7e352b572c19b6715bb67340a868fa73ad976331e964bbf4a19974421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-k, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:48:53.912 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 16:48:53 smithi094 podman[64716]: 2024-09-13 16:48:53.64490322 +0000 UTC m=+0.383006495 container start 8b97e1e7e352b572c19b6715bb67340a868fa73ad976331e964bbf4a19974421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-k, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T16:48:53.912 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 16:48:53 smithi094 ceph-mds[64735]: -- 172.21.15.94:0/965777863 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55eebf1acd00 con 0x55eebf180800 2024-09-13T16:48:53.912 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 16:48:53 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-k[64731]: starting mds.k at 2024-09-13T16:48:53.912 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 16:48:53 smithi094 bash[64716]: 8b97e1e7e352b572c19b6715bb67340a868fa73ad976331e964bbf4a19974421 2024-09-13T16:48:53.912 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 16:48:53 smithi094 systemd[1]: Started Ceph mds.k for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:48:54.774 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:48:54.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.935+0000 7f68a4c00640 1 -- 172.21.15.18:0/1147022128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a0101dc0 msgr2=0x7f68a01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:54.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.935+0000 7f68a4c00640 1 --2- 172.21.15.18:0/1147022128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a0101dc0 0x7f68a01021c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6890009ca0 tx=0x7f689002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:48:54.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.935+0000 7f68a4c00640 1 -- 172.21.15.18:0/1147022128 shutdown_connections 2024-09-13T16:48:54.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.935+0000 7f68a4c00640 1 --2- 172.21.15.18:0/1147022128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a0103970 0x7f68a010a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:54.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.935+0000 7f68a4c00640 1 --2- 172.21.15.18:0/1147022128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68a0102fb0 0x7f68a0103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:54.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.935+0000 7f68a4c00640 1 --2- 172.21.15.18:0/1147022128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a0101dc0 0x7f68a01021c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:54.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.935+0000 7f68a4c00640 1 -- 172.21.15.18:0/1147022128 >> 172.21.15.18:0/1147022128 conn(0x7f68a00fd540 msgr2=0x7f68a00ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:54.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.935+0000 7f68a4c00640 1 -- 172.21.15.18:0/1147022128 shutdown_connections 2024-09-13T16:48:54.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.935+0000 7f68a4c00640 1 -- 172.21.15.18:0/1147022128 wait complete. 2024-09-13T16:48:54.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.936+0000 7f68a4c00640 1 Processor -- start 2024-09-13T16:48:54.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.936+0000 7f68a4c00640 1 -- start start 2024-09-13T16:48:54.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.936+0000 7f68a4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a0101dc0 0x7f68a0197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.936+0000 7f68a4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a0102fb0 0x7f68a01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.936+0000 7f68a4c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68a0103970 0x7f68a019f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.936+0000 7f68a4c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a019f8a0 con 0x7f68a0101dc0 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.936+0000 7f68a4c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a019fa10 con 0x7f68a0103970 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.936+0000 7f68a4c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a019fbd0 con 0x7f68a0102fb0 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a0101dc0 0x7f68a0197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a0101dc0 0x7f68a0197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57500/0 (socket says 172.21.15.18:57500) 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689f400640 1 -- 172.21.15.18:0/2321562967 learned_addr learned my addr 172.21.15.18:0/2321562967 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f6896a00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a0102fb0 0x7f68a01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689fe00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68a0103970 0x7f68a019f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:54.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689f400640 1 -- 172.21.15.18:0/2321562967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a0102fb0 msgr2=0x7f68a01982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689f400640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a0102fb0 0x7f68a01982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689f400640 1 -- 172.21.15.18:0/2321562967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68a0103970 msgr2=0x7f68a019f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689f400640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68a0103970 0x7f68a019f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689f400640 1 -- 172.21.15.18:0/2321562967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890009900 con 0x7f68a0101dc0 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f6896a00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a0102fb0 0x7f68a01982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689fe00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68a0103970 0x7f68a019f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.937+0000 7f689f400640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a0101dc0 0x7f68a0197db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6890000f80 tx=0x7f6890003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.938+0000 7f689cc00640 1 -- 172.21.15.18:0/2321562967 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689002f310 con 0x7f68a0101dc0 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.938+0000 7f689cc00640 1 -- 172.21.15.18:0/2321562967 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6890040070 con 0x7f68a0101dc0 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.938+0000 7f68a4c00640 1 -- 172.21.15.18:0/2321562967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a019fe50 con 0x7f68a0101dc0 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.938+0000 7f689cc00640 1 -- 172.21.15.18:0/2321562967 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890004480 con 0x7f68a0101dc0 2024-09-13T16:48:54.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.938+0000 7f68a4c00640 1 -- 172.21.15.18:0/2321562967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a01a02d0 con 0x7f68a0101dc0 2024-09-13T16:48:54.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.939+0000 7f68a4c00640 1 -- 172.21.15.18:0/2321562967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a0109240 con 0x7f68a0101dc0 2024-09-13T16:48:54.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.941+0000 7f689cc00640 1 -- 172.21.15.18:0/2321562967 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6890042030 con 0x7f68a0101dc0 2024-09-13T16:48:54.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.942+0000 7f689cc00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68840a1110 0x7f68840a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:54.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.942+0000 7f689cc00640 1 -- 172.21.15.18:0/2321562967 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f68900edbd0 con 0x7f68a0101dc0 2024-09-13T16:48:54.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.942+0000 7f6896a00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68840a1110 0x7f68840a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:54.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.943+0000 7f6896a00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68840a1110 0x7f68840a35d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68a01992c0 tx=0x7f6888005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:54.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:54.946+0000 7f689cc00640 1 -- 172.21.15.18:0/2321562967 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f68900b7880 con 0x7f68a0101dc0 2024-09-13T16:48:54.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:54.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:54.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:54.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:54.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:54.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:54.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:54.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: Deploying daemon mds.j on smithi018 2024-09-13T16:48:54.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.94:6832/3502575605,v1:172.21.15.94:6833/3502575605] up:boot 2024-09-13T16:48:54.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: fsmap 2 up:standby 2024-09-13T16:48:54.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:54 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T16:48:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:55.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: Deploying daemon mds.j on smithi018 2024-09-13T16:48:55.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.94:6832/3502575605,v1:172.21.15.94:6833/3502575605] up:boot 2024-09-13T16:48:55.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: fsmap 2 up:standby 2024-09-13T16:48:55.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:54 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T16:48:55.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.166+0000 7f68a4c00640 1 -- 172.21.15.18:0/2321562967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68a010d680 con 0x7f68a0101dc0 2024-09-13T16:48:55.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.166+0000 7f689cc00640 1 -- 172.21.15.18:0/2321562967 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2014 (secure 0 0 0) 0x7f68900baea0 con 0x7f68a0101dc0 2024-09-13T16:48:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:48:55.168 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T16:48:55.168 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2024-09-13T16:48:55.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 -- 172.21.15.18:0/2321562967 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68840a1110 msgr2=0x7f68840a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:55.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68840a1110 0x7f68840a35d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68a01992c0 tx=0x7f6888005f90 comp rx=0 tx=0).stop 2024-09-13T16:48:55.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 -- 172.21.15.18:0/2321562967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a0101dc0 msgr2=0x7f68a0197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:55.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a0101dc0 0x7f68a0197db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6890000f80 tx=0x7f6890003ba0 comp rx=0 tx=0).stop 2024-09-13T16:48:55.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 -- 172.21.15.18:0/2321562967 shutdown_connections 2024-09-13T16:48:55.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f68a0103970 0x7f68a019f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:55.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a0102fb0 0x7f68a01982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:55.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68840a1110 0x7f68840a35d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:55.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 --2- 172.21.15.18:0/2321562967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a0101dc0 0x7f68a0197db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:55.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 -- 172.21.15.18:0/2321562967 >> 172.21.15.18:0/2321562967 conn(0x7f68a00fd540 msgr2=0x7f68a0106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:55.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 -- 172.21.15.18:0/2321562967 shutdown_connections 2024-09-13T16:48:55.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:55.169+0000 7f68a4c00640 1 -- 172.21.15.18:0/2321562967 wait complete. 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: Deploying daemon mds.j on smithi018 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.94:6832/3502575605,v1:172.21.15.94:6833/3502575605] up:boot 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: fsmap 2 up:standby 2024-09-13T16:48:55.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:54 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T16:48:55.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:55 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2321562967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:56.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:55 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2321562967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:56.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:55 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2321562967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:56.694 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 16:48:56 smithi018 systemd[1]: Starting Ceph mds.j for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:48:56.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:56 smithi018 ceph-mon[30981]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:56.960 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 16:48:56 smithi018 podman[70899]: 2024-09-13 16:48:56.597472359 +0000 UTC m=+0.028413417 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:48:56.960 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 16:48:56 smithi018 podman[70899]: 2024-09-13 16:48:56.713357284 +0000 UTC m=+0.144298342 container create 2460fe1f9ce078373fad055c50da5f001c3a63ed56ab392df7404c8254844e9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:48:57.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:56 smithi094 ceph-mon[35259]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:57.186 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:48:57.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:56 smithi144 ceph-mon[35328]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:57.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.350+0000 7f037f000640 1 -- 172.21.15.18:0/296250388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0378100db0 msgr2=0x7f0378101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:57.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.350+0000 7f037f000640 1 --2- 172.21.15.18:0/296250388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0378100db0 0x7f0378101230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0364009900 tx=0x7f036402a410 comp rx=0 tx=0).stop 2024-09-13T16:48:57.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.350+0000 7f037f000640 1 -- 172.21.15.18:0/296250388 shutdown_connections 2024-09-13T16:48:57.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.350+0000 7f037f000640 1 --2- 172.21.15.18:0/296250388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0378100db0 0x7f0378101230 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:57.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.350+0000 7f037f000640 1 --2- 172.21.15.18:0/296250388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0378101770 0x7f0378108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:57.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.350+0000 7f037f000640 1 --2- 172.21.15.18:0/296250388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03780ffbc0 0x7f03780fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:57.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.350+0000 7f037f000640 1 -- 172.21.15.18:0/296250388 >> 172.21.15.18:0/296250388 conn(0x7f03780fb360 msgr2=0x7f03780fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:57.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.350+0000 7f037f000640 1 -- 172.21.15.18:0/296250388 shutdown_connections 2024-09-13T16:48:57.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.350+0000 7f037f000640 1 -- 172.21.15.18:0/296250388 wait complete. 2024-09-13T16:48:57.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.351+0000 7f037f000640 1 Processor -- start 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.351+0000 7f037f000640 1 -- start start 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037f000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03780ffbc0 0x7f0378074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037f000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0378100db0 0x7f03780728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037f000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0378101770 0x7f0378072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037f000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378073540 con 0x7f03780ffbc0 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037f000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780736b0 con 0x7f0378101770 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037f000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037819fc70 con 0x7f0378100db0 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037dc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03780ffbc0 0x7f0378074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037dc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03780ffbc0 0x7f0378074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57536/0 (socket says 172.21.15.18:57536) 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037dc00640 1 -- 172.21.15.18:0/4018090442 learned_addr learned my addr 172.21.15.18:0/4018090442 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037e600640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0378101770 0x7f0378072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:57.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037d200640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0378100db0 0x7f03780728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037e600640 1 -- 172.21.15.18:0/4018090442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0378100db0 msgr2=0x7f03780728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037e600640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0378100db0 0x7f03780728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037e600640 1 -- 172.21.15.18:0/4018090442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03780ffbc0 msgr2=0x7f0378074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037e600640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03780ffbc0 0x7f0378074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037e600640 1 -- 172.21.15.18:0/4018090442 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0364009560 con 0x7f0378101770 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.352+0000 7f037dc00640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03780ffbc0 0x7f0378074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.353+0000 7f037e600640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0378101770 0x7f0378072de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f037000ea80 tx=0x7f037000ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.353+0000 7f0376000640 1 -- 172.21.15.18:0/4018090442 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037000cea0 con 0x7f0378101770 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.353+0000 7f0376000640 1 -- 172.21.15.18:0/4018090442 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0370005020 con 0x7f0378101770 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.353+0000 7f0376000640 1 -- 172.21.15.18:0/4018090442 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370010670 con 0x7f0378101770 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.353+0000 7f037f000640 1 -- 172.21.15.18:0/4018090442 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037819ff20 con 0x7f0378101770 2024-09-13T16:48:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.353+0000 7f037f000640 1 -- 172.21.15.18:0/4018090442 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03781a0350 con 0x7f0378101770 2024-09-13T16:48:57.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.354+0000 7f037f000640 1 -- 172.21.15.18:0/4018090442 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03781070a0 con 0x7f0378101770 2024-09-13T16:48:57.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.356+0000 7f0376000640 1 -- 172.21.15.18:0/4018090442 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0370005450 con 0x7f0378101770 2024-09-13T16:48:57.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.357+0000 7f0376000640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f03600a1110 0x7f03600a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:57.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.357+0000 7f0376000640 1 -- 172.21.15.18:0/4018090442 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0370014070 con 0x7f0378101770 2024-09-13T16:48:57.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.357+0000 7f037dc00640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f03600a1110 0x7f03600a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:57.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.358+0000 7f037dc00640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f03600a1110 0x7f03600a35d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f036c0058c0 tx=0x7f036c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:57.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.361+0000 7f0376000640 1 -- 172.21.15.18:0/4018090442 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f03700966c0 con 0x7f0378101770 2024-09-13T16:48:57.460 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 16:48:57 smithi018 podman[70899]: 2024-09-13 16:48:57.0079017 +0000 UTC m=+0.438842759 container init 2460fe1f9ce078373fad055c50da5f001c3a63ed56ab392df7404c8254844e9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T16:48:57.460 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 16:48:57 smithi018 podman[70899]: 2024-09-13 16:48:57.014339202 +0000 UTC m=+0.445280260 container start 2460fe1f9ce078373fad055c50da5f001c3a63ed56ab392df7404c8254844e9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0) 2024-09-13T16:48:57.460 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 16:48:57 smithi018 ceph-mds[70918]: -- 172.21.15.18:0/310967304 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5641ad240d00 con 0x5641ad215000 2024-09-13T16:48:57.460 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 16:48:57 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j[70914]: starting mds.j at 2024-09-13T16:48:57.460 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 16:48:57 smithi018 bash[70899]: 2460fe1f9ce078373fad055c50da5f001c3a63ed56ab392df7404c8254844e9b 2024-09-13T16:48:57.460 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 16:48:57 smithi018 systemd[1]: Started Ceph mds.j for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:48:57.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.585+0000 7f037f000640 1 -- 172.21.15.18:0/4018090442 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f037810b7c0 con 0x7f0378101770 2024-09-13T16:48:57.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.585+0000 7f0376000640 1 -- 172.21.15.18:0/4018090442 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2014 (secure 0 0 0) 0x7f0370099ce0 con 0x7f0378101770 2024-09-13T16:48:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:48:57.587 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T16:48:57.587 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2024-09-13T16:48:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 -- 172.21.15.18:0/4018090442 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f03600a1110 msgr2=0x7f03600a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f03600a1110 0x7f03600a35d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f036c0058c0 tx=0x7f036c005f90 comp rx=0 tx=0).stop 2024-09-13T16:48:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 -- 172.21.15.18:0/4018090442 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0378101770 msgr2=0x7f0378072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0378101770 0x7f0378072de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f037000ea80 tx=0x7f037000ef40 comp rx=0 tx=0).stop 2024-09-13T16:48:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 -- 172.21.15.18:0/4018090442 shutdown_connections 2024-09-13T16:48:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0378101770 0x7f0378072de0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0378100db0 0x7f03780728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f03600a1110 0x7f03600a35d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 --2- 172.21.15.18:0/4018090442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03780ffbc0 0x7f0378074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 -- 172.21.15.18:0/4018090442 >> 172.21.15.18:0/4018090442 conn(0x7f03780fb360 msgr2=0x7f0378104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 -- 172.21.15.18:0/4018090442 shutdown_connections 2024-09-13T16:48:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:57.588+0000 7f037f000640 1 -- 172.21.15.18:0/4018090442 wait complete. 2024-09-13T16:48:58.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:58.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:58.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:58.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:58.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:58.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:58.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: Deploying daemon mds.d on smithi018 2024-09-13T16:48:58.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4018090442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:58.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:58.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.18:6834/1281964026,v1:172.21.15.18:6835/1281964026] up:boot 2024-09-13T16:48:58.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: fsmap 3 up:standby 2024-09-13T16:48:58.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:48:58 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T16:48:58.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:58.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:58.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:58.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:58.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:58.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:58.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: Deploying daemon mds.d on smithi018 2024-09-13T16:48:58.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/4018090442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:58.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:58.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.18:6834/1281964026,v1:172.21.15.18:6835/1281964026] up:boot 2024-09-13T16:48:58.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: fsmap 3 up:standby 2024-09-13T16:48:58.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:48:58 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: Deploying daemon mds.d on smithi018 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/4018090442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.18:6834/1281964026,v1:172.21.15.18:6835/1281964026] up:boot 2024-09-13T16:48:58.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: fsmap 3 up:standby 2024-09-13T16:48:58.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:48:58 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T16:48:59.609 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:48:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.832+0000 7fe759c00640 1 -- 172.21.15.18:0/4118114742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe754100f90 msgr2=0x7fe754101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.832+0000 7fe759c00640 1 --2- 172.21.15.18:0/4118114742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe754100f90 0x7fe754101410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009900 tx=0x7fe73c02a410 comp rx=0 tx=0).stop 2024-09-13T16:48:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.832+0000 7fe759c00640 1 -- 172.21.15.18:0/4118114742 shutdown_connections 2024-09-13T16:48:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.832+0000 7fe759c00640 1 --2- 172.21.15.18:0/4118114742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe754100f90 0x7fe754101410 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.832+0000 7fe759c00640 1 --2- 172.21.15.18:0/4118114742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe754101950 0x7fe7541081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.832+0000 7fe759c00640 1 --2- 172.21.15.18:0/4118114742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7540ffda0 0x7fe7541001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.832+0000 7fe759c00640 1 -- 172.21.15.18:0/4118114742 >> 172.21.15.18:0/4118114742 conn(0x7fe7540fb520 msgr2=0x7fe7540fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:48:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.832+0000 7fe759c00640 1 -- 172.21.15.18:0/4118114742 shutdown_connections 2024-09-13T16:48:59.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.832+0000 7fe759c00640 1 -- 172.21.15.18:0/4118114742 wait complete. 2024-09-13T16:48:59.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.833+0000 7fe759c00640 1 Processor -- start 2024-09-13T16:48:59.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.833+0000 7fe759c00640 1 -- start start 2024-09-13T16:48:59.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe759c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7540ffda0 0x7fe754074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:59.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe759c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe754100f90 0x7fe7540728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe759c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe754101950 0x7fe754072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe759c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe754073540 con 0x7fe7540ffda0 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe759c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540736b0 con 0x7fe754100f90 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe759c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75419fdd0 con 0x7fe754101950 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe752a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7540ffda0 0x7fe754074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe752a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7540ffda0 0x7fe754074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57552/0 (socket says 172.21.15.18:57552) 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe74be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe754100f90 0x7fe7540728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe752a00640 1 -- 172.21.15.18:0/1529646882 learned_addr learned my addr 172.21.15.18:0/1529646882 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe753400640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe754101950 0x7fe754072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe753400640 1 -- 172.21.15.18:0/1529646882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe754100f90 msgr2=0x7fe7540728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe753400640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe754100f90 0x7fe7540728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe753400640 1 -- 172.21.15.18:0/1529646882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7540ffda0 msgr2=0x7fe754074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:48:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe753400640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7540ffda0 0x7fe754074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:48:59.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe753400640 1 -- 172.21.15.18:0/1529646882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c009560 con 0x7fe754101950 2024-09-13T16:48:59.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.834+0000 7fe752a00640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7540ffda0 0x7fe754074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:48:59.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.835+0000 7fe753400640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe754101950 0x7fe754072de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009fd0 tx=0x7fe74c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:59.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.835+0000 7fe74b400640 1 -- 172.21.15.18:0/1529646882 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00ce20 con 0x7fe754101950 2024-09-13T16:48:59.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.835+0000 7fe759c00640 1 -- 172.21.15.18:0/1529646882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7541a0080 con 0x7fe754101950 2024-09-13T16:48:59.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.835+0000 7fe74b400640 1 -- 172.21.15.18:0/1529646882 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe74c005020 con 0x7fe754101950 2024-09-13T16:48:59.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.835+0000 7fe74b400640 1 -- 172.21.15.18:0/1529646882 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c010670 con 0x7fe754101950 2024-09-13T16:48:59.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.835+0000 7fe759c00640 1 -- 172.21.15.18:0/1529646882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7541a0560 con 0x7fe754101950 2024-09-13T16:48:59.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.836+0000 7fe759c00640 1 -- 172.21.15.18:0/1529646882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe754107250 con 0x7fe754101950 2024-09-13T16:48:59.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.838+0000 7fe74b400640 1 -- 172.21.15.18:0/1529646882 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe74c005450 con 0x7fe754101950 2024-09-13T16:48:59.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.839+0000 7fe74b400640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7380a1090 0x7fe7380a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:48:59.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.840+0000 7fe74b400640 1 -- 172.21.15.18:0/1529646882 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe74c014070 con 0x7fe754101950 2024-09-13T16:48:59.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.840+0000 7fe752a00640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7380a1090 0x7fe7380a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:48:59.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.841+0000 7fe752a00640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7380a1090 0x7fe7380a3550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe7440058c0 tx=0x7fe744005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:48:59.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:48:59.843+0000 7fe74b400640 1 -- 172.21.15.18:0/1529646882 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe74c096750 con 0x7fe754101950 2024-09-13T16:49:00.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.065+0000 7fe759c00640 1 -- 172.21.15.18:0/1529646882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe75410b660 con 0x7fe754101950 2024-09-13T16:49:00.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.067+0000 7fe74b400640 1 -- 172.21.15.18:0/1529646882 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2771 (secure 0 0 0) 0x7fe74c099d70 con 0x7fe754101950 2024-09-13T16:49:00.068 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:00.068 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T16:49:00.068 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 4 2024-09-13T16:49:00.069 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 16:48:59 smithi018 systemd[1]: Starting Ceph mds.d for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:49:00.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 -- 172.21.15.18:0/1529646882 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7380a1090 msgr2=0x7fe7380a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:00.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7380a1090 0x7fe7380a3550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe7440058c0 tx=0x7fe744005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:00.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 -- 172.21.15.18:0/1529646882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe754101950 msgr2=0x7fe754072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:00.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe754101950 0x7fe754072de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009fd0 tx=0x7fe74c00ef10 comp rx=0 tx=0).stop 2024-09-13T16:49:00.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 -- 172.21.15.18:0/1529646882 shutdown_connections 2024-09-13T16:49:00.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe754101950 0x7fe754072de0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:00.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe754100f90 0x7fe7540728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:00.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7380a1090 0x7fe7380a3550 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:00.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 --2- 172.21.15.18:0/1529646882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7540ffda0 0x7fe754074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:00.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 -- 172.21.15.18:0/1529646882 >> 172.21.15.18:0/1529646882 conn(0x7fe7540fb520 msgr2=0x7fe754104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:00.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 -- 172.21.15.18:0/1529646882 shutdown_connections 2024-09-13T16:49:00.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:00.069+0000 7fe759c00640 1 -- 172.21.15.18:0/1529646882 wait complete. 2024-09-13T16:49:00.382 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 16:49:00 smithi018 podman[71279]: 2024-09-13 16:48:59.972502759 +0000 UTC m=+0.027887087 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:49:00.382 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 16:49:00 smithi018 podman[71279]: 2024-09-13 16:49:00.119911071 +0000 UTC m=+0.175295405 container create b34164176946891f7b7d40c0dca879263e416a45e801fa79443c63297219ad24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:49:00.382 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 16:49:00 smithi018 podman[71279]: 2024-09-13 16:49:00.381406142 +0000 UTC m=+0.436790470 container init b34164176946891f7b7d40c0dca879263e416a45e801fa79443c63297219ad24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-13T16:49:00.709 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 16:49:00 smithi018 podman[71279]: 2024-09-13 16:49:00.387730612 +0000 UTC m=+0.443114940 container start b34164176946891f7b7d40c0dca879263e416a45e801fa79443c63297219ad24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:49:00.710 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 16:49:00 smithi018 ceph-mds[71300]: -- 172.21.15.18:0/103860634 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d08799ed00 con 0x55d087973400 2024-09-13T16:49:00.710 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 16:49:00 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-d[71296]: starting mds.d at 2024-09-13T16:49:00.710 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 16:49:00 smithi018 bash[71279]: b34164176946891f7b7d40c0dca879263e416a45e801fa79443c63297219ad24 2024-09-13T16:49:00.710 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 16:49:00 smithi018 systemd[1]: Started Ceph mds.d for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:49:01.109 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:00 smithi094 ceph-mon[35259]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:01.110 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:00 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1529646882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:01.110 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:00 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:01.110 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:00 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:01.110 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:00 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:01.110 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:00 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:01.110 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:00 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:01.110 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:00 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:01.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:00 smithi018 ceph-mon[30981]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:01.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:00 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1529646882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:01.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:00 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:01.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:00 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:01.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:00 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:01.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:00 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:01.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:00 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:01.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:00 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:00 smithi144 ceph-mon[35328]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:00 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1529646882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:00 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:00 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:00 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:00 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:00 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:00 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:02.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:02.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:01 smithi094 ceph-mon[35259]: Deploying daemon mds.e on smithi094 2024-09-13T16:49:02.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:01 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.18:6836/2164016233,v1:172.21.15.18:6837/2164016233] up:boot 2024-09-13T16:49:02.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:01 smithi094 ceph-mon[35259]: fsmap 4 up:standby 2024-09-13T16:49:02.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:01 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T16:49:02.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:01 smithi018 ceph-mon[30981]: Deploying daemon mds.e on smithi094 2024-09-13T16:49:02.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:01 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.18:6836/2164016233,v1:172.21.15.18:6837/2164016233] up:boot 2024-09-13T16:49:02.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:01 smithi018 ceph-mon[30981]: fsmap 4 up:standby 2024-09-13T16:49:02.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:01 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T16:49:02.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.255+0000 7fbf35e00640 1 -- 172.21.15.18:0/2172878824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf300ffda0 msgr2=0x7fbf301001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:02.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.255+0000 7fbf35e00640 1 --2- 172.21.15.18:0/2172878824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf300ffda0 0x7fbf301001a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009900 tx=0x7fbf2002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:02.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.255+0000 7fbf35e00640 1 -- 172.21.15.18:0/2172878824 shutdown_connections 2024-09-13T16:49:02.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.255+0000 7fbf35e00640 1 --2- 172.21.15.18:0/2172878824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf30101950 0x7fbf301081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:02.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.255+0000 7fbf35e00640 1 --2- 172.21.15.18:0/2172878824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf30100f90 0x7fbf30101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:02.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.255+0000 7fbf35e00640 1 --2- 172.21.15.18:0/2172878824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf300ffda0 0x7fbf301001a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:02.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.255+0000 7fbf35e00640 1 -- 172.21.15.18:0/2172878824 >> 172.21.15.18:0/2172878824 conn(0x7fbf300fb520 msgr2=0x7fbf300fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:02.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.255+0000 7fbf35e00640 1 -- 172.21.15.18:0/2172878824 shutdown_connections 2024-09-13T16:49:02.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.255+0000 7fbf35e00640 1 -- 172.21.15.18:0/2172878824 wait complete. 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.256+0000 7fbf35e00640 1 Processor -- start 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.256+0000 7fbf35e00640 1 -- start start 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf35e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf300ffda0 0x7fbf30198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf35e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf30100f90 0x7fbf30198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf35e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf30101950 0x7fbf3019f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf35e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3019fb30 con 0x7fbf300ffda0 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf35e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3019fca0 con 0x7fbf30101950 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf35e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3019fe60 con 0x7fbf30100f90 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf2ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf300ffda0 0x7fbf30198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf2ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf300ffda0 0x7fbf30198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52268/0 (socket says 172.21.15.18:52268) 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf2ea00640 1 -- 172.21.15.18:0/1261917990 learned_addr learned my addr 172.21.15.18:0/1261917990 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf2e000640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf30100f90 0x7fbf30198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf2f400640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf30101950 0x7fbf3019f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf2ea00640 1 -- 172.21.15.18:0/1261917990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf30100f90 msgr2=0x7fbf30198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf2ea00640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf30100f90 0x7fbf30198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf2ea00640 1 -- 172.21.15.18:0/1261917990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf30101950 msgr2=0x7fbf3019f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf2ea00640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf30101950 0x7fbf3019f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.257+0000 7fbf2ea00640 1 -- 172.21.15.18:0/1261917990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c009490 con 0x7fbf300ffda0 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.258+0000 7fbf2f400640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf30101950 0x7fbf3019f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.258+0000 7fbf2ea00640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf300ffda0 0x7fbf30198040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbf20031500 tx=0x7fbf20003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.258+0000 7fbf34a00640 1 -- 172.21.15.18:0/1261917990 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20003e00 con 0x7fbf300ffda0 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.258+0000 7fbf34a00640 1 -- 172.21.15.18:0/1261917990 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf20031c70 con 0x7fbf300ffda0 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.258+0000 7fbf34a00640 1 -- 172.21.15.18:0/1261917990 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2003bc20 con 0x7fbf300ffda0 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.258+0000 7fbf35e00640 1 -- 172.21.15.18:0/1261917990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf20009560 con 0x7fbf300ffda0 2024-09-13T16:49:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.258+0000 7fbf35e00640 1 -- 172.21.15.18:0/1261917990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf301a03b0 con 0x7fbf300ffda0 2024-09-13T16:49:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.259+0000 7fbf35e00640 1 -- 172.21.15.18:0/1261917990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3010b6b0 con 0x7fbf300ffda0 2024-09-13T16:49:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.261+0000 7fbf34a00640 1 -- 172.21.15.18:0/1261917990 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbf200317b0 con 0x7fbf300ffda0 2024-09-13T16:49:02.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.262+0000 7fbf34a00640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf140a1110 0x7fbf140a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.262+0000 7fbf34a00640 1 -- 172.21.15.18:0/1261917990 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbf200ecc50 con 0x7fbf300ffda0 2024-09-13T16:49:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.263+0000 7fbf2e000640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf140a1110 0x7fbf140a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.263+0000 7fbf2e000640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf140a1110 0x7fbf140a35d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf30199550 tx=0x7fbf1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.266+0000 7fbf34a00640 1 -- 172.21.15.18:0/1261917990 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbf200b6890 con 0x7fbf300ffda0 2024-09-13T16:49:02.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:01 smithi144 ceph-mon[35328]: Deploying daemon mds.e on smithi094 2024-09-13T16:49:02.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:01 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.18:6836/2164016233,v1:172.21.15.18:6837/2164016233] up:boot 2024-09-13T16:49:02.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:01 smithi144 ceph-mon[35328]: fsmap 4 up:standby 2024-09-13T16:49:02.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:01 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T16:49:02.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.483+0000 7fbf35e00640 1 -- 172.21.15.18:0/1261917990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf3010b8c0 con 0x7fbf300ffda0 2024-09-13T16:49:02.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.484+0000 7fbf34a00640 1 -- 172.21.15.18:0/1261917990 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3528 (secure 0 0 0) 0x7fbf20049de0 con 0x7fbf300ffda0 2024-09-13T16:49:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:02.486 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T16:49:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 5 2024-09-13T16:49:02.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 -- 172.21.15.18:0/1261917990 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf140a1110 msgr2=0x7fbf140a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:02.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf140a1110 0x7fbf140a35d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf30199550 tx=0x7fbf1c005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:02.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 -- 172.21.15.18:0/1261917990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf300ffda0 msgr2=0x7fbf30198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:02.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf300ffda0 0x7fbf30198040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbf20031500 tx=0x7fbf20003c10 comp rx=0 tx=0).stop 2024-09-13T16:49:02.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 -- 172.21.15.18:0/1261917990 shutdown_connections 2024-09-13T16:49:02.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf30101950 0x7fbf3019f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf30100f90 0x7fbf30198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbf140a1110 0x7fbf140a35d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 --2- 172.21.15.18:0/1261917990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf300ffda0 0x7fbf30198040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 -- 172.21.15.18:0/1261917990 >> 172.21.15.18:0/1261917990 conn(0x7fbf300fb520 msgr2=0x7fbf30106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 -- 172.21.15.18:0/1261917990 shutdown_connections 2024-09-13T16:49:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:02.486+0000 7fbf35e00640 1 -- 172.21.15.18:0/1261917990 wait complete. 2024-09-13T16:49:02.662 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 16:49:02 smithi094 systemd[1]: Starting Ceph mds.e for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:49:03.034 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:02 smithi094 ceph-mon[35259]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:03.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:02 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1261917990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:03.035 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 16:49:02 smithi094 podman[65037]: 2024-09-13 16:49:02.672835685 +0000 UTC m=+0.016068417 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:49:03.035 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 16:49:02 smithi094 podman[65037]: 2024-09-13 16:49:02.772057977 +0000 UTC m=+0.115290700 container create 0d92e712d87097f07035b56c81b347b6a7abc7c168eb2477b3f959d4ff87d781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731) 2024-09-13T16:49:03.035 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 16:49:03 smithi094 podman[65037]: 2024-09-13 16:49:03.034134119 +0000 UTC m=+0.377366845 container init 0d92e712d87097f07035b56c81b347b6a7abc7c168eb2477b3f959d4ff87d781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-e, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T16:49:03.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:02 smithi018 ceph-mon[30981]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:03.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:02 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1261917990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:03.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:02 smithi144 ceph-mon[35328]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:03.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:02 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1261917990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:03.412 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 16:49:03 smithi094 podman[65037]: 2024-09-13 16:49:03.037170482 +0000 UTC m=+0.380403208 container start 0d92e712d87097f07035b56c81b347b6a7abc7c168eb2477b3f959d4ff87d781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-13T16:49:03.412 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 16:49:03 smithi094 ceph-mds[65056]: -- 172.21.15.94:0/2615810453 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556c62714d00 con 0x556c626e9400 2024-09-13T16:49:03.412 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 16:49:03 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-e[65052]: starting mds.e at 2024-09-13T16:49:03.412 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 16:49:03 smithi094 bash[65037]: 0d92e712d87097f07035b56c81b347b6a7abc7c168eb2477b3f959d4ff87d781 2024-09-13T16:49:03.412 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 16:49:03 smithi094 systemd[1]: Started Ceph mds.e for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:49:04.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:04.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:04.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:04.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:04.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:04.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:04.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: Deploying daemon mds.f on smithi144 2024-09-13T16:49:04.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:04.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.94:6834/3926764648,v1:172.21.15.94:6835/3926764648] up:boot 2024-09-13T16:49:04.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: fsmap 5 up:standby 2024-09-13T16:49:04.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T16:49:04.505 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:04.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:04.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:04.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:04.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:04.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:04.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:04.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: Deploying daemon mds.f on smithi144 2024-09-13T16:49:04.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:04.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.94:6834/3926764648,v1:172.21.15.94:6835/3926764648] up:boot 2024-09-13T16:49:04.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: fsmap 5 up:standby 2024-09-13T16:49:04.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: Deploying daemon mds.f on smithi144 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.94:6834/3926764648,v1:172.21.15.94:6835/3926764648] up:boot 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: fsmap 5 up:standby 2024-09-13T16:49:04.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T16:49:04.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.673+0000 7fd1e1400640 1 -- 172.21.15.18:0/3453215971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1dc0ffda0 msgr2=0x7fd1dc1001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:04.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.673+0000 7fd1e1400640 1 --2- 172.21.15.18:0/3453215971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1dc0ffda0 0x7fd1dc1001a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009900 tx=0x7fd1cc02a410 comp rx=0 tx=0).stop 2024-09-13T16:49:04.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.673+0000 7fd1e1400640 1 -- 172.21.15.18:0/3453215971 shutdown_connections 2024-09-13T16:49:04.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.673+0000 7fd1e1400640 1 --2- 172.21.15.18:0/3453215971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1dc101950 0x7fd1dc1081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:04.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.673+0000 7fd1e1400640 1 --2- 172.21.15.18:0/3453215971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1dc100f90 0x7fd1dc101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:04.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.673+0000 7fd1e1400640 1 --2- 172.21.15.18:0/3453215971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1dc0ffda0 0x7fd1dc1001a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:04.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.673+0000 7fd1e1400640 1 -- 172.21.15.18:0/3453215971 >> 172.21.15.18:0/3453215971 conn(0x7fd1dc0fb520 msgr2=0x7fd1dc0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:04.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.673+0000 7fd1e1400640 1 -- 172.21.15.18:0/3453215971 shutdown_connections 2024-09-13T16:49:04.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.673+0000 7fd1e1400640 1 -- 172.21.15.18:0/3453215971 wait complete. 2024-09-13T16:49:04.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.674+0000 7fd1e1400640 1 Processor -- start 2024-09-13T16:49:04.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.674+0000 7fd1e1400640 1 -- start start 2024-09-13T16:49:04.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.674+0000 7fd1e1400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1dc0ffda0 0x7fd1dc195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:04.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.674+0000 7fd1e1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1dc100f90 0x7fd1dc196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:04.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.674+0000 7fd1e1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1dc101950 0x7fd1dc19d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:04.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.674+0000 7fd1e1400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc19d8d0 con 0x7fd1dc101950 2024-09-13T16:49:04.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.674+0000 7fd1e1400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc19da40 con 0x7fd1dc0ffda0 2024-09-13T16:49:04.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.674+0000 7fd1e1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc19dc00 con 0x7fd1dc100f90 2024-09-13T16:49:04.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1db200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1dc101950 0x7fd1dc19d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:04.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1dc100f90 0x7fd1dc196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:04.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1db200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1dc101950 0x7fd1dc19d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52276/0 (socket says 172.21.15.18:52276) 2024-09-13T16:49:04.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1da800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1dc0ffda0 0x7fd1dc195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1db200640 1 -- 172.21.15.18:0/3292040172 learned_addr learned my addr 172.21.15.18:0/3292040172 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1db200640 1 -- 172.21.15.18:0/3292040172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1dc100f90 msgr2=0x7fd1dc196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1db200640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1dc100f90 0x7fd1dc196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1db200640 1 -- 172.21.15.18:0/3292040172 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1dc0ffda0 msgr2=0x7fd1dc195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1db200640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1dc0ffda0 0x7fd1dc195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1db200640 1 -- 172.21.15.18:0/3292040172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc009560 con 0x7fd1dc101950 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.675+0000 7fd1db200640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1dc101950 0x7fd1dc19d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400eb10 tx=0x7fd1d400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.676+0000 7fd1d3e00640 1 -- 172.21.15.18:0/3292040172 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4004b20 con 0x7fd1dc101950 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.676+0000 7fd1d3e00640 1 -- 172.21.15.18:0/3292040172 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1d4004c80 con 0x7fd1dc101950 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.676+0000 7fd1e1400640 1 -- 172.21.15.18:0/3292040172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc19dee0 con 0x7fd1dc101950 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.676+0000 7fd1d3e00640 1 -- 172.21.15.18:0/3292040172 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4010690 con 0x7fd1dc101950 2024-09-13T16:49:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.676+0000 7fd1e1400640 1 -- 172.21.15.18:0/3292040172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc19e360 con 0x7fd1dc101950 2024-09-13T16:49:04.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.677+0000 7fd1e1400640 1 -- 172.21.15.18:0/3292040172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc107220 con 0x7fd1dc101950 2024-09-13T16:49:04.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.679+0000 7fd1d3e00640 1 -- 172.21.15.18:0/3292040172 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd1d4005020 con 0x7fd1dc101950 2024-09-13T16:49:04.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.681+0000 7fd1d3e00640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd1c00a1090 0x7fd1c00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:04.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.681+0000 7fd1d3e00640 1 -- 172.21.15.18:0/3292040172 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd1d4014070 con 0x7fd1dc101950 2024-09-13T16:49:04.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.681+0000 7fd1da800640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd1c00a1090 0x7fd1c00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:04.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.682+0000 7fd1da800640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd1c00a1090 0x7fd1c00a3550 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc031500 tx=0x7fd1cc005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:04.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.685+0000 7fd1d3e00640 1 -- 172.21.15.18:0/3292040172 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd1d4096550 con 0x7fd1dc101950 2024-09-13T16:49:04.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.906+0000 7fd1e1400640 1 -- 172.21.15.18:0/3292040172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1dc02c3e0 con 0x7fd1dc101950 2024-09-13T16:49:04.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.906+0000 7fd1d3e00640 1 -- 172.21.15.18:0/3292040172 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4285 (secure 0 0 0) 0x7fd1d4099b70 con 0x7fd1dc101950 2024-09-13T16:49:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:04.908 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-09-13T16:49:04.909 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-13T16:49:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 -- 172.21.15.18:0/3292040172 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd1c00a1090 msgr2=0x7fd1c00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd1c00a1090 0x7fd1c00a3550 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc031500 tx=0x7fd1cc005780 comp rx=0 tx=0).stop 2024-09-13T16:49:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 -- 172.21.15.18:0/3292040172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1dc101950 msgr2=0x7fd1dc19d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1dc101950 0x7fd1dc19d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400eb10 tx=0x7fd1d400c2d0 comp rx=0 tx=0).stop 2024-09-13T16:49:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 -- 172.21.15.18:0/3292040172 shutdown_connections 2024-09-13T16:49:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd1c00a1090 0x7fd1c00a3550 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1dc101950 0x7fd1dc19d390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1dc100f90 0x7fd1dc196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 --2- 172.21.15.18:0/3292040172 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd1dc0ffda0 0x7fd1dc195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 -- 172.21.15.18:0/3292040172 >> 172.21.15.18:0/3292040172 conn(0x7fd1dc0fb520 msgr2=0x7fd1dc1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 -- 172.21.15.18:0/3292040172 shutdown_connections 2024-09-13T16:49:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:04.909+0000 7fd1e1400640 1 -- 172.21.15.18:0/3292040172 wait complete. 2024-09-13T16:49:05.193 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 16:49:05 smithi144 systemd[1]: Starting Ceph mds.f for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:49:05.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:05 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3292040172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:05.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:05 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3292040172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:05.522 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 16:49:05 smithi144 podman[65368]: 2024-09-13 16:49:05.169176907 +0000 UTC m=+0.015589821 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:49:05.522 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 16:49:05 smithi144 podman[65368]: 2024-09-13 16:49:05.294150886 +0000 UTC m=+0.140563793 container create 41e9cd222da81b6fcfe8fe6aaa9451de540b2f6a4941fc1cdad01ca5cd8c2f04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-13T16:49:05.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:05 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3292040172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:06.022 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 16:49:05 smithi144 podman[65368]: 2024-09-13 16:49:05.549951968 +0000 UTC m=+0.396364882 container init 41e9cd222da81b6fcfe8fe6aaa9451de540b2f6a4941fc1cdad01ca5cd8c2f04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:49:06.022 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 16:49:05 smithi144 podman[65368]: 2024-09-13 16:49:05.552883293 +0000 UTC m=+0.399296199 container start 41e9cd222da81b6fcfe8fe6aaa9451de540b2f6a4941fc1cdad01ca5cd8c2f04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-13T16:49:06.022 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 16:49:05 smithi144 ceph-mds[65387]: -- 172.21.15.144:0/1471293281 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e8e806cd00 con 0x55e8e8041000 2024-09-13T16:49:06.022 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 16:49:05 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f[65383]: starting mds.f at 2024-09-13T16:49:06.022 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 16:49:05 smithi144 bash[65368]: 41e9cd222da81b6fcfe8fe6aaa9451de540b2f6a4941fc1cdad01ca5cd8c2f04 2024-09-13T16:49:06.022 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 16:49:05 smithi144 systemd[1]: Started Ceph mds.f for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:49:06.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:06.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:06.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:06.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:06.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:06.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:06.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: Deploying daemon mds.c on smithi144 2024-09-13T16:49:06.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:06.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.144:6834/81449437,v1:172.21.15.144:6835/81449437] up:boot 2024-09-13T16:49:06.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: fsmap 6 up:standby 2024-09-13T16:49:06.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:49:06.928 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:06.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:06.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:06.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:06.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:06.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:06.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:06.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: Deploying daemon mds.c on smithi144 2024-09-13T16:49:06.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:06.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.144:6834/81449437,v1:172.21.15.144:6835/81449437] up:boot 2024-09-13T16:49:06.984 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: fsmap 6 up:standby 2024-09-13T16:49:06.984 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:49:07.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:07.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:07.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:07.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:07.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:07.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:07.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: Deploying daemon mds.c on smithi144 2024-09-13T16:49:07.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:07.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.144:6834/81449437,v1:172.21.15.144:6835/81449437] up:boot 2024-09-13T16:49:07.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: fsmap 6 up:standby 2024-09-13T16:49:07.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:49:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.097+0000 7f1b97e00640 1 -- 172.21.15.18:0/4108739969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b90100f70 msgr2=0x7f1b901013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.097+0000 7f1b97e00640 1 --2- 172.21.15.18:0/4108739969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b90100f70 0x7f1b901013f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009900 tx=0x7f1b7c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.097+0000 7f1b97e00640 1 -- 172.21.15.18:0/4108739969 shutdown_connections 2024-09-13T16:49:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.097+0000 7f1b97e00640 1 --2- 172.21.15.18:0/4108739969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b90100f70 0x7f1b901013f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.097+0000 7f1b97e00640 1 --2- 172.21.15.18:0/4108739969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b90101930 0x7f1b901081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.097+0000 7f1b97e00640 1 --2- 172.21.15.18:0/4108739969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b900ffd80 0x7f1b90100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.097+0000 7f1b97e00640 1 -- 172.21.15.18:0/4108739969 >> 172.21.15.18:0/4108739969 conn(0x7f1b900fb500 msgr2=0x7f1b900fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.097+0000 7f1b97e00640 1 -- 172.21.15.18:0/4108739969 shutdown_connections 2024-09-13T16:49:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.097+0000 7f1b97e00640 1 -- 172.21.15.18:0/4108739969 wait complete. 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.098+0000 7f1b97e00640 1 Processor -- start 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.098+0000 7f1b97e00640 1 -- start start 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.098+0000 7f1b97e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b900ffd80 0x7f1b90198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.098+0000 7f1b97e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90100f70 0x7f1b90198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.098+0000 7f1b97e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b90101930 0x7f1b9019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.098+0000 7f1b97e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9019fae0 con 0x7f1b90101930 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.098+0000 7f1b97e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9019fc50 con 0x7f1b900ffd80 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.098+0000 7f1b97e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9019fe10 con 0x7f1b90100f70 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b94a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90100f70 0x7f1b90198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b95e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b90101930 0x7f1b9019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:07.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b94a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90100f70 0x7f1b90198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:54720/0 (socket says 172.21.15.18:54720) 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b94a00640 1 -- 172.21.15.18:0/1368832524 learned_addr learned my addr 172.21.15.18:0/1368832524 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b95400640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b900ffd80 0x7f1b90198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b94a00640 1 -- 172.21.15.18:0/1368832524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b900ffd80 msgr2=0x7f1b90198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b94a00640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b900ffd80 0x7f1b90198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b94a00640 1 -- 172.21.15.18:0/1368832524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b90101930 msgr2=0x7f1b9019f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b94a00640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b90101930 0x7f1b9019f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b94a00640 1 -- 172.21.15.18:0/1368832524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c009560 con 0x7f1b90100f70 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.099+0000 7f1b94a00640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90100f70 0x7f1b90198580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009a20 tx=0x7f1b7c005620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.100+0000 7f1b8e000640 1 -- 172.21.15.18:0/1368832524 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c004c10 con 0x7f1b90100f70 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.100+0000 7f1b8e000640 1 -- 172.21.15.18:0/1368832524 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b7c004d70 con 0x7f1b90100f70 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.100+0000 7f1b97e00640 1 -- 172.21.15.18:0/1368832524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b901a0090 con 0x7f1b90100f70 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.100+0000 7f1b8e000640 1 -- 172.21.15.18:0/1368832524 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c031ae0 con 0x7f1b90100f70 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.100+0000 7f1b97e00640 1 -- 172.21.15.18:0/1368832524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b901a0540 con 0x7f1b90100f70 2024-09-13T16:49:07.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.101+0000 7f1b97e00640 1 -- 172.21.15.18:0/1368832524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9010b640 con 0x7f1b90100f70 2024-09-13T16:49:07.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.103+0000 7f1b8e000640 1 -- 172.21.15.18:0/1368832524 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1b7c031c40 con 0x7f1b90100f70 2024-09-13T16:49:07.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.104+0000 7f1b8e000640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f1b780a1090 0x7f1b780a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:07.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.105+0000 7f1b8e000640 1 -- 172.21.15.18:0/1368832524 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1b7c0ed3d0 con 0x7f1b90100f70 2024-09-13T16:49:07.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.105+0000 7f1b95400640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f1b780a1090 0x7f1b780a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:07.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.105+0000 7f1b95400640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f1b780a1090 0x7f1b780a3550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b90100dd0 tx=0x7f1b84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:07.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.106+0000 7f1b8e000640 1 -- 172.21.15.18:0/1368832524 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1b7c0b7010 con 0x7f1b90100f70 2024-09-13T16:49:07.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.323+0000 7f1b97e00640 1 -- 172.21.15.18:0/1368832524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b9010b800 con 0x7f1b90100f70 2024-09-13T16:49:07.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.324+0000 7f1b8e000640 1 -- 172.21.15.18:0/1368832524 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5039 (secure 0 0 0) 0x7f1b7c0ba630 con 0x7f1b90100f70 2024-09-13T16:49:07.325 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:07.325 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2024-09-13T16:49:07.326 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 7 2024-09-13T16:49:07.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 -- 172.21.15.18:0/1368832524 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f1b780a1090 msgr2=0x7f1b780a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f1b780a1090 0x7f1b780a3550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b90100dd0 tx=0x7f1b84005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 -- 172.21.15.18:0/1368832524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90100f70 msgr2=0x7f1b90198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90100f70 0x7f1b90198580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009a20 tx=0x7f1b7c005620 comp rx=0 tx=0).stop 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 -- 172.21.15.18:0/1368832524 shutdown_connections 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f1b780a1090 0x7f1b780a3550 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b90101930 0x7f1b9019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b90100f70 0x7f1b90198580 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 --2- 172.21.15.18:0/1368832524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b900ffd80 0x7f1b90198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 -- 172.21.15.18:0/1368832524 >> 172.21.15.18:0/1368832524 conn(0x7f1b900fb500 msgr2=0x7f1b901067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 -- 172.21.15.18:0/1368832524 shutdown_connections 2024-09-13T16:49:07.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:07.326+0000 7f1b97e00640 1 -- 172.21.15.18:0/1368832524 wait complete. 2024-09-13T16:49:07.745 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 16:49:07 smithi144 systemd[1]: Starting Ceph mds.c for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:49:08.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:07 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1368832524' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:08.021 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 16:49:07 smithi144 podman[65671]: 2024-09-13 16:49:07.841708625 +0000 UTC m=+0.096213007 container create b9736da3e20f2f0c5777d1e88b5ab43d8be84c3d228080927c977a74e9d079ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2) 2024-09-13T16:49:08.022 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 16:49:07 smithi144 podman[65671]: 2024-09-13 16:49:07.761638399 +0000 UTC m=+0.016142744 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:49:08.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:07 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1368832524' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:08.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:07 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1368832524' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:08.522 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 16:49:08 smithi144 podman[65671]: 2024-09-13 16:49:08.09433352 +0000 UTC m=+0.348837856 container init b9736da3e20f2f0c5777d1e88b5ab43d8be84c3d228080927c977a74e9d079ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T16:49:08.522 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 16:49:08 smithi144 podman[65671]: 2024-09-13 16:49:08.0971594 +0000 UTC m=+0.351663737 container start b9736da3e20f2f0c5777d1e88b5ab43d8be84c3d228080927c977a74e9d079ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:49:08.522 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 16:49:08 smithi144 ceph-mds[65690]: -- 172.21.15.144:0/560582274 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55797fcbad00 con 0x55797fc8e800 2024-09-13T16:49:08.522 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 16:49:08 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c[65686]: starting mds.c at 2024-09-13T16:49:08.522 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 16:49:08 smithi144 bash[65671]: b9736da3e20f2f0c5777d1e88b5ab43d8be84c3d228080927c977a74e9d079ba 2024-09-13T16:49:08.522 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 16:49:08 smithi144 systemd[1]: Started Ceph mds.c for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:49:08.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:08 smithi094 ceph-mon[35259]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:08.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:08.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:08.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:08.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:08.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:08.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:09.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:08 smithi144 ceph-mon[35328]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:09.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:08 smithi018 ceph-mon[30981]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:09.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.511+0000 7f575c600640 1 -- 172.21.15.18:0/3245704486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5754100f70 msgr2=0x7f57541013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.511+0000 7f575c600640 1 --2- 172.21.15.18:0/3245704486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5754100f70 0x7f57541013f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5740009900 tx=0x7f574002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.511+0000 7f575c600640 1 -- 172.21.15.18:0/3245704486 shutdown_connections 2024-09-13T16:49:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.511+0000 7f575c600640 1 --2- 172.21.15.18:0/3245704486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5754100f70 0x7f57541013f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.511+0000 7f575c600640 1 --2- 172.21.15.18:0/3245704486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5754101930 0x7f57541081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.511+0000 7f575c600640 1 --2- 172.21.15.18:0/3245704486 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57540ffd80 0x7f5754100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.511+0000 7f575c600640 1 -- 172.21.15.18:0/3245704486 >> 172.21.15.18:0/3245704486 conn(0x7f57540fb500 msgr2=0x7f57540fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.511+0000 7f575c600640 1 -- 172.21.15.18:0/3245704486 shutdown_connections 2024-09-13T16:49:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.511+0000 7f575c600640 1 -- 172.21.15.18:0/3245704486 wait complete. 2024-09-13T16:49:09.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.512+0000 7f575c600640 1 Processor -- start 2024-09-13T16:49:09.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.512+0000 7f575c600640 1 -- start start 2024-09-13T16:49:09.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.512+0000 7f575c600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57540ffd80 0x7f5754195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:09.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.512+0000 7f575c600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5754100f70 0x7f57541962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.512+0000 7f575c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5754101930 0x7f575419d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.512+0000 7f575c600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575419d8a0 con 0x7f57540ffd80 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.512+0000 7f575c600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575419da10 con 0x7f5754100f70 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.512+0000 7f575c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575419dbd0 con 0x7f5754101930 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f5759c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57540ffd80 0x7f5754195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f5759c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57540ffd80 0x7f5754195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52310/0 (socket says 172.21.15.18:52310) 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f5759c00640 1 -- 172.21.15.18:0/2921142082 learned_addr learned my addr 172.21.15.18:0/2921142082 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f5759200640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5754100f70 0x7f57541962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f575a600640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5754101930 0x7f575419d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f5759c00640 1 -- 172.21.15.18:0/2921142082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5754101930 msgr2=0x7f575419d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f5759c00640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5754101930 0x7f575419d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f5759c00640 1 -- 172.21.15.18:0/2921142082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5754100f70 msgr2=0x7f57541962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:09.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f5759c00640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5754100f70 0x7f57541962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:09.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f5759c00640 1 -- 172.21.15.18:0/2921142082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740009560 con 0x7f57540ffd80 2024-09-13T16:49:09.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.513+0000 7f5759c00640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57540ffd80 0x7f5754195db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f574800e9c0 tx=0x7f574800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:09.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.514+0000 7f5752000640 1 -- 172.21.15.18:0/2921142082 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748009700 con 0x7f57540ffd80 2024-09-13T16:49:09.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.514+0000 7f5752000640 1 -- 172.21.15.18:0/2921142082 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57480044e0 con 0x7f57540ffd80 2024-09-13T16:49:09.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.514+0000 7f575c600640 1 -- 172.21.15.18:0/2921142082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575419deb0 con 0x7f57540ffd80 2024-09-13T16:49:09.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.514+0000 7f5752000640 1 -- 172.21.15.18:0/2921142082 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748010430 con 0x7f57540ffd80 2024-09-13T16:49:09.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.514+0000 7f575c600640 1 -- 172.21.15.18:0/2921142082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575419e2e0 con 0x7f57540ffd80 2024-09-13T16:49:09.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.515+0000 7f575c600640 1 -- 172.21.15.18:0/2921142082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5754107230 con 0x7f57540ffd80 2024-09-13T16:49:09.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.517+0000 7f5752000640 1 -- 172.21.15.18:0/2921142082 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5748003f60 con 0x7f57540ffd80 2024-09-13T16:49:09.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.518+0000 7f5752000640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f573c0a1110 0x7f573c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:09.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.518+0000 7f5752000640 1 -- 172.21.15.18:0/2921142082 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5748014070 con 0x7f57540ffd80 2024-09-13T16:49:09.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.518+0000 7f5759200640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f573c0a1110 0x7f573c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:09.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.519+0000 7f5759200640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f573c0a1110 0x7f573c0a35d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5740005ab0 tx=0x7f5740005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:09.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.522+0000 7f5752000640 1 -- 172.21.15.18:0/2921142082 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5748096460 con 0x7f57540ffd80 2024-09-13T16:49:09.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.742+0000 7f575c600640 1 -- 172.21.15.18:0/2921142082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f575410b670 con 0x7f57540ffd80 2024-09-13T16:49:09.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.742+0000 7f5752000640 1 -- 172.21.15.18:0/2921142082 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5796 (secure 0 0 0) 0x7f5748099a80 con 0x7f57540ffd80 2024-09-13T16:49:09.744 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:09.744 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-09-13T16:49:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-13T16:49:09.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.744+0000 7f575c600640 1 -- 172.21.15.18:0/2921142082 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f573c0a1110 msgr2=0x7f573c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:09.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.744+0000 7f575c600640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f573c0a1110 0x7f573c0a35d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5740005ab0 tx=0x7f5740005780 comp rx=0 tx=0).stop 2024-09-13T16:49:09.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.744+0000 7f575c600640 1 -- 172.21.15.18:0/2921142082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57540ffd80 msgr2=0x7f5754195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:09.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.744+0000 7f575c600640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57540ffd80 0x7f5754195db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f574800e9c0 tx=0x7f574800ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:09.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.745+0000 7f575c600640 1 -- 172.21.15.18:0/2921142082 shutdown_connections 2024-09-13T16:49:09.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.745+0000 7f575c600640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5754101930 0x7f575419d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:09.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.745+0000 7f575c600640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5754100f70 0x7f57541962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:09.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.745+0000 7f575c600640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f573c0a1110 0x7f573c0a35d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:09.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.745+0000 7f575c600640 1 --2- 172.21.15.18:0/2921142082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57540ffd80 0x7f5754195db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:09.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.745+0000 7f575c600640 1 -- 172.21.15.18:0/2921142082 >> 172.21.15.18:0/2921142082 conn(0x7f57540fb500 msgr2=0x7f5754104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:09.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.745+0000 7f575c600640 1 -- 172.21.15.18:0/2921142082 shutdown_connections 2024-09-13T16:49:09.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:09.745+0000 7f575c600640 1 -- 172.21.15.18:0/2921142082 wait complete. 2024-09-13T16:49:10.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:09 smithi144 ceph-mon[35328]: Deploying daemon mds.h on smithi094 2024-09-13T16:49:10.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:09 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.144:6836/443543812,v1:172.21.15.144:6837/443543812] up:boot 2024-09-13T16:49:10.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:09 smithi144 ceph-mon[35328]: fsmap 7 up:standby 2024-09-13T16:49:10.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:09 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:49:10.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:09 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2921142082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:10.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:09 smithi094 ceph-mon[35259]: Deploying daemon mds.h on smithi094 2024-09-13T16:49:10.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:09 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.144:6836/443543812,v1:172.21.15.144:6837/443543812] up:boot 2024-09-13T16:49:10.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:09 smithi094 ceph-mon[35259]: fsmap 7 up:standby 2024-09-13T16:49:10.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:09 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:49:10.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:09 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2921142082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:10.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:09 smithi018 ceph-mon[30981]: Deploying daemon mds.h on smithi094 2024-09-13T16:49:10.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:09 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.144:6836/443543812,v1:172.21.15.144:6837/443543812] up:boot 2024-09-13T16:49:10.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:09 smithi018 ceph-mon[30981]: fsmap 7 up:standby 2024-09-13T16:49:10.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:09 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:49:10.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:09 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2921142082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:10.412 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 16:49:10 smithi094 systemd[1]: Starting Ceph mds.h for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:49:10.757 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 16:49:10 smithi094 podman[65343]: 2024-09-13 16:49:10.374835002 +0000 UTC m=+0.015343133 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:49:10.757 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 16:49:10 smithi094 podman[65343]: 2024-09-13 16:49:10.498532598 +0000 UTC m=+0.139040725 container create 9f7bd9e97b5b03bf7be7555dd007a421c8774beb854bd27f3580488df11cfd0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True) 2024-09-13T16:49:11.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:10 smithi144 ceph-mon[35328]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:11.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:10 smithi094 ceph-mon[35259]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:11.162 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 16:49:10 smithi094 podman[65343]: 2024-09-13 16:49:10.776603469 +0000 UTC m=+0.417111589 container init 9f7bd9e97b5b03bf7be7555dd007a421c8774beb854bd27f3580488df11cfd0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T16:49:11.162 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 16:49:10 smithi094 podman[65343]: 2024-09-13 16:49:10.779522065 +0000 UTC m=+0.420030188 container start 9f7bd9e97b5b03bf7be7555dd007a421c8774beb854bd27f3580488df11cfd0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0) 2024-09-13T16:49:11.162 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 16:49:10 smithi094 ceph-mds[65362]: -- 172.21.15.94:0/4146047605 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5596f0aded00 con 0x5596f0ab3400 2024-09-13T16:49:11.162 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 16:49:10 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h[65358]: starting mds.h at 2024-09-13T16:49:11.162 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 16:49:10 smithi094 bash[65343]: 9f7bd9e97b5b03bf7be7555dd007a421c8774beb854bd27f3580488df11cfd0b 2024-09-13T16:49:11.163 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 16:49:10 smithi094 systemd[1]: Started Ceph mds.h for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:49:11.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:10 smithi018 ceph-mon[30981]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:11.764 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:11.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.930+0000 7f28ab400640 1 -- 172.21.15.18:0/4024283359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a4101fb0 msgr2=0x7f28a41023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:11.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.930+0000 7f28ab400640 1 --2- 172.21.15.18:0/4024283359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a4101fb0 0x7f28a41023b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2898009900 tx=0x7f289802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:11.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.931+0000 7f28ab400640 1 -- 172.21.15.18:0/4024283359 shutdown_connections 2024-09-13T16:49:11.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.931+0000 7f28ab400640 1 --2- 172.21.15.18:0/4024283359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a4103b60 0x7f28a410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:11.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.931+0000 7f28ab400640 1 --2- 172.21.15.18:0/4024283359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28a41031a0 0x7f28a4103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:11.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.931+0000 7f28ab400640 1 --2- 172.21.15.18:0/4024283359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a4101fb0 0x7f28a41023b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:11.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.931+0000 7f28ab400640 1 -- 172.21.15.18:0/4024283359 >> 172.21.15.18:0/4024283359 conn(0x7f28a40fd730 msgr2=0x7f28a40ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:11.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.931+0000 7f28ab400640 1 -- 172.21.15.18:0/4024283359 shutdown_connections 2024-09-13T16:49:11.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.931+0000 7f28ab400640 1 -- 172.21.15.18:0/4024283359 wait complete. 2024-09-13T16:49:11.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28ab400640 1 Processor -- start 2024-09-13T16:49:11.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28ab400640 1 -- start start 2024-09-13T16:49:11.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28ab400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28a4101fb0 0x7f28a4197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:11.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28ab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41031a0 0x7f28a4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28ab400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a4103b60 0x7f28a419f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28ab400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a419fad0 con 0x7f28a41031a0 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28ab400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a419fc40 con 0x7f28a4101fb0 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28ab400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a419fe00 con 0x7f28a4103b60 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41031a0 0x7f28a4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41031a0 0x7f28a4198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51826/0 (socket says 172.21.15.18:51826) 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28a3e00640 1 -- 172.21.15.18:0/3169808108 learned_addr learned my addr 172.21.15.18:0/3169808108 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28a9400640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a4103b60 0x7f28a419f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.932+0000 7f28a8a00640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28a4101fb0 0x7f28a4197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28a3e00640 1 -- 172.21.15.18:0/3169808108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a4103b60 msgr2=0x7f28a419f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28a3e00640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a4103b60 0x7f28a419f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28a3e00640 1 -- 172.21.15.18:0/3169808108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28a4101fb0 msgr2=0x7f28a4197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:11.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28a3e00640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28a4101fb0 0x7f28a4197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:11.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28a3e00640 1 -- 172.21.15.18:0/3169808108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898009560 con 0x7f28a41031a0 2024-09-13T16:49:11.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28a9400640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a4103b60 0x7f28a419f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:11.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28a3e00640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41031a0 0x7f28a4198520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f289000e9f0 tx=0x7f289000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:11.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28a1600640 1 -- 172.21.15.18:0/3169808108 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890009720 con 0x7f28a41031a0 2024-09-13T16:49:11.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28ab400640 1 -- 172.21.15.18:0/3169808108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a41a00e0 con 0x7f28a41031a0 2024-09-13T16:49:11.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28a1600640 1 -- 172.21.15.18:0/3169808108 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f289000cd80 con 0x7f28a41031a0 2024-09-13T16:49:11.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.933+0000 7f28a1600640 1 -- 172.21.15.18:0/3169808108 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890010430 con 0x7f28a41031a0 2024-09-13T16:49:11.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.934+0000 7f28ab400640 1 -- 172.21.15.18:0/3169808108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a41a05f0 con 0x7f28a41031a0 2024-09-13T16:49:11.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.935+0000 7f28ab400640 1 -- 172.21.15.18:0/3169808108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a4109440 con 0x7f28a41031a0 2024-09-13T16:49:11.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.939+0000 7f28a1600640 1 -- 172.21.15.18:0/3169808108 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2890005000 con 0x7f28a41031a0 2024-09-13T16:49:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.940+0000 7f28a1600640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f288c0a1110 0x7f288c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.940+0000 7f28a1600640 1 -- 172.21.15.18:0/3169808108 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2890014070 con 0x7f28a41031a0 2024-09-13T16:49:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.940+0000 7f28a8a00640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f288c0a1110 0x7f288c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:11.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.941+0000 7f28a8a00640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f288c0a1110 0x7f288c0a35d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2898031500 tx=0x7f2898005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:11.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:11.941+0000 7f28a1600640 1 -- 172.21.15.18:0/3169808108 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2890096540 con 0x7f28a41031a0 2024-09-13T16:49:12.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.156+0000 7f28ab400640 1 -- 172.21.15.18:0/3169808108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28a410d8c0 con 0x7f28a41031a0 2024-09-13T16:49:12.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.157+0000 7f28a1600640 1 -- 172.21.15.18:0/3169808108 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6553 (secure 0 0 0) 0x7f2890099b60 con 0x7f28a41031a0 2024-09-13T16:49:12.159 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:12.159 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-09-13T16:49:12.159 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-09-13T16:49:12.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 -- 172.21.15.18:0/3169808108 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f288c0a1110 msgr2=0x7f288c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:12.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f288c0a1110 0x7f288c0a35d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2898031500 tx=0x7f2898005780 comp rx=0 tx=0).stop 2024-09-13T16:49:12.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 -- 172.21.15.18:0/3169808108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41031a0 msgr2=0x7f28a4198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:12.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41031a0 0x7f28a4198520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f289000e9f0 tx=0x7f289000edf0 comp rx=0 tx=0).stop 2024-09-13T16:49:12.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 -- 172.21.15.18:0/3169808108 shutdown_connections 2024-09-13T16:49:12.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f288c0a1110 0x7f288c0a35d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:12.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41031a0 0x7f28a4198520 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:12.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a4103b60 0x7f28a419f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:12.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 --2- 172.21.15.18:0/3169808108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28a4101fb0 0x7f28a4197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:12.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 -- 172.21.15.18:0/3169808108 >> 172.21.15.18:0/3169808108 conn(0x7f28a40fd730 msgr2=0x7f28a4106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:12.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 -- 172.21.15.18:0/3169808108 shutdown_connections 2024-09-13T16:49:12.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:12.159+0000 7f28ab400640 1 -- 172.21.15.18:0/3169808108 wait complete. 2024-09-13T16:49:12.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:12.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:12.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:12.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:12.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:12.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:12.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: Deploying daemon mds.i on smithi144 2024-09-13T16:49:12.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:12.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] up:boot 2024-09-13T16:49:12.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: fsmap 8 up:standby 2024-09-13T16:49:12.176 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:11 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:49:12.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:12.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:12.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:12.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:12.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:12.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:12.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: Deploying daemon mds.i on smithi144 2024-09-13T16:49:12.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:12.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] up:boot 2024-09-13T16:49:12.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: fsmap 8 up:standby 2024-09-13T16:49:12.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:11 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:49:12.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:12.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:12.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:12.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:12.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:12.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:12.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: Deploying daemon mds.i on smithi144 2024-09-13T16:49:12.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:12.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] up:boot 2024-09-13T16:49:12.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: fsmap 8 up:standby 2024-09-13T16:49:12.413 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:11 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:49:13.189 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:12 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3169808108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:13.190 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:49:12 smithi144 systemd[1]: Starting Ceph mds.i for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:49:13.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:12 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3169808108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:13.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:12 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3169808108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:13.451 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:49:13 smithi144 podman[65971]: 2024-09-13 16:49:13.091220209 +0000 UTC m=+0.015829086 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:49:13.451 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:49:13 smithi144 podman[65971]: 2024-09-13 16:49:13.213625309 +0000 UTC m=+0.138234216 container create 8d178548df97b6a083cd970532d2b13404df4fb2c1a50e2477946b5618d5f395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:49:13.451 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:49:13 smithi144 podman[65971]: 2024-09-13 16:49:13.450004205 +0000 UTC m=+0.374613069 container init 8d178548df97b6a083cd970532d2b13404df4fb2c1a50e2477946b5618d5f395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T16:49:13.772 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:49:13 smithi144 podman[65971]: 2024-09-13 16:49:13.452788765 +0000 UTC m=+0.377397632 container start 8d178548df97b6a083cd970532d2b13404df4fb2c1a50e2477946b5618d5f395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T16:49:13.772 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:49:13 smithi144 ceph-mds[65991]: -- 172.21.15.144:0/193332820 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5604280e4d00 con 0x5604280b9400 2024-09-13T16:49:13.772 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:49:13 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i[65987]: starting mds.i at 2024-09-13T16:49:13.772 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:49:13 smithi144 bash[65971]: 8d178548df97b6a083cd970532d2b13404df4fb2c1a50e2477946b5618d5f395 2024-09-13T16:49:13.772 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:49:13 smithi144 systemd[1]: Started Ceph mds.i for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:49:14.177 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:14.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.340+0000 7f2713e00640 1 -- 172.21.15.18:0/4166278692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f270c1031a0 msgr2=0x7f270c103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:14.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.340+0000 7f2713e00640 1 --2- 172.21.15.18:0/4166278692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f270c1031a0 0x7f270c103620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009900 tx=0x7f26f802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:14.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.340+0000 7f2713e00640 1 -- 172.21.15.18:0/4166278692 shutdown_connections 2024-09-13T16:49:14.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.340+0000 7f2713e00640 1 --2- 172.21.15.18:0/4166278692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f270c103b60 0x7f270c10a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:14.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.340+0000 7f2713e00640 1 --2- 172.21.15.18:0/4166278692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f270c1031a0 0x7f270c103620 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:14.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.340+0000 7f2713e00640 1 --2- 172.21.15.18:0/4166278692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f270c101fb0 0x7f270c1023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:14.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.340+0000 7f2713e00640 1 -- 172.21.15.18:0/4166278692 >> 172.21.15.18:0/4166278692 conn(0x7f270c0fd730 msgr2=0x7f270c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:14.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.340+0000 7f2713e00640 1 -- 172.21.15.18:0/4166278692 shutdown_connections 2024-09-13T16:49:14.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.340+0000 7f2713e00640 1 -- 172.21.15.18:0/4166278692 wait complete. 2024-09-13T16:49:14.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.341+0000 7f2713e00640 1 Processor -- start 2024-09-13T16:49:14.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.341+0000 7f2713e00640 1 -- start start 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.341+0000 7f2713e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f270c101fb0 0x7f270c197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.341+0000 7f2713e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f270c1031a0 0x7f270c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.341+0000 7f2713e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f270c103b60 0x7f270c19f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.341+0000 7f2713e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c19fac0 con 0x7f270c1031a0 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.341+0000 7f2713e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c19fc30 con 0x7f270c101fb0 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.341+0000 7f2713e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c19fdf0 con 0x7f270c103b60 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2710a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f270c1031a0 0x7f270c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2711400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f270c101fb0 0x7f270c197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2711e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f270c103b60 0x7f270c19f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2711400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f270c101fb0 0x7f270c197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:51686/0 (socket says 172.21.15.18:51686) 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2710a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f270c1031a0 0x7f270c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51836/0 (socket says 172.21.15.18:51836) 2024-09-13T16:49:14.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2711400640 1 -- 172.21.15.18:0/2959488084 learned_addr learned my addr 172.21.15.18:0/2959488084 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2711400640 1 -- 172.21.15.18:0/2959488084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f270c103b60 msgr2=0x7f270c19f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2711400640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f270c103b60 0x7f270c19f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2711400640 1 -- 172.21.15.18:0/2959488084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f270c1031a0 msgr2=0x7f270c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2711400640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f270c1031a0 0x7f270c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2711400640 1 -- 172.21.15.18:0/2959488084 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f8009560 con 0x7f270c101fb0 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f2711400640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f270c101fb0 0x7f270c197fd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f270000e9c0 tx=0x7f270000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.342+0000 7f270a000640 1 -- 172.21.15.18:0/2959488084 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000096e0 con 0x7f270c101fb0 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.343+0000 7f2713e00640 1 -- 172.21.15.18:0/2959488084 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270c1a00d0 con 0x7f270c101fb0 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.343+0000 7f270a000640 1 -- 172.21.15.18:0/2959488084 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27000044f0 con 0x7f270c101fb0 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.343+0000 7f270a000640 1 -- 172.21.15.18:0/2959488084 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700010430 con 0x7f270c101fb0 2024-09-13T16:49:14.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.343+0000 7f2713e00640 1 -- 172.21.15.18:0/2959488084 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270c1a05b0 con 0x7f270c101fb0 2024-09-13T16:49:14.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.344+0000 7f2713e00640 1 -- 172.21.15.18:0/2959488084 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270c109460 con 0x7f270c101fb0 2024-09-13T16:49:14.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.346+0000 7f270a000640 1 -- 172.21.15.18:0/2959488084 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f27000035f0 con 0x7f270c101fb0 2024-09-13T16:49:14.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.347+0000 7f270a000640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f26f40a1090 0x7f26f40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:14.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.347+0000 7f270a000640 1 -- 172.21.15.18:0/2959488084 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2700014070 con 0x7f270c101fb0 2024-09-13T16:49:14.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.347+0000 7f2710a00640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f26f40a1090 0x7f26f40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:14.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.348+0000 7f2710a00640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f26f40a1090 0x7f26f40a3550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26f8005ab0 tx=0x7f26f8005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:14.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.349+0000 7f270a000640 1 -- 172.21.15.18:0/2959488084 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2700096760 con 0x7f270c101fb0 2024-09-13T16:49:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.572+0000 7f2713e00640 1 -- 172.21.15.18:0/2959488084 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f270c10d8c0 con 0x7f270c101fb0 2024-09-13T16:49:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.574+0000 7f270a000640 1 -- 172.21.15.18:0/2959488084 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7312 (secure 0 0 0) 0x7f2700099d80 con 0x7f270c101fb0 2024-09-13T16:49:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:14.575 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-09-13T16:49:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 10 2024-09-13T16:49:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 -- 172.21.15.18:0/2959488084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f26f40a1090 msgr2=0x7f26f40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f26f40a1090 0x7f26f40a3550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26f8005ab0 tx=0x7f26f8005780 comp rx=0 tx=0).stop 2024-09-13T16:49:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 -- 172.21.15.18:0/2959488084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f270c101fb0 msgr2=0x7f270c197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f270c101fb0 0x7f270c197fd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f270000e9c0 tx=0x7f270000ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 -- 172.21.15.18:0/2959488084 shutdown_connections 2024-09-13T16:49:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f26f40a1090 0x7f26f40a3550 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f270c1031a0 0x7f270c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f270c103b60 0x7f270c19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 --2- 172.21.15.18:0/2959488084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f270c101fb0 0x7f270c197fd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 -- 172.21.15.18:0/2959488084 >> 172.21.15.18:0/2959488084 conn(0x7f270c0fd730 msgr2=0x7f270c106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 -- 172.21.15.18:0/2959488084 shutdown_connections 2024-09-13T16:49:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:14.576+0000 7f2713e00640 1 -- 172.21.15.18:0/2959488084 wait complete. 2024-09-13T16:49:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: Deploying daemon mds.g on smithi018 2024-09-13T16:49:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.144:6838/506298733,v1:172.21.15.144:6839/506298733] up:boot 2024-09-13T16:49:14.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: fsmap 9 up:standby 2024-09-13T16:49:14.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:49:14.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:14 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2959488084' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:14.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:14.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:14.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:14.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:14.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:14.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:14.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: Deploying daemon mds.g on smithi018 2024-09-13T16:49:14.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:14.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.144:6838/506298733,v1:172.21.15.144:6839/506298733] up:boot 2024-09-13T16:49:14.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: fsmap 9 up:standby 2024-09-13T16:49:14.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:49:14.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:14 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2959488084' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:15.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: Deploying daemon mds.g on smithi018 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.144:6838/506298733,v1:172.21.15.144:6839/506298733] up:boot 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: fsmap 9 up:standby 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:49:15.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:14 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2959488084' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:16.460 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 16:49:16 smithi018 systemd[1]: Starting Ceph mds.g for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:49:16.594 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:16.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.757+0000 7f1317800640 1 -- 172.21.15.18:0/3955509488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1310074490 msgr2=0x7f13100728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:16.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.757+0000 7f1317800640 1 --2- 172.21.15.18:0/3955509488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1310074490 0x7f13100728e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1304009860 tx=0x7f130402a3d0 comp rx=0 tx=0).stop 2024-09-13T16:49:16.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.758+0000 7f1317800640 1 -- 172.21.15.18:0/3955509488 shutdown_connections 2024-09-13T16:49:16.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.758+0000 7f1317800640 1 --2- 172.21.15.18:0/3955509488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1310072eb0 0x7f1310073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:16.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.758+0000 7f1317800640 1 --2- 172.21.15.18:0/3955509488 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1310107c10 0x7f131010a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:16.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.758+0000 7f1317800640 1 --2- 172.21.15.18:0/3955509488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1310074490 0x7f13100728e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:16.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.758+0000 7f1317800640 1 -- 172.21.15.18:0/3955509488 >> 172.21.15.18:0/3955509488 conn(0x7f13100fb500 msgr2=0x7f13100fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:16.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.758+0000 7f1317800640 1 -- 172.21.15.18:0/3955509488 shutdown_connections 2024-09-13T16:49:16.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.758+0000 7f1317800640 1 -- 172.21.15.18:0/3955509488 wait complete. 2024-09-13T16:49:16.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.758+0000 7f1317800640 1 Processor -- start 2024-09-13T16:49:16.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1317800640 1 -- start start 2024-09-13T16:49:16.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1317800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1310072eb0 0x7f1310197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1317800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1310074490 0x7f13101984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1317800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1310107c10 0x7f131019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1317800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131019fa60 con 0x7f1310072eb0 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1317800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131019fbd0 con 0x7f1310074490 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1317800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131019fd90 con 0x7f1310107c10 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1314e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1310072eb0 0x7f1310197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1314e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1310072eb0 0x7f1310197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51860/0 (socket says 172.21.15.18:51860) 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1314e00640 1 -- 172.21.15.18:0/3895733708 learned_addr learned my addr 172.21.15.18:0/3895733708 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f1315800640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1310107c10 0x7f131019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.759+0000 7f130fe00640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1310074490 0x7f13101984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f1314e00640 1 -- 172.21.15.18:0/3895733708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1310107c10 msgr2=0x7f131019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:16.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f1314e00640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1310107c10 0x7f131019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f1314e00640 1 -- 172.21.15.18:0/3895733708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1310074490 msgr2=0x7f13101984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f1314e00640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1310074490 0x7f13101984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f1314e00640 1 -- 172.21.15.18:0/3895733708 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304009490 con 0x7f1310072eb0 2024-09-13T16:49:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f1314e00640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1310072eb0 0x7f1310197f70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f13040306d0 tx=0x7f13040052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f130d600640 1 -- 172.21.15.18:0/3895733708 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304004250 con 0x7f1310072eb0 2024-09-13T16:49:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f1317800640 1 -- 172.21.15.18:0/3895733708 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13101a0010 con 0x7f1310072eb0 2024-09-13T16:49:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f130d600640 1 -- 172.21.15.18:0/3895733708 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13040043b0 con 0x7f1310072eb0 2024-09-13T16:49:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f130d600640 1 -- 172.21.15.18:0/3895733708 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304003990 con 0x7f1310072eb0 2024-09-13T16:49:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.760+0000 7f1317800640 1 -- 172.21.15.18:0/3895733708 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13101a04c0 con 0x7f1310072eb0 2024-09-13T16:49:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.762+0000 7f1317800640 1 -- 172.21.15.18:0/3895733708 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13101069d0 con 0x7f1310072eb0 2024-09-13T16:49:16.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.764+0000 7f130d600640 1 -- 172.21.15.18:0/3895733708 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1304003af0 con 0x7f1310072eb0 2024-09-13T16:49:16.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.765+0000 7f130d600640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f12f80a1090 0x7f12f80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:16.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.765+0000 7f130d600640 1 -- 172.21.15.18:0/3895733708 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f13040ed680 con 0x7f1310072eb0 2024-09-13T16:49:16.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.766+0000 7f130fe00640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f12f80a1090 0x7f12f80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:16.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.766+0000 7f130fe00640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f12f80a1090 0x7f12f80a3550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1310199480 tx=0x7f12fc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.769+0000 7f130d600640 1 -- 172.21.15.18:0/3895733708 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f13040b7210 con 0x7f1310072eb0 2024-09-13T16:49:16.809 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 16:49:16 smithi018 podman[71834]: 2024-09-13 16:49:16.431622037 +0000 UTC m=+0.027508965 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:49:16.809 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 16:49:16 smithi018 podman[71834]: 2024-09-13 16:49:16.559276551 +0000 UTC m=+0.155163448 container create c4b7cbb788f597d07a7043d59d97a6cbddd3f853ffa1b9685462c7ccc9ff9024 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:49:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.997+0000 7f1317800640 1 -- 172.21.15.18:0/3895733708 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f131010d850 con 0x7f1310072eb0 2024-09-13T16:49:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:16.998+0000 7f130d600640 1 -- 172.21.15.18:0/3895733708 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7312 (secure 0 0 0) 0x7f131010d850 con 0x7f1310072eb0 2024-09-13T16:49:16.999 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:16.999 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-09-13T16:49:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 10 2024-09-13T16:49:17.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 -- 172.21.15.18:0/3895733708 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f12f80a1090 msgr2=0x7f12f80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:17.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f12f80a1090 0x7f12f80a3550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1310199480 tx=0x7f12fc009260 comp rx=0 tx=0).stop 2024-09-13T16:49:17.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 -- 172.21.15.18:0/3895733708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1310072eb0 msgr2=0x7f1310197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:17.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1310072eb0 0x7f1310197f70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f13040306d0 tx=0x7f13040052d0 comp rx=0 tx=0).stop 2024-09-13T16:49:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 -- 172.21.15.18:0/3895733708 shutdown_connections 2024-09-13T16:49:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1310107c10 0x7f131019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1310074490 0x7f13101984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f12f80a1090 0x7f12f80a3550 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 --2- 172.21.15.18:0/3895733708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1310072eb0 0x7f1310197f70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 -- 172.21.15.18:0/3895733708 >> 172.21.15.18:0/3895733708 conn(0x7f13100fb500 msgr2=0x7f1310103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 -- 172.21.15.18:0/3895733708 shutdown_connections 2024-09-13T16:49:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:17.000+0000 7f1317800640 1 -- 172.21.15.18:0/3895733708 wait complete. 2024-09-13T16:49:17.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:16 smithi094 ceph-mon[35259]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:17.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:16 smithi018 ceph-mon[30981]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:17.210 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 16:49:16 smithi018 podman[71834]: 2024-09-13 16:49:16.855242877 +0000 UTC m=+0.451129800 container init c4b7cbb788f597d07a7043d59d97a6cbddd3f853ffa1b9685462c7ccc9ff9024 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T16:49:17.210 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 16:49:16 smithi018 podman[71834]: 2024-09-13 16:49:16.863839261 +0000 UTC m=+0.459726171 container start c4b7cbb788f597d07a7043d59d97a6cbddd3f853ffa1b9685462c7ccc9ff9024 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T16:49:17.210 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 16:49:16 smithi018 ceph-mds[71899]: -- 172.21.15.18:0/2587173653 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d7d3488d00 con 0x55d7d345c800 2024-09-13T16:49:17.210 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 16:49:16 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g[71871]: starting mds.g at 2024-09-13T16:49:17.210 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 16:49:16 smithi018 bash[71834]: c4b7cbb788f597d07a7043d59d97a6cbddd3f853ffa1b9685462c7ccc9ff9024 2024-09-13T16:49:17.210 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 16:49:16 smithi018 systemd[1]: Started Ceph mds.g for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:49:17.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:16 smithi144 ceph-mon[35328]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:17.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:17 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3895733708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:17.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:17.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:17.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:17.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:17.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:17.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:17 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3895733708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:18.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:17 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3895733708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:18.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:18.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:18.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:18.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:18.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:18.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:19.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:19.085 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:18 smithi018 ceph-mon[30981]: Deploying daemon mds.a on smithi018 2024-09-13T16:49:19.085 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:18 smithi018 ceph-mon[30981]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:19.085 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:18 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] up:boot 2024-09-13T16:49:19.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:18 smithi018 ceph-mon[30981]: fsmap 10 up:standby 2024-09-13T16:49:19.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:18 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T16:49:19.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:18 smithi094 ceph-mon[35259]: Deploying daemon mds.a on smithi018 2024-09-13T16:49:19.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:18 smithi094 ceph-mon[35259]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:19.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:18 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] up:boot 2024-09-13T16:49:19.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:18 smithi094 ceph-mon[35259]: fsmap 10 up:standby 2024-09-13T16:49:19.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:18 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T16:49:19.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:18 smithi144 ceph-mon[35328]: Deploying daemon mds.a on smithi018 2024-09-13T16:49:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:18 smithi144 ceph-mon[35328]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:18 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] up:boot 2024-09-13T16:49:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:18 smithi144 ceph-mon[35328]: fsmap 10 up:standby 2024-09-13T16:49:19.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:18 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T16:49:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.380+0000 7f5dfc400640 1 -- 172.21.15.18:0/1423114142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5df40715c0 msgr2=0x7f5df4108990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.380+0000 7f5dfc400640 1 --2- 172.21.15.18:0/1423114142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5df40715c0 0x7f5df4108990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009ca0 tx=0x7f5dec02a8b0 comp rx=0 tx=0).stop 2024-09-13T16:49:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.380+0000 7f5dfc400640 1 -- 172.21.15.18:0/1423114142 shutdown_connections 2024-09-13T16:49:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.380+0000 7f5dfc400640 1 --2- 172.21.15.18:0/1423114142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df4108300 0x7f5df4070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.380+0000 7f5dfc400640 1 --2- 172.21.15.18:0/1423114142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5df40715c0 0x7f5df4108990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.380+0000 7f5dfc400640 1 --2- 172.21.15.18:0/1423114142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df41079c0 0x7f5df4107dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.380+0000 7f5dfc400640 1 -- 172.21.15.18:0/1423114142 >> 172.21.15.18:0/1423114142 conn(0x7f5df406cfa0 msgr2=0x7f5df406f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.380+0000 7f5dfc400640 1 -- 172.21.15.18:0/1423114142 shutdown_connections 2024-09-13T16:49:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.380+0000 7f5dfc400640 1 -- 172.21.15.18:0/1423114142 wait complete. 2024-09-13T16:49:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.382+0000 7f5dfc400640 1 Processor -- start 2024-09-13T16:49:19.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.382+0000 7f5dfc400640 1 -- start start 2024-09-13T16:49:19.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.382+0000 7f5dfc400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5df40715c0 0x7f5df41a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:19.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.382+0000 7f5dfc400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df41079c0 0x7f5df41a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:19.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.382+0000 7f5dfc400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df4108300 0x7f5df41a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:19.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.382+0000 7f5dfc400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df41a81c0 con 0x7f5df41079c0 2024-09-13T16:49:19.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.382+0000 7f5dfc400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df41a8330 con 0x7f5df40715c0 2024-09-13T16:49:19.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.382+0000 7f5dfc400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df41a84f0 con 0x7f5df4108300 2024-09-13T16:49:19.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5df9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df41079c0 0x7f5df41a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:19.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5dfa400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df4108300 0x7f5df41a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:19.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5df9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df41079c0 0x7f5df41a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51874/0 (socket says 172.21.15.18:51874) 2024-09-13T16:49:19.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5dfa400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df4108300 0x7f5df41a7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:33552/0 (socket says 172.21.15.18:33552) 2024-09-13T16:49:19.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5df9000640 1 -- 172.21.15.18:0/2633156057 learned_addr learned my addr 172.21.15.18:0/2633156057 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:19.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5df9a00640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5df40715c0 0x7f5df41a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:19.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5df9000640 1 -- 172.21.15.18:0/2633156057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df4108300 msgr2=0x7f5df41a7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:19.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5df9000640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df4108300 0x7f5df41a7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:19.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5df9000640 1 -- 172.21.15.18:0/2633156057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5df40715c0 msgr2=0x7f5df41a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:19.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5df9000640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5df40715c0 0x7f5df41a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:19.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5df9000640 1 -- 172.21.15.18:0/2633156057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec009900 con 0x7f5df41079c0 2024-09-13T16:49:19.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5dfa400640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df4108300 0x7f5df41a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:19.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.383+0000 7f5df9a00640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5df40715c0 0x7f5df41a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:19.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.384+0000 7f5df9000640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df41079c0 0x7f5df41a0c10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5de000c970 tx=0x7f5de000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:19.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.384+0000 7f5df2000640 1 -- 172.21.15.18:0/2633156057 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0004440 con 0x7f5df41079c0 2024-09-13T16:49:19.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.384+0000 7f5df2000640 1 -- 172.21.15.18:0/2633156057 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5de0007d20 con 0x7f5df41079c0 2024-09-13T16:49:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.384+0000 7f5df2000640 1 -- 172.21.15.18:0/2633156057 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de000f450 con 0x7f5df41079c0 2024-09-13T16:49:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.384+0000 7f5dfc400640 1 -- 172.21.15.18:0/2633156057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df41a87d0 con 0x7f5df41079c0 2024-09-13T16:49:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.384+0000 7f5dfc400640 1 -- 172.21.15.18:0/2633156057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df41a8ce0 con 0x7f5df41079c0 2024-09-13T16:49:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.385+0000 7f5dfc400640 1 -- 172.21.15.18:0/2633156057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df4113440 con 0x7f5df41079c0 2024-09-13T16:49:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.388+0000 7f5df2000640 1 -- 172.21.15.18:0/2633156057 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5de00035f0 con 0x7f5df41079c0 2024-09-13T16:49:19.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.390+0000 7f5df2000640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ddc0a1110 0x7f5ddc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.390+0000 7f5df2000640 1 -- 172.21.15.18:0/2633156057 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5de00cc970 con 0x7f5df41079c0 2024-09-13T16:49:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.390+0000 7f5df9a00640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ddc0a1110 0x7f5ddc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.391+0000 7f5df9a00640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ddc0a1110 0x7f5ddc0a35d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009fc0 tx=0x7f5de8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.392+0000 7f5df2000640 1 -- 172.21.15.18:0/2633156057 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5de0096580 con 0x7f5df41079c0 2024-09-13T16:49:19.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.611+0000 7f5dfc400640 1 -- 172.21.15.18:0/2633156057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5df41160b0 con 0x7f5df41079c0 2024-09-13T16:49:19.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.611+0000 7f5df2000640 1 -- 172.21.15.18:0/2633156057 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8067 (secure 0 0 0) 0x7f5de0099ba0 con 0x7f5df41079c0 2024-09-13T16:49:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:19.613 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24566,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2024-09-13T16:49:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 11 2024-09-13T16:49:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 -- 172.21.15.18:0/2633156057 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ddc0a1110 msgr2=0x7f5ddc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ddc0a1110 0x7f5ddc0a35d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009fc0 tx=0x7f5de8005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 -- 172.21.15.18:0/2633156057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df41079c0 msgr2=0x7f5df41a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df41079c0 0x7f5df41a0c10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5de000c970 tx=0x7f5de000ce30 comp rx=0 tx=0).stop 2024-09-13T16:49:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 -- 172.21.15.18:0/2633156057 shutdown_connections 2024-09-13T16:49:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ddc0a1110 0x7f5ddc0a35d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df41079c0 0x7f5df41a0c10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df4108300 0x7f5df41a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 --2- 172.21.15.18:0/2633156057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5df40715c0 0x7f5df41a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 -- 172.21.15.18:0/2633156057 >> 172.21.15.18:0/2633156057 conn(0x7f5df406cfa0 msgr2=0x7f5df406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 -- 172.21.15.18:0/2633156057 shutdown_connections 2024-09-13T16:49:19.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:19.614+0000 7f5dfc400640 1 -- 172.21.15.18:0/2633156057 wait complete. 2024-09-13T16:49:19.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:19 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2633156057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:19.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:19 smithi018 ceph-mon[30981]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:20.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:19 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2633156057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:20.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:19 smithi094 ceph-mon[35259]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:20.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:19 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2633156057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:20.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:19 smithi144 ceph-mon[35328]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:20.709 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 13 16:49:20 smithi018 systemd[1]: Started Ceph mds.a for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:49:21.632 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:21.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:21.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:21.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:21.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:21.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:21.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:21.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:21 smithi094 ceph-mon[35259]: Deploying daemon mds.b on smithi094 2024-09-13T16:49:21.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:21 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.18:6840/2193765786,v1:172.21.15.18:6841/2193765786] up:boot 2024-09-13T16:49:21.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:21 smithi094 ceph-mon[35259]: fsmap 11 up:standby 2024-09-13T16:49:21.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T16:49:21.687 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:21.688 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:21.688 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:21.688 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:21.688 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:21.688 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:21.688 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:21 smithi018 ceph-mon[30981]: Deploying daemon mds.b on smithi094 2024-09-13T16:49:21.688 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:21 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.18:6840/2193765786,v1:172.21.15.18:6841/2193765786] up:boot 2024-09-13T16:49:21.688 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:21 smithi018 ceph-mon[30981]: fsmap 11 up:standby 2024-09-13T16:49:21.688 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T16:49:21.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:21.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:21.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:21.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T16:49:21.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T16:49:21.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:21.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:21 smithi144 ceph-mon[35328]: Deploying daemon mds.b on smithi094 2024-09-13T16:49:21.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:21 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.18:6840/2193765786,v1:172.21.15.18:6841/2193765786] up:boot 2024-09-13T16:49:21.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:21 smithi144 ceph-mon[35328]: fsmap 11 up:standby 2024-09-13T16:49:21.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T16:49:21.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.801+0000 7f8857e00640 1 -- 172.21.15.18:0/2274392393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8858102fe0 msgr2=0x7f8858103460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.801+0000 7f8857e00640 1 --2- 172.21.15.18:0/2274392393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8858102fe0 0x7f8858103460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8840009900 tx=0x7f884002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.801+0000 7f8857e00640 1 -- 172.21.15.18:0/2274392393 shutdown_connections 2024-09-13T16:49:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.801+0000 7f8857e00640 1 --2- 172.21.15.18:0/2274392393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8858102fe0 0x7f8858103460 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.801+0000 7f8857e00640 1 --2- 172.21.15.18:0/2274392393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88581039a0 0x7f885810a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.801+0000 7f8857e00640 1 --2- 172.21.15.18:0/2274392393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8858101df0 0x7f88581021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.801+0000 7f8857e00640 1 -- 172.21.15.18:0/2274392393 >> 172.21.15.18:0/2274392393 conn(0x7f88580fd570 msgr2=0x7f88580ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:21.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.801+0000 7f8857e00640 1 -- 172.21.15.18:0/2274392393 shutdown_connections 2024-09-13T16:49:21.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.801+0000 7f8857e00640 1 -- 172.21.15.18:0/2274392393 wait complete. 2024-09-13T16:49:21.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.802+0000 7f8857e00640 1 Processor -- start 2024-09-13T16:49:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.802+0000 7f8857e00640 1 -- start start 2024-09-13T16:49:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.802+0000 7f8857e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8858101df0 0x7f8858197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.802+0000 7f8857e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8858102fe0 0x7f8858198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.802+0000 7f8857e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88581039a0 0x7f885819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.802+0000 7f8857e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885819f930 con 0x7f8858102fe0 2024-09-13T16:49:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.802+0000 7f8857e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885819faa0 con 0x7f8858101df0 2024-09-13T16:49:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.802+0000 7f8857e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885819fc60 con 0x7f88581039a0 2024-09-13T16:49:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f884e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8858102fe0 0x7f8858198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f884e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8858102fe0 0x7f8858198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47750/0 (socket says 172.21.15.18:47750) 2024-09-13T16:49:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f884e000640 1 -- 172.21.15.18:0/1334576007 learned_addr learned my addr 172.21.15.18:0/1334576007 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f8856a00640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8858101df0 0x7f8858197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f8857400640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88581039a0 0x7f885819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f884e000640 1 -- 172.21.15.18:0/1334576007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88581039a0 msgr2=0x7f885819f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f884e000640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88581039a0 0x7f885819f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f884e000640 1 -- 172.21.15.18:0/1334576007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8858101df0 msgr2=0x7f8858197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f884e000640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8858101df0 0x7f8858197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f884e000640 1 -- 172.21.15.18:0/1334576007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840009560 con 0x7f8858102fe0 2024-09-13T16:49:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f8857400640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88581039a0 0x7f885819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:49:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.803+0000 7f884e000640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8858102fe0 0x7f8858198380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8840031500 tx=0x7f8840003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.804+0000 7f884fe00640 1 -- 172.21.15.18:0/1334576007 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840003e00 con 0x7f8858102fe0 2024-09-13T16:49:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.804+0000 7f884fe00640 1 -- 172.21.15.18:0/1334576007 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8840031c70 con 0x7f8858102fe0 2024-09-13T16:49:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.804+0000 7f884fe00640 1 -- 172.21.15.18:0/1334576007 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884003bc20 con 0x7f8858102fe0 2024-09-13T16:49:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.804+0000 7f8857e00640 1 -- 172.21.15.18:0/1334576007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885819fee0 con 0x7f8858102fe0 2024-09-13T16:49:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.804+0000 7f8857e00640 1 -- 172.21.15.18:0/1334576007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88581a0300 con 0x7f8858102fe0 2024-09-13T16:49:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.805+0000 7f8857e00640 1 -- 172.21.15.18:0/1334576007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88581092d0 con 0x7f8858102fe0 2024-09-13T16:49:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.807+0000 7f884fe00640 1 -- 172.21.15.18:0/1334576007 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f88400317b0 con 0x7f8858102fe0 2024-09-13T16:49:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.808+0000 7f884fe00640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f883c0a1110 0x7f883c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.808+0000 7f884fe00640 1 -- 172.21.15.18:0/1334576007 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f88400ecd60 con 0x7f8858102fe0 2024-09-13T16:49:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.808+0000 7f8856a00640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f883c0a1110 0x7f883c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.809+0000 7f8856a00640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f883c0a1110 0x7f883c0a35d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8858102e40 tx=0x7f8848009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:21.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:21.812+0000 7f884fe00640 1 -- 172.21.15.18:0/1334576007 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f88400b68f0 con 0x7f8858102fe0 2024-09-13T16:49:22.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.028+0000 7f8857e00640 1 -- 172.21.15.18:0/1334576007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f885810d700 con 0x7f8858102fe0 2024-09-13T16:49:22.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.029+0000 7f884fe00640 1 -- 172.21.15.18:0/1334576007 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8825 (secure 0 0 0) 0x7f88400b9f10 con 0x7f8858102fe0 2024-09-13T16:49:22.030 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:22.031 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24566,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2024-09-13T16:49:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 12 2024-09-13T16:49:22.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 -- 172.21.15.18:0/1334576007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f883c0a1110 msgr2=0x7f883c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:22.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f883c0a1110 0x7f883c0a35d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8858102e40 tx=0x7f8848009500 comp rx=0 tx=0).stop 2024-09-13T16:49:22.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 -- 172.21.15.18:0/1334576007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8858102fe0 msgr2=0x7f8858198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:22.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8858102fe0 0x7f8858198380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8840031500 tx=0x7f8840003c10 comp rx=0 tx=0).stop 2024-09-13T16:49:22.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 -- 172.21.15.18:0/1334576007 shutdown_connections 2024-09-13T16:49:22.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f883c0a1110 0x7f883c0a35d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8858102fe0 0x7f8858198380 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88581039a0 0x7f885819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 --2- 172.21.15.18:0/1334576007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8858101df0 0x7f8858197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 -- 172.21.15.18:0/1334576007 >> 172.21.15.18:0/1334576007 conn(0x7f88580fd570 msgr2=0x7f88581064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 -- 172.21.15.18:0/1334576007 shutdown_connections 2024-09-13T16:49:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:22.031+0000 7f8857e00640 1 -- 172.21.15.18:0/1334576007 wait complete. 2024-09-13T16:49:22.662 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:22 smithi094 systemd[1]: Starting Ceph mds.b for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T16:49:22.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:22 smithi094 ceph-mon[35259]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:22.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:22 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1334576007' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:22.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:22 smithi018 ceph-mon[30981]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:22.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:22 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1334576007' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:22.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:22 smithi144 ceph-mon[35328]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:22.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:22 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1334576007' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:23.044 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:22 smithi094 podman[65646]: 2024-09-13 16:49:22.675614731 +0000 UTC m=+0.016232120 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:49:23.044 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:22 smithi094 podman[65646]: 2024-09-13 16:49:22.78207884 +0000 UTC m=+0.122696254 container create 88b0f03328cb87d7ffef789263229b31e1c63356dadcc910d170fdd17956041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:49:23.044 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:23 smithi094 podman[65646]: 2024-09-13 16:49:23.043482009 +0000 UTC m=+0.384099386 container init 88b0f03328cb87d7ffef789263229b31e1c63356dadcc910d170fdd17956041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T16:49:23.412 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:23 smithi094 podman[65646]: 2024-09-13 16:49:23.046317571 +0000 UTC m=+0.386934945 container start 88b0f03328cb87d7ffef789263229b31e1c63356dadcc910d170fdd17956041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T16:49:23.412 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:23 smithi094 ceph-mds[65666]: -- 172.21.15.94:0/1928776065 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561b82526d00 con 0x561b824fb000 2024-09-13T16:49:23.412 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:23 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b[65662]: starting mds.b at 2024-09-13T16:49:23.412 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:23 smithi094 bash[65646]: 88b0f03328cb87d7ffef789263229b31e1c63356dadcc910d170fdd17956041a 2024-09-13T16:49:23.412 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:23 smithi094 systemd[1]: Started Ceph mds.b for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T16:49:24.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:24.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.213+0000 7f5e9f600640 1 -- 172.21.15.18:0/2132147760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98103150 msgr2=0x7f5e98105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:24.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.213+0000 7f5e9f600640 1 --2- 172.21.15.18:0/2132147760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98103150 0x7f5e98105540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009900 tx=0x7f5e8402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.214+0000 7f5e9f600640 1 -- 172.21.15.18:0/2132147760 shutdown_connections 2024-09-13T16:49:24.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.214+0000 7f5e9f600640 1 --2- 172.21.15.18:0/2132147760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e98105a80 0x7f5e98107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.214+0000 7f5e9f600640 1 --2- 172.21.15.18:0/2132147760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98103150 0x7f5e98105540 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.214+0000 7f5e9f600640 1 --2- 172.21.15.18:0/2132147760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98100820 0x7f5e98102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.214+0000 7f5e9f600640 1 -- 172.21.15.18:0/2132147760 >> 172.21.15.18:0/2132147760 conn(0x7f5e980fa420 msgr2=0x7f5e980fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:24.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.214+0000 7f5e9f600640 1 -- 172.21.15.18:0/2132147760 shutdown_connections 2024-09-13T16:49:24.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.214+0000 7f5e9f600640 1 -- 172.21.15.18:0/2132147760 wait complete. 2024-09-13T16:49:24.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e9f600640 1 Processor -- start 2024-09-13T16:49:24.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e9f600640 1 -- start start 2024-09-13T16:49:24.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e9f600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98100820 0x7f5e98198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:24.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e9f600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e98103150 0x7f5e98198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:24.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e9f600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98105a80 0x7f5e9819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e9f600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9819fc10 con 0x7f5e98103150 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e9f600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9819fd80 con 0x7f5e98105a80 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e9f600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9819ff40 con 0x7f5e98100820 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e97e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e98103150 0x7f5e98198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e9cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98100820 0x7f5e98198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e97e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e98103150 0x7f5e98198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47774/0 (socket says 172.21.15.18:47774) 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.215+0000 7f5e97e00640 1 -- 172.21.15.18:0/1398028472 learned_addr learned my addr 172.21.15.18:0/1398028472 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.216+0000 7f5e9d600640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98105a80 0x7f5e9819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.216+0000 7f5e97e00640 1 -- 172.21.15.18:0/1398028472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98100820 msgr2=0x7f5e98198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.216+0000 7f5e97e00640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98100820 0x7f5e98198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.216+0000 7f5e97e00640 1 -- 172.21.15.18:0/1398028472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98105a80 msgr2=0x7f5e9819f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.216+0000 7f5e97e00640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98105a80 0x7f5e9819f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.216+0000 7f5e97e00640 1 -- 172.21.15.18:0/1398028472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e90009840 con 0x7f5e98103150 2024-09-13T16:49:24.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.216+0000 7f5e97e00640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e98103150 0x7f5e98198660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5e84005ab0 tx=0x7f5e84003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:24.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.216+0000 7f5e95600640 1 -- 172.21.15.18:0/1398028472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84005d50 con 0x7f5e98103150 2024-09-13T16:49:24.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.217+0000 7f5e95600640 1 -- 172.21.15.18:0/1398028472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e84003e00 con 0x7f5e98103150 2024-09-13T16:49:24.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.217+0000 7f5e9f600640 1 -- 172.21.15.18:0/1398028472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e84009560 con 0x7f5e98103150 2024-09-13T16:49:24.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.217+0000 7f5e95600640 1 -- 172.21.15.18:0/1398028472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8403bb30 con 0x7f5e98103150 2024-09-13T16:49:24.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.217+0000 7f5e9f600640 1 -- 172.21.15.18:0/1398028472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e981a0530 con 0x7f5e98103150 2024-09-13T16:49:24.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.218+0000 7f5e9f600640 1 -- 172.21.15.18:0/1398028472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e981075c0 con 0x7f5e98103150 2024-09-13T16:49:24.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.220+0000 7f5e95600640 1 -- 172.21.15.18:0/1398028472 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5e8403bc90 con 0x7f5e98103150 2024-09-13T16:49:24.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.221+0000 7f5e95600640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1110 0x7f5e800a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:24.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.221+0000 7f5e95600640 1 -- 172.21.15.18:0/1398028472 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5e840eccf0 con 0x7f5e98103150 2024-09-13T16:49:24.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.221+0000 7f5e9cc00640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1110 0x7f5e800a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:24.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.222+0000 7f5e9cc00640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1110 0x7f5e800a35d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009bd0 tx=0x7f5e8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:24.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.225+0000 7f5e95600640 1 -- 172.21.15.18:0/1398028472 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5e840b6880 con 0x7f5e98103150 2024-09-13T16:49:24.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:49:24.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:24 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] up:boot 2024-09-13T16:49:24.359 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:24 smithi018 ceph-mon[30981]: fsmap 12 up:standby 2024-09-13T16:49:24.360 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:24 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:49:24.360 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:24 smithi018 ceph-mon[30981]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.447+0000 7f5e9f600640 1 -- 172.21.15.18:0/1398028472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e9810b6e0 con 0x7f5e98103150 2024-09-13T16:49:24.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.447+0000 7f5e95600640 1 -- 172.21.15.18:0/1398028472 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9583 (secure 0 0 0) 0x7f5e840b9ea0 con 0x7f5e98103150 2024-09-13T16:49:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:24.449 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24566,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24590,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-09-13T16:49:24.450 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-13T16:49:24.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 -- 172.21.15.18:0/1398028472 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1110 msgr2=0x7f5e800a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:24.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1110 0x7f5e800a35d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009bd0 tx=0x7f5e8c005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:24.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 -- 172.21.15.18:0/1398028472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e98103150 msgr2=0x7f5e98198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:24.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e98103150 0x7f5e98198660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5e84005ab0 tx=0x7f5e84003c10 comp rx=0 tx=0).stop 2024-09-13T16:49:24.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 -- 172.21.15.18:0/1398028472 shutdown_connections 2024-09-13T16:49:24.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5e800a1110 0x7f5e800a35d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e98103150 0x7f5e98198660 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98105a80 0x7f5e9819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 --2- 172.21.15.18:0/1398028472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e98100820 0x7f5e98198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 -- 172.21.15.18:0/1398028472 >> 172.21.15.18:0/1398028472 conn(0x7f5e980fa420 msgr2=0x7f5e98100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:24.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 -- 172.21.15.18:0/1398028472 shutdown_connections 2024-09-13T16:49:24.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.450+0000 7f5e9f600640 1 -- 172.21.15.18:0/1398028472 wait complete. 2024-09-13T16:49:24.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:49:24.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:49:24.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:24 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] up:boot 2024-09-13T16:49:24.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:24 smithi144 ceph-mon[35328]: fsmap 12 up:standby 2024-09-13T16:49:24.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:24 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:49:24.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:24 smithi144 ceph-mon[35328]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:24.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.624+0000 7fa126000640 1 -- 172.21.15.18:0/502962715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1200fedd0 msgr2=0x7fa1200ff250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:24.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.624+0000 7fa126000640 1 --2- 172.21.15.18:0/502962715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1200fedd0 0x7fa1200ff250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009900 tx=0x7fa10c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.624+0000 7fa126000640 1 -- 172.21.15.18:0/502962715 shutdown_connections 2024-09-13T16:49:24.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.624+0000 7fa126000640 1 --2- 172.21.15.18:0/502962715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1200ff790 0x7fa120104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.624+0000 7fa126000640 1 --2- 172.21.15.18:0/502962715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1200fedd0 0x7fa1200ff250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.624+0000 7fa126000640 1 --2- 172.21.15.18:0/502962715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1200fe070 0x7fa1200fe470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.624+0000 7fa126000640 1 -- 172.21.15.18:0/502962715 >> 172.21.15.18:0/502962715 conn(0x7fa1200f9bb0 msgr2=0x7fa1200fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:24.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.624+0000 7fa126000640 1 -- 172.21.15.18:0/502962715 shutdown_connections 2024-09-13T16:49:24.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.624+0000 7fa126000640 1 -- 172.21.15.18:0/502962715 wait complete. 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.625+0000 7fa126000640 1 Processor -- start 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.625+0000 7fa126000640 1 -- start start 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.625+0000 7fa126000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1200fe070 0x7fa12019c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.625+0000 7fa126000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1200fedd0 0x7fa12019c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.625+0000 7fa126000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1200ff790 0x7fa1201a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa126000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1201a3f70 con 0x7fa1200fe070 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa126000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1201a40e0 con 0x7fa1200fedd0 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa126000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1201a42a0 con 0x7fa1200ff790 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11ea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1200fedd0 0x7fa12019c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11ea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1200fedd0 0x7fa12019c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:47426/0 (socket says 172.21.15.18:47426) 2024-09-13T16:49:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1200ff790 0x7fa1201a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11ea00640 1 -- 172.21.15.18:0/65340240 learned_addr learned my addr 172.21.15.18:0/65340240 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11f400640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1200fe070 0x7fa12019c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11ea00640 1 -- 172.21.15.18:0/65340240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1200ff790 msgr2=0x7fa1201a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11ea00640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1200ff790 0x7fa1201a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11ea00640 1 -- 172.21.15.18:0/65340240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1200fe070 msgr2=0x7fa12019c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11ea00640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1200fe070 0x7fa12019c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11ea00640 1 -- 172.21.15.18:0/65340240 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c009560 con 0x7fa1200fedd0 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11fe00640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1200ff790 0x7fa1201a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.626+0000 7fa11ea00640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1200fedd0 0x7fa12019c9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa10c005ab0 tx=0x7fa10c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.627+0000 7fa117e00640 1 -- 172.21.15.18:0/65340240 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c005d50 con 0x7fa1200fedd0 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.627+0000 7fa117e00640 1 -- 172.21.15.18:0/65340240 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa10c003e00 con 0x7fa1200fedd0 2024-09-13T16:49:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.627+0000 7fa126000640 1 -- 172.21.15.18:0/65340240 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1201a4520 con 0x7fa1200fedd0 2024-09-13T16:49:24.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.627+0000 7fa117e00640 1 -- 172.21.15.18:0/65340240 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c03bba0 con 0x7fa1200fedd0 2024-09-13T16:49:24.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.627+0000 7fa126000640 1 -- 172.21.15.18:0/65340240 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1201a4a20 con 0x7fa1200fedd0 2024-09-13T16:49:24.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.628+0000 7fa126000640 1 -- 172.21.15.18:0/65340240 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa120102e20 con 0x7fa1200fedd0 2024-09-13T16:49:24.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.630+0000 7fa117e00640 1 -- 172.21.15.18:0/65340240 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa10c03bd00 con 0x7fa1200fedd0 2024-09-13T16:49:24.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.631+0000 7fa117e00640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1040a1110 0x7fa1040a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:24.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.631+0000 7fa117e00640 1 -- 172.21.15.18:0/65340240 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa10c0eccb0 con 0x7fa1200fedd0 2024-09-13T16:49:24.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.631+0000 7fa11f400640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1040a1110 0x7fa1040a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:24.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.632+0000 7fa11f400640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1040a1110 0x7fa1040a35d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa110009bd0 tx=0x7fa110005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:24.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.633+0000 7fa117e00640 1 -- 172.21.15.18:0/65340240 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa10c0b68f0 con 0x7fa1200fedd0 2024-09-13T16:49:24.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:24.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:49:24.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:24 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] up:boot 2024-09-13T16:49:24.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:24 smithi094 ceph-mon[35259]: fsmap 12 up:standby 2024-09-13T16:49:24.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:24 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:49:24.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:24 smithi094 ceph-mon[35259]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:24.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.843+0000 7fa126000640 1 -- 172.21.15.18:0/65340240 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa120111d60 con 0x7fa1200fedd0 2024-09-13T16:49:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.844+0000 7fa117e00640 1 -- 172.21.15.18:0/65340240 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18336 (secure 0 0 0) 0x7fa10c0b9f10 con 0x7fa1200fedd0 2024-09-13T16:49:24.846 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:24.846 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:48:35.483958+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:49:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.846+0000 7fa126000640 1 -- 172.21.15.18:0/65340240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1040a1110 msgr2=0x7fa1040a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.846+0000 7fa126000640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1040a1110 0x7fa1040a35d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa110009bd0 tx=0x7fa110005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.846+0000 7fa126000640 1 -- 172.21.15.18:0/65340240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1200fedd0 msgr2=0x7fa12019c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.846+0000 7fa126000640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1200fedd0 0x7fa12019c9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa10c005ab0 tx=0x7fa10c003c10 comp rx=0 tx=0).stop 2024-09-13T16:49:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.846+0000 7fa126000640 1 -- 172.21.15.18:0/65340240 shutdown_connections 2024-09-13T16:49:24.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.846+0000 7fa126000640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1200ff790 0x7fa1201a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.846+0000 7fa126000640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1200fedd0 0x7fa12019c9c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.846+0000 7fa126000640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1040a1110 0x7fa1040a35d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.847+0000 7fa126000640 1 --2- 172.21.15.18:0/65340240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1200fe070 0x7fa12019c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:24.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.847+0000 7fa126000640 1 -- 172.21.15.18:0/65340240 >> 172.21.15.18:0/65340240 conn(0x7fa1200f9bb0 msgr2=0x7fa1200ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:24.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.847+0000 7fa126000640 1 -- 172.21.15.18:0/65340240 shutdown_connections 2024-09-13T16:49:24.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:24.847+0000 7fa126000640 1 -- 172.21.15.18:0/65340240 wait complete. 2024-09-13T16:49:24.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T16:49:24.869 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:49:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.036+0000 7fed0e000640 1 -- 172.21.15.18:0/1259276918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed08100e20 msgr2=0x7fed081012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.036+0000 7fed0e000640 1 --2- 172.21.15.18:0/1259276918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed08100e20 0x7fed081012a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009900 tx=0x7fecf402a410 comp rx=0 tx=0).stop 2024-09-13T16:49:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.037+0000 7fed0e000640 1 -- 172.21.15.18:0/1259276918 shutdown_connections 2024-09-13T16:49:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.037+0000 7fed0e000640 1 --2- 172.21.15.18:0/1259276918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed081017e0 0x7fed08108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.037+0000 7fed0e000640 1 --2- 172.21.15.18:0/1259276918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed08100e20 0x7fed081012a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.037+0000 7fed0e000640 1 --2- 172.21.15.18:0/1259276918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed080ffc30 0x7fed08100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.037+0000 7fed0e000640 1 -- 172.21.15.18:0/1259276918 >> 172.21.15.18:0/1259276918 conn(0x7fed080fb390 msgr2=0x7fed080fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.037+0000 7fed0e000640 1 -- 172.21.15.18:0/1259276918 shutdown_connections 2024-09-13T16:49:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.037+0000 7fed0e000640 1 -- 172.21.15.18:0/1259276918 wait complete. 2024-09-13T16:49:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0e000640 1 Processor -- start 2024-09-13T16:49:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0e000640 1 -- start start 2024-09-13T16:49:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed080ffc30 0x7fed08197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed08100e20 0x7fed081983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed081017e0 0x7fed0819f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0819f950 con 0x7fed08100e20 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0e000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0819fac0 con 0x7fed080ffc30 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0819fc80 con 0x7fed081017e0 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed080ffc30 0x7fed08197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed080ffc30 0x7fed08197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:47452/0 (socket says 172.21.15.18:47452) 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0cc00640 1 -- 172.21.15.18:0/3966290190 learned_addr learned my addr 172.21.15.18:0/3966290190 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed07e00640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed08100e20 0x7fed081983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.038+0000 7fed0d600640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed081017e0 0x7fed0819f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed0cc00640 1 -- 172.21.15.18:0/3966290190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed081017e0 msgr2=0x7fed0819f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed0cc00640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed081017e0 0x7fed0819f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed0cc00640 1 -- 172.21.15.18:0/3966290190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed08100e20 msgr2=0x7fed081983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed0cc00640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed08100e20 0x7fed081983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed0cc00640 1 -- 172.21.15.18:0/3966290190 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4009560 con 0x7fed080ffc30 2024-09-13T16:49:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed0cc00640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed080ffc30 0x7fed08197e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00e9c0 tx=0x7fecfc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:25.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed05600640 1 -- 172.21.15.18:0/3966290190 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc009700 con 0x7fed080ffc30 2024-09-13T16:49:25.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed05600640 1 -- 172.21.15.18:0/3966290190 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecfc0044e0 con 0x7fed080ffc30 2024-09-13T16:49:25.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed0e000640 1 -- 172.21.15.18:0/3966290190 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0819ff60 con 0x7fed080ffc30 2024-09-13T16:49:25.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed05600640 1 -- 172.21.15.18:0/3966290190 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc010430 con 0x7fed080ffc30 2024-09-13T16:49:25.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.039+0000 7fed0e000640 1 -- 172.21.15.18:0/3966290190 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed081a0390 con 0x7fed080ffc30 2024-09-13T16:49:25.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.040+0000 7fed0e000640 1 -- 172.21.15.18:0/3966290190 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0810b520 con 0x7fed080ffc30 2024-09-13T16:49:25.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.043+0000 7fed05600640 1 -- 172.21.15.18:0/3966290190 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fecfc003f60 con 0x7fed080ffc30 2024-09-13T16:49:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.044+0000 7fed05600640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecf00a1110 0x7fecf00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.044+0000 7fed05600640 1 -- 172.21.15.18:0/3966290190 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fecfc014070 con 0x7fed080ffc30 2024-09-13T16:49:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.044+0000 7fed07e00640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecf00a1110 0x7fecf00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.045+0000 7fed07e00640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecf00a1110 0x7fecf00a35d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fecf4005ab0 tx=0x7fecf4005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:25.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.048+0000 7fed05600640 1 -- 172.21.15.18:0/3966290190 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fecfc096460 con 0x7fed080ffc30 2024-09-13T16:49:25.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.231+0000 7fed0e000640 1 -- 172.21.15.18:0/3966290190 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed081a0900 con 0x7fed080ffc30 2024-09-13T16:49:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.232+0000 7fed05600640 1 -- 172.21.15.18:0/3966290190 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fecfc099a80 con 0x7fed080ffc30 2024-09-13T16:49:25.233 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T16:49:25.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 -- 172.21.15.18:0/3966290190 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecf00a1110 msgr2=0x7fecf00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecf00a1110 0x7fecf00a35d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fecf4005ab0 tx=0x7fecf4005780 comp rx=0 tx=0).stop 2024-09-13T16:49:25.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 -- 172.21.15.18:0/3966290190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed080ffc30 msgr2=0x7fed08197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed080ffc30 0x7fed08197e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00e9c0 tx=0x7fecfc00ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:25.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 -- 172.21.15.18:0/3966290190 shutdown_connections 2024-09-13T16:49:25.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fecf00a1110 0x7fecf00a35d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed08100e20 0x7fed081983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed081017e0 0x7fed0819f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 --2- 172.21.15.18:0/3966290190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed080ffc30 0x7fed08197e60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 -- 172.21.15.18:0/3966290190 >> 172.21.15.18:0/3966290190 conn(0x7fed080fb390 msgr2=0x7fed081065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:25.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 -- 172.21.15.18:0/3966290190 shutdown_connections 2024-09-13T16:49:25.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.234+0000 7fed0e000640 1 -- 172.21.15.18:0/3966290190 wait complete. 2024-09-13T16:49:25.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T16:49:25.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.425+0000 7efda3e00640 1 -- 172.21.15.18:0/3576087192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efda40ffba0 msgr2=0x7efda40fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.425+0000 7efda3e00640 1 --2- 172.21.15.18:0/3576087192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efda40ffba0 0x7efda40fffa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efd94009900 tx=0x7efd9402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.425+0000 7efda3e00640 1 -- 172.21.15.18:0/3576087192 shutdown_connections 2024-09-13T16:49:25.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.426+0000 7efda3e00640 1 --2- 172.21.15.18:0/3576087192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efda4101750 0x7efda4107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.426+0000 7efda3e00640 1 --2- 172.21.15.18:0/3576087192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda4100d90 0x7efda4101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.426+0000 7efda3e00640 1 --2- 172.21.15.18:0/3576087192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efda40ffba0 0x7efda40fffa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.426+0000 7efda3e00640 1 -- 172.21.15.18:0/3576087192 >> 172.21.15.18:0/3576087192 conn(0x7efda40fb300 msgr2=0x7efda40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.426+0000 7efda3e00640 1 -- 172.21.15.18:0/3576087192 shutdown_connections 2024-09-13T16:49:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.426+0000 7efda3e00640 1 -- 172.21.15.18:0/3576087192 wait complete. 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda3e00640 1 Processor -- start 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda3e00640 1 -- start start 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efda40ffba0 0x7efda4197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda4100d90 0x7efda4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efda4101750 0x7efda419f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda419f8b0 con 0x7efda40ffba0 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda3e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda419fa20 con 0x7efda4101750 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda419fbe0 con 0x7efda4100d90 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efda40ffba0 0x7efda4197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efda40ffba0 0x7efda4197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47828/0 (socket says 172.21.15.18:47828) 2024-09-13T16:49:25.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda2a00640 1 -- 172.21.15.18:0/3525901195 learned_addr learned my addr 172.21.15.18:0/3525901195 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda3400640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efda4101750 0x7efda419f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.427+0000 7efda2000640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda4100d90 0x7efda4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efda3400640 1 -- 172.21.15.18:0/3525901195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda4100d90 msgr2=0x7efda4198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efda3400640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda4100d90 0x7efda4198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efda3400640 1 -- 172.21.15.18:0/3525901195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efda40ffba0 msgr2=0x7efda4197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efda3400640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efda40ffba0 0x7efda4197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efda3400640 1 -- 172.21.15.18:0/3525901195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90009490 con 0x7efda4101750 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efda3400640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efda4101750 0x7efda419f370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009fd0 tx=0x7efd9c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efd9b400640 1 -- 172.21.15.18:0/3525901195 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00ce20 con 0x7efda4101750 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efd9b400640 1 -- 172.21.15.18:0/3525901195 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd9c005020 con 0x7efda4101750 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efd9b400640 1 -- 172.21.15.18:0/3525901195 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c010670 con 0x7efda4101750 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efda3e00640 1 -- 172.21.15.18:0/3525901195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd94009560 con 0x7efda4101750 2024-09-13T16:49:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.428+0000 7efda3e00640 1 -- 172.21.15.18:0/3525901195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda41a0190 con 0x7efda4101750 2024-09-13T16:49:25.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.430+0000 7efda3e00640 1 -- 172.21.15.18:0/3525901195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda410b490 con 0x7efda4101750 2024-09-13T16:49:25.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.431+0000 7efd9b400640 1 -- 172.21.15.18:0/3525901195 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efd9c005450 con 0x7efda4101750 2024-09-13T16:49:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.433+0000 7efd9b400640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7efd880a1110 0x7efd880a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.433+0000 7efd9b400640 1 -- 172.21.15.18:0/3525901195 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efd9c014070 con 0x7efda4101750 2024-09-13T16:49:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.433+0000 7efda2a00640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7efd880a1110 0x7efd880a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.434+0000 7efda2a00640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7efd880a1110 0x7efd880a35d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd94000c00 tx=0x7efd94005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:25.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.436+0000 7efd9b400640 1 -- 172.21.15.18:0/3525901195 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efd9c096770 con 0x7efda4101750 2024-09-13T16:49:25.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.627+0000 7efda3e00640 1 -- 172.21.15.18:0/3525901195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efda41a0590 con 0x7efda4101750 2024-09-13T16:49:25.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.628+0000 7efd9b400640 1 -- 172.21.15.18:0/3525901195 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7efd9c099d90 con 0x7efda4101750 2024-09-13T16:49:25.629 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:25.629 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-13T16:49:25.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T16:49:25.629 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-13T16:49:25.629 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-13T16:49:25.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T16:49:25.629 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-13T16:49:25.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 -- 172.21.15.18:0/3525901195 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7efd880a1110 msgr2=0x7efd880a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7efd880a1110 0x7efd880a35d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd94000c00 tx=0x7efd94005780 comp rx=0 tx=0).stop 2024-09-13T16:49:25.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 -- 172.21.15.18:0/3525901195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efda4101750 msgr2=0x7efda419f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efda4101750 0x7efda419f370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009fd0 tx=0x7efd9c00ef10 comp rx=0 tx=0).stop 2024-09-13T16:49:25.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 -- 172.21.15.18:0/3525901195 shutdown_connections 2024-09-13T16:49:25.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efda4101750 0x7efda419f370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda4100d90 0x7efda4198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7efd880a1110 0x7efd880a35d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 --2- 172.21.15.18:0/3525901195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efda40ffba0 0x7efda4197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 -- 172.21.15.18:0/3525901195 >> 172.21.15.18:0/3525901195 conn(0x7efda40fb300 msgr2=0x7efda4106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:25.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 -- 172.21.15.18:0/3525901195 shutdown_connections 2024-09-13T16:49:25.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.630+0000 7efda3e00640 1 -- 172.21.15.18:0/3525901195 wait complete. 2024-09-13T16:49:25.645 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:25 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1398028472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:25.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:25 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:25 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:25 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:25 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:25 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/65340240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:25.647 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:25 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3966290190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:49:25.648 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T16:49:25.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T16:49:25.668 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:25 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1398028472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:25.668 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:25 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.669 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:25 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.669 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:25 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.669 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:25 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.669 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:25 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/65340240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:25.669 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:25 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3966290190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:49:25.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:25 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1398028472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:25.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:25 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:25 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:25 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:25 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:25.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:25 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/65340240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:25.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:25 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3966290190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:49:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.818+0000 7ff28bc00640 1 -- 172.21.15.18:0/1281479938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff284074470 msgr2=0x7ff2840728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.818+0000 7ff28bc00640 1 --2- 172.21.15.18:0/1281479938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff284074470 0x7ff2840728c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff278009900 tx=0x7ff27802a480 comp rx=0 tx=0).stop 2024-09-13T16:49:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.819+0000 7ff28bc00640 1 -- 172.21.15.18:0/1281479938 shutdown_connections 2024-09-13T16:49:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.819+0000 7ff28bc00640 1 --2- 172.21.15.18:0/1281479938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff284107c20 0x7ff28410a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.819+0000 7ff28bc00640 1 --2- 172.21.15.18:0/1281479938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff284072e90 0x7ff2840732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.819+0000 7ff28bc00640 1 --2- 172.21.15.18:0/1281479938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff284074470 0x7ff2840728c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.819+0000 7ff28bc00640 1 -- 172.21.15.18:0/1281479938 >> 172.21.15.18:0/1281479938 conn(0x7ff2840fb4d0 msgr2=0x7ff2840fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.819+0000 7ff28bc00640 1 -- 172.21.15.18:0/1281479938 shutdown_connections 2024-09-13T16:49:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.819+0000 7ff28bc00640 1 -- 172.21.15.18:0/1281479938 wait complete. 2024-09-13T16:49:25.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff28bc00640 1 Processor -- start 2024-09-13T16:49:25.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff28bc00640 1 -- start start 2024-09-13T16:49:25.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff28bc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff284072e90 0x7ff284198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff28bc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff284074470 0x7ff284198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff28bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff284107c20 0x7ff28419f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff28bc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28419fb10 con 0x7ff284074470 2024-09-13T16:49:25.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff28bc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28419fc80 con 0x7ff284072e90 2024-09-13T16:49:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff28bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28419fe40 con 0x7ff284107c20 2024-09-13T16:49:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff283e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff284074470 0x7ff284198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff289200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff284072e90 0x7ff284198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff283e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff284074470 0x7ff284198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47850/0 (socket says 172.21.15.18:47850) 2024-09-13T16:49:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.820+0000 7ff283e00640 1 -- 172.21.15.18:0/1847881116 learned_addr learned my addr 172.21.15.18:0/1847881116 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff289c00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff284107c20 0x7ff28419f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff283e00640 1 -- 172.21.15.18:0/1847881116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff284107c20 msgr2=0x7ff28419f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff283e00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff284107c20 0x7ff28419f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff283e00640 1 -- 172.21.15.18:0/1847881116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff284072e90 msgr2=0x7ff284198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff283e00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff284072e90 0x7ff284198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff283e00640 1 -- 172.21.15.18:0/1847881116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270009490 con 0x7ff284074470 2024-09-13T16:49:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff289c00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff284107c20 0x7ff28419f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:49:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff283e00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff284074470 0x7ff284198560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff27000ea60 tx=0x7ff27000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:25.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff281600640 1 -- 172.21.15.18:0/1847881116 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000cde0 con 0x7ff284074470 2024-09-13T16:49:25.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff281600640 1 -- 172.21.15.18:0/1847881116 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2700035f0 con 0x7ff284074470 2024-09-13T16:49:25.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff281600640 1 -- 172.21.15.18:0/1847881116 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2700044e0 con 0x7ff284074470 2024-09-13T16:49:25.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.821+0000 7ff28bc00640 1 -- 172.21.15.18:0/1847881116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff278009560 con 0x7ff284074470 2024-09-13T16:49:25.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.822+0000 7ff28bc00640 1 -- 172.21.15.18:0/1847881116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2841a0450 con 0x7ff284074470 2024-09-13T16:49:25.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.823+0000 7ff28bc00640 1 -- 172.21.15.18:0/1847881116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2841069e0 con 0x7ff284074470 2024-09-13T16:49:25.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.825+0000 7ff281600640 1 -- 172.21.15.18:0/1847881116 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff270003a60 con 0x7ff284074470 2024-09-13T16:49:25.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.827+0000 7ff281600640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff26c0a1110 0x7ff26c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:25.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.827+0000 7ff281600640 1 -- 172.21.15.18:0/1847881116 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff270014070 con 0x7ff284074470 2024-09-13T16:49:25.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.827+0000 7ff289200640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff26c0a1110 0x7ff26c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:25.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.828+0000 7ff289200640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff26c0a1110 0x7ff26c0a35d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff278006010 tx=0x7ff278005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:25.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:25.830+0000 7ff281600640 1 -- 172.21.15.18:0/1847881116 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff270096530 con 0x7ff284074470 2024-09-13T16:49:26.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.019+0000 7ff28bc00640 1 -- 172.21.15.18:0/1847881116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff28410d880 con 0x7ff284074470 2024-09-13T16:49:26.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.627+0000 7ff281600640 1 -- 172.21.15.18:0/1847881116 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff270099b50 con 0x7ff284074470 2024-09-13T16:49:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-13T16:49:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.631+0000 7ff28bc00640 1 -- 172.21.15.18:0/1847881116 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff26c0a1110 msgr2=0x7ff26c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.631+0000 7ff28bc00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff26c0a1110 0x7ff26c0a35d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff278006010 tx=0x7ff278005760 comp rx=0 tx=0).stop 2024-09-13T16:49:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.631+0000 7ff28bc00640 1 -- 172.21.15.18:0/1847881116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff284074470 msgr2=0x7ff284198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.631+0000 7ff28bc00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff284074470 0x7ff284198560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff27000ea60 tx=0x7ff27000ef20 comp rx=0 tx=0).stop 2024-09-13T16:49:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.631+0000 7ff28bc00640 1 -- 172.21.15.18:0/1847881116 shutdown_connections 2024-09-13T16:49:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.631+0000 7ff28bc00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff26c0a1110 0x7ff26c0a35d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.631+0000 7ff28bc00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff284074470 0x7ff284198560 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.631+0000 7ff28bc00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff284107c20 0x7ff28419f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.631+0000 7ff28bc00640 1 --2- 172.21.15.18:0/1847881116 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff284072e90 0x7ff284198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.631+0000 7ff28bc00640 1 -- 172.21.15.18:0/1847881116 >> 172.21.15.18:0/1847881116 conn(0x7ff2840fb4d0 msgr2=0x7ff284103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.632+0000 7ff28bc00640 1 -- 172.21.15.18:0/1847881116 shutdown_connections 2024-09-13T16:49:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.632+0000 7ff28bc00640 1 -- 172.21.15.18:0/1847881116 wait complete. 2024-09-13T16:49:26.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T16:49:26.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:26.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:26.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:26.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:49:26.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:26.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:26 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3525901195' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T16:49:26.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:26 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:49:26.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:26 smithi018 ceph-mon[30981]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:26.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:26.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:26.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:26.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:49:26.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:26.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:26 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3525901195' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T16:49:26.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:26 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:49:26.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:26 smithi144 ceph-mon[35328]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.815+0000 7f2968c00640 1 -- 172.21.15.18:0/1997521906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2964100f60 msgr2=0x7f29641013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.815+0000 7f2968c00640 1 --2- 172.21.15.18:0/1997521906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2964100f60 0x7f29641013e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2950009900 tx=0x7f295002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.815+0000 7f2968c00640 1 -- 172.21.15.18:0/1997521906 shutdown_connections 2024-09-13T16:49:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.815+0000 7f2968c00640 1 --2- 172.21.15.18:0/1997521906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2964101920 0x7f29641081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.815+0000 7f2968c00640 1 --2- 172.21.15.18:0/1997521906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2964100f60 0x7f29641013e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.815+0000 7f2968c00640 1 --2- 172.21.15.18:0/1997521906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29640ffd70 0x7f2964100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.815+0000 7f2968c00640 1 -- 172.21.15.18:0/1997521906 >> 172.21.15.18:0/1997521906 conn(0x7f29640fb4d0 msgr2=0x7f29640fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.815+0000 7f2968c00640 1 -- 172.21.15.18:0/1997521906 shutdown_connections 2024-09-13T16:49:26.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.815+0000 7f2968c00640 1 -- 172.21.15.18:0/1997521906 wait complete. 2024-09-13T16:49:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.816+0000 7f2968c00640 1 Processor -- start 2024-09-13T16:49:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.816+0000 7f2968c00640 1 -- start start 2024-09-13T16:49:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.816+0000 7f2968c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29640ffd70 0x7f2964195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.816+0000 7f2968c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2964100f60 0x7f29641962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2968c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2964101920 0x7f296419d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2968c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419d890 con 0x7f29640ffd70 2024-09-13T16:49:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2968c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419da00 con 0x7f2964100f60 2024-09-13T16:49:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2968c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419dbc0 con 0x7f2964101920 2024-09-13T16:49:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29640ffd70 0x7f2964195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2964100f60 0x7f29641962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2964100f60 0x7f29641962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:47514/0 (socket says 172.21.15.18:47514) 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961400640 1 -- 172.21.15.18:0/3303693595 learned_addr learned my addr 172.21.15.18:0/3303693595 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29640ffd70 0x7f2964195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47872/0 (socket says 172.21.15.18:47872) 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2962800640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2964101920 0x7f296419d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961400640 1 -- 172.21.15.18:0/3303693595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2964101920 msgr2=0x7f296419d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961400640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2964101920 0x7f296419d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961400640 1 -- 172.21.15.18:0/3303693595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29640ffd70 msgr2=0x7f2964195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961400640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29640ffd70 0x7f2964195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961400640 1 -- 172.21.15.18:0/3303693595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950009560 con 0x7f2964100f60 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961e00640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29640ffd70 0x7f2964195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2962800640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2964101920 0x7f296419d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.817+0000 7f2961400640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2964100f60 0x7f29641962f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2950031500 tx=0x7f2950003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.818+0000 7f295aa00640 1 -- 172.21.15.18:0/3303693595 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950003e00 con 0x7f2964100f60 2024-09-13T16:49:26.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.818+0000 7f295aa00640 1 -- 172.21.15.18:0/3303693595 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2950031c70 con 0x7f2964100f60 2024-09-13T16:49:26.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.818+0000 7f295aa00640 1 -- 172.21.15.18:0/3303693595 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295003bc20 con 0x7f2964100f60 2024-09-13T16:49:26.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.818+0000 7f2968c00640 1 -- 172.21.15.18:0/3303693595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296419de40 con 0x7f2964100f60 2024-09-13T16:49:26.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.818+0000 7f2968c00640 1 -- 172.21.15.18:0/3303693595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296419e1b0 con 0x7f2964100f60 2024-09-13T16:49:26.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.819+0000 7f2968c00640 1 -- 172.21.15.18:0/3303693595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29641072a0 con 0x7f2964100f60 2024-09-13T16:49:26.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.821+0000 7f295aa00640 1 -- 172.21.15.18:0/3303693595 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f29500317b0 con 0x7f2964100f60 2024-09-13T16:49:26.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.822+0000 7f295aa00640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f29480a1110 0x7f29480a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:26.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.822+0000 7f295aa00640 1 -- 172.21.15.18:0/3303693595 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f29500ed220 con 0x7f2964100f60 2024-09-13T16:49:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.823+0000 7f2961e00640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f29480a1110 0x7f29480a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.823+0000 7f2961e00640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f29480a1110 0x7f29480a35d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2964197280 tx=0x7f2954005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:26.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:26.824+0000 7f295aa00640 1 -- 172.21.15.18:0/3303693595 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f29500b6c60 con 0x7f2964100f60 2024-09-13T16:49:26.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:26.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:26.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:26.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:49:26.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:26.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:26 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3525901195' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T16:49:26.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:26 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:49:26.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:26 smithi094 ceph-mon[35259]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:27.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.016+0000 7f2968c00640 1 -- 172.21.15.18:0/3303693595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f296410b680 con 0x7f2964100f60 2024-09-13T16:49:27.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.638+0000 7f295aa00640 1 -- 172.21.15.18:0/3303693595 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) v1 ==== 171+0+0 (secure 0 0 0) 0x7f295003f0d0 con 0x7f2964100f60 2024-09-13T16:49:27.645 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-13T16:49:27.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.646+0000 7f2968c00640 1 -- 172.21.15.18:0/3303693595 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f29480a1110 msgr2=0x7f29480a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:27.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.646+0000 7f2968c00640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f29480a1110 0x7f29480a35d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2964197280 tx=0x7f2954005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:27.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.646+0000 7f2968c00640 1 -- 172.21.15.18:0/3303693595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2964100f60 msgr2=0x7f29641962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:27.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.646+0000 7f2968c00640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2964100f60 0x7f29641962f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2950031500 tx=0x7f2950003c10 comp rx=0 tx=0).stop 2024-09-13T16:49:27.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.647+0000 7f2968c00640 1 -- 172.21.15.18:0/3303693595 shutdown_connections 2024-09-13T16:49:27.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.647+0000 7f2968c00640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2964101920 0x7f296419d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:27.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.647+0000 7f2968c00640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2964100f60 0x7f29641962f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:27.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.647+0000 7f2968c00640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f29480a1110 0x7f29480a35d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:27.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.647+0000 7f2968c00640 1 --2- 172.21.15.18:0/3303693595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29640ffd70 0x7f2964195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:27.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.647+0000 7f2968c00640 1 -- 172.21.15.18:0/3303693595 >> 172.21.15.18:0/3303693595 conn(0x7f29640fb4d0 msgr2=0x7f2964104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.649+0000 7f2968c00640 1 -- 172.21.15.18:0/3303693595 shutdown_connections 2024-09-13T16:49:27.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.649+0000 7f2968c00640 1 -- 172.21.15.18:0/3303693595 wait complete. 2024-09-13T16:49:27.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T16:49:27.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.845+0000 7f516fe00640 1 -- 172.21.15.18:0/2512518848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51700744f0 msgr2=0x7f5170072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:27.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.845+0000 7f516fe00640 1 --2- 172.21.15.18:0/2512518848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51700744f0 0x7f5170072940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5160009900 tx=0x7f516002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:27.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.845+0000 7f516fe00640 1 -- 172.21.15.18:0/2512518848 shutdown_connections 2024-09-13T16:49:27.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.845+0000 7f516fe00640 1 --2- 172.21.15.18:0/2512518848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f517010c2b0 0x7f517010e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:27.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.845+0000 7f516fe00640 1 --2- 172.21.15.18:0/2512518848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5170072f10 0x7f5170073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:27.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.845+0000 7f516fe00640 1 --2- 172.21.15.18:0/2512518848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51700744f0 0x7f5170072940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:27.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.845+0000 7f516fe00640 1 -- 172.21.15.18:0/2512518848 >> 172.21.15.18:0/2512518848 conn(0x7f51700fb440 msgr2=0x7f51700fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:27.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.845+0000 7f516fe00640 1 -- 172.21.15.18:0/2512518848 shutdown_connections 2024-09-13T16:49:27.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.845+0000 7f516fe00640 1 -- 172.21.15.18:0/2512518848 wait complete. 2024-09-13T16:49:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516fe00640 1 Processor -- start 2024-09-13T16:49:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516fe00640 1 -- start start 2024-09-13T16:49:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5170072f10 0x7f517019c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51700744f0 0x7f517019c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f517010c2b0 0x7f51701a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51701a3d90 con 0x7f517010c2b0 2024-09-13T16:49:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516fe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51701a3f00 con 0x7f51700744f0 2024-09-13T16:49:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51701a40c0 con 0x7f5170072f10 2024-09-13T16:49:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5170072f10 0x7f517019c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5170072f10 0x7f517019c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:50512/0 (socket says 172.21.15.18:50512) 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516ea00640 1 -- 172.21.15.18:0/3443398449 learned_addr learned my addr 172.21.15.18:0/3443398449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.846+0000 7f516f400640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f517010c2b0 0x7f51701a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f5167e00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51700744f0 0x7f517019c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f516ea00640 1 -- 172.21.15.18:0/3443398449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51700744f0 msgr2=0x7f517019c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f516ea00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51700744f0 0x7f517019c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f516ea00640 1 -- 172.21.15.18:0/3443398449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f517010c2b0 msgr2=0x7f51701a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f516ea00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f517010c2b0 0x7f51701a3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f516ea00640 1 -- 172.21.15.18:0/3443398449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5160009560 con 0x7f5170072f10 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f516ea00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5170072f10 0x7f517019c2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5160009a20 tx=0x7f5160005620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f5167400640 1 -- 172.21.15.18:0/3443398449 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160004c10 con 0x7f5170072f10 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f5167400640 1 -- 172.21.15.18:0/3443398449 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5160004d70 con 0x7f5170072f10 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f5167400640 1 -- 172.21.15.18:0/3443398449 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160031ae0 con 0x7f5170072f10 2024-09-13T16:49:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.847+0000 7f516fe00640 1 -- 172.21.15.18:0/3443398449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51701a4340 con 0x7f5170072f10 2024-09-13T16:49:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.848+0000 7f516fe00640 1 -- 172.21.15.18:0/3443398449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51701a47a0 con 0x7f5170072f10 2024-09-13T16:49:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.849+0000 7f516fe00640 1 -- 172.21.15.18:0/3443398449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5170101c50 con 0x7f5170072f10 2024-09-13T16:49:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.850+0000 7f5167400640 1 -- 172.21.15.18:0/3443398449 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5160031c40 con 0x7f5170072f10 2024-09-13T16:49:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.852+0000 7f5167400640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51540a1090 0x7f51540a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.852+0000 7f5167400640 1 -- 172.21.15.18:0/3443398449 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f51600ed6c0 con 0x7f5170072f10 2024-09-13T16:49:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.852+0000 7f5167e00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51540a1090 0x7f51540a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:27.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.853+0000 7f5167e00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51540a1090 0x7f51540a3550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f517019d7b0 tx=0x7f5158005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:27.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:27.854+0000 7f5167400640 1 -- 172.21.15.18:0/3443398449 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f51600b7010 con 0x7f5170072f10 2024-09-13T16:49:27.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:27 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1847881116' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T16:49:27.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:27 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1847881116' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T16:49:27.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:27 smithi094 ceph-mon[35259]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T16:49:27.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:27 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:27.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:27 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1847881116' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T16:49:27.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:27 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1847881116' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T16:49:27.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:27 smithi018 ceph-mon[30981]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T16:49:27.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:27 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:27 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1847881116' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T16:49:28.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:27 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1847881116' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T16:49:28.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:27 smithi144 ceph-mon[35328]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T16:49:28.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:27 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.078+0000 7f516fe00640 1 -- 172.21.15.18:0/3443398449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5170111bd0 con 0x7f5170072f10 2024-09-13T16:49:28.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.087+0000 7f5167400640 1 -- 172.21.15.18:0/3443398449 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f51600ba630 con 0x7f5170072f10 2024-09-13T16:49:28.091 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T16:49:28.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.092+0000 7f516fe00640 1 -- 172.21.15.18:0/3443398449 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51540a1090 msgr2=0x7f51540a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:28.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.092+0000 7f516fe00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51540a1090 0x7f51540a3550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f517019d7b0 tx=0x7f5158005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:28.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.092+0000 7f516fe00640 1 -- 172.21.15.18:0/3443398449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5170072f10 msgr2=0x7f517019c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:28.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.092+0000 7f516fe00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5170072f10 0x7f517019c2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5160009a20 tx=0x7f5160005620 comp rx=0 tx=0).stop 2024-09-13T16:49:28.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.093+0000 7f516fe00640 1 -- 172.21.15.18:0/3443398449 shutdown_connections 2024-09-13T16:49:28.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.093+0000 7f516fe00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51540a1090 0x7f51540a3550 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:28.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.093+0000 7f516fe00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f517010c2b0 0x7f51701a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:28.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.093+0000 7f516fe00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51700744f0 0x7f517019c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:28.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.093+0000 7f516fe00640 1 --2- 172.21.15.18:0/3443398449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5170072f10 0x7f517019c2a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:28.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.093+0000 7f516fe00640 1 -- 172.21.15.18:0/3443398449 >> 172.21.15.18:0/3443398449 conn(0x7f51700fb440 msgr2=0x7f51700fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:28.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.094+0000 7f516fe00640 1 -- 172.21.15.18:0/3443398449 shutdown_connections 2024-09-13T16:49:28.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.094+0000 7f516fe00640 1 -- 172.21.15.18:0/3443398449 wait complete. 2024-09-13T16:49:28.124 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T16:49:28.124 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T16:49:28.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.285+0000 7f74fb000640 1 -- 172.21.15.18:0/4119031490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74f4103b30 msgr2=0x7f74f410a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:28.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.285+0000 7f74fb000640 1 --2- 172.21.15.18:0/4119031490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74f4103b30 0x7f74f410a3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009ca0 tx=0x7f74ec02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:49:28.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.285+0000 7f74fb000640 1 -- 172.21.15.18:0/4119031490 shutdown_connections 2024-09-13T16:49:28.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.285+0000 7f74fb000640 1 --2- 172.21.15.18:0/4119031490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74f4103b30 0x7f74f410a3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:28.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.285+0000 7f74fb000640 1 --2- 172.21.15.18:0/4119031490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f4103170 0x7f74f41035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:28.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.285+0000 7f74fb000640 1 --2- 172.21.15.18:0/4119031490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74f4101f80 0x7f74f4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:28.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.285+0000 7f74fb000640 1 -- 172.21.15.18:0/4119031490 >> 172.21.15.18:0/4119031490 conn(0x7f74f40fd700 msgr2=0x7f74f40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:28.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.285+0000 7f74fb000640 1 -- 172.21.15.18:0/4119031490 shutdown_connections 2024-09-13T16:49:28.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.285+0000 7f74fb000640 1 -- 172.21.15.18:0/4119031490 wait complete. 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74fb000640 1 Processor -- start 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74fb000640 1 -- start start 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74fb000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74f4101f80 0x7f74f4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74fb000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74f4103170 0x7f74f4198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74fb000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f4103b30 0x7f74f419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74fb000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f419f9b0 con 0x7f74f4101f80 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74fb000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f419fb20 con 0x7f74f4103170 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74fb000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f419fce0 con 0x7f74f4103b30 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74f4101f80 0x7f74f4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74f4101f80 0x7f74f4197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47892/0 (socket says 172.21.15.18:47892) 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.286+0000 7f74f3e00640 1 -- 172.21.15.18:0/2240367971 learned_addr learned my addr 172.21.15.18:0/2240367971 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.287+0000 7f74f9000640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f4103b30 0x7f74f419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:28.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.287+0000 7f74ebe00640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74f4103170 0x7f74f4198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:28.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.287+0000 7f74f3e00640 1 -- 172.21.15.18:0/2240367971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f4103b30 msgr2=0x7f74f419f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:28.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.287+0000 7f74f3e00640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f4103b30 0x7f74f419f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:28.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.287+0000 7f74f3e00640 1 -- 172.21.15.18:0/2240367971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74f4103170 msgr2=0x7f74f4198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:28.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.287+0000 7f74f3e00640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74f4103170 0x7f74f4198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:28.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.287+0000 7f74f3e00640 1 -- 172.21.15.18:0/2240367971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4009490 con 0x7f74f4101f80 2024-09-13T16:49:28.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.287+0000 7f74f3e00640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74f4101f80 0x7f74f4197ec0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74e400e9c0 tx=0x7f74e400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:28.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.287+0000 7f74f1600640 1 -- 172.21.15.18:0/2240367971 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400cde0 con 0x7f74f4101f80 2024-09-13T16:49:28.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.288+0000 7f74fb000640 1 -- 172.21.15.18:0/2240367971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec009900 con 0x7f74f4101f80 2024-09-13T16:49:28.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.288+0000 7f74f1600640 1 -- 172.21.15.18:0/2240367971 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74e40108f0 con 0x7f74f4101f80 2024-09-13T16:49:28.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.288+0000 7f74f1600640 1 -- 172.21.15.18:0/2240367971 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4004a00 con 0x7f74f4101f80 2024-09-13T16:49:28.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.288+0000 7f74fb000640 1 -- 172.21.15.18:0/2240367971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f41a0250 con 0x7f74f4101f80 2024-09-13T16:49:28.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.289+0000 7f74fb000640 1 -- 172.21.15.18:0/2240367971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f4102380 con 0x7f74f4101f80 2024-09-13T16:49:28.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.291+0000 7f74f1600640 1 -- 172.21.15.18:0/2240367971 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f74e4010a60 con 0x7f74f4101f80 2024-09-13T16:49:28.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.292+0000 7f74f1600640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f74d80a1090 0x7f74d80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:28.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.292+0000 7f74f1600640 1 -- 172.21.15.18:0/2240367971 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f74e4014070 con 0x7f74f4101f80 2024-09-13T16:49:28.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.293+0000 7f74ebe00640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f74d80a1090 0x7f74d80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:28.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.293+0000 7f74ebe00640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f74d80a1090 0x7f74d80a3550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f74f41993d0 tx=0x7f74dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:28.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.295+0000 7f74f1600640 1 -- 172.21.15.18:0/2240367971 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f74e4096e20 con 0x7f74f4101f80 2024-09-13T16:49:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:28.483+0000 7f74fb000640 1 -- 172.21.15.18:0/2240367971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f74f41093c0 con 0x7f74f4101f80 2024-09-13T16:49:28.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3303693595' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:49:28.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:49:28.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T16:49:28.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T16:49:28.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: pgmap v291: 97 pgs: 4 creating+peering, 1 active+clean, 92 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3443398449' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T16:49:28.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:28 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2240367971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T16:49:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3303693595' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:49:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:49:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T16:49:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T16:49:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: pgmap v291: 97 pgs: 4 creating+peering, 1 active+clean, 92 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3443398449' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T16:49:28.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T16:49:28.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:28 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2240367971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T16:49:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3303693595' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:49:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T16:49:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T16:49:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T16:49:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:29.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: pgmap v291: 97 pgs: 4 creating+peering, 1 active+clean, 92 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3443398449' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T16:49:29.023 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:28 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2240367971' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T16:49:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.086+0000 7f74f1600640 1 -- 172.21.15.18:0/2240367971 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) v1 ==== 157+0+0 (secure 0 0 0) 0x7f74e409a440 con 0x7f74f4101f80 2024-09-13T16:49:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 -- 172.21.15.18:0/2240367971 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f74d80a1090 msgr2=0x7f74d80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f74d80a1090 0x7f74d80a3550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f74f41993d0 tx=0x7f74dc005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 -- 172.21.15.18:0/2240367971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74f4101f80 msgr2=0x7f74f4197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74f4101f80 0x7f74f4197ec0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74e400e9c0 tx=0x7f74e400ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 -- 172.21.15.18:0/2240367971 shutdown_connections 2024-09-13T16:49:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f4103b30 0x7f74f419f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74f4103170 0x7f74f4198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f74d80a1090 0x7f74d80a3550 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 --2- 172.21.15.18:0/2240367971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74f4101f80 0x7f74f4197ec0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 -- 172.21.15.18:0/2240367971 >> 172.21.15.18:0/2240367971 conn(0x7f74f40fd700 msgr2=0x7f74f4106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 -- 172.21.15.18:0/2240367971 shutdown_connections 2024-09-13T16:49:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.089+0000 7f74fb000640 1 -- 172.21.15.18:0/2240367971 wait complete. 2024-09-13T16:49:29.109 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T16:49:29.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.273+0000 7f2d2c600640 1 -- 172.21.15.18:0/794534920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d240ffda0 msgr2=0x7f2d241001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:29.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.273+0000 7f2d2c600640 1 --2- 172.21.15.18:0/794534920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d240ffda0 0x7f2d241001a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009900 tx=0x7f2d1802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:29.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.273+0000 7f2d2c600640 1 -- 172.21.15.18:0/794534920 shutdown_connections 2024-09-13T16:49:29.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.273+0000 7f2d2c600640 1 --2- 172.21.15.18:0/794534920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d24101950 0x7f2d241081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:29.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.273+0000 7f2d2c600640 1 --2- 172.21.15.18:0/794534920 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d24100f90 0x7f2d24101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:29.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.273+0000 7f2d2c600640 1 --2- 172.21.15.18:0/794534920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d240ffda0 0x7f2d241001a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:29.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.273+0000 7f2d2c600640 1 -- 172.21.15.18:0/794534920 >> 172.21.15.18:0/794534920 conn(0x7f2d240fb520 msgr2=0x7f2d240fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:29.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.273+0000 7f2d2c600640 1 -- 172.21.15.18:0/794534920 shutdown_connections 2024-09-13T16:49:29.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.273+0000 7f2d2c600640 1 -- 172.21.15.18:0/794534920 wait complete. 2024-09-13T16:49:29.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.274+0000 7f2d2c600640 1 Processor -- start 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.274+0000 7f2d2c600640 1 -- start start 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2c600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d240ffda0 0x7f2d24197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d24100f90 0x7f2d24198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2c600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d24101950 0x7f2d2419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2c600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2419fac0 con 0x7f2d24101950 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2c600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2419fc30 con 0x7f2d240ffda0 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2419fdf0 con 0x7f2d24100f90 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d24101950 0x7f2d2419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d29200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d24100f90 0x7f2d24198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d24101950 0x7f2d2419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47908/0 (socket says 172.21.15.18:47908) 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2a600640 1 -- 172.21.15.18:0/1477840306 learned_addr learned my addr 172.21.15.18:0/1477840306 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d29c00640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d240ffda0 0x7f2d24197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2a600640 1 -- 172.21.15.18:0/1477840306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d24100f90 msgr2=0x7f2d24198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2a600640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d24100f90 0x7f2d24198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2a600640 1 -- 172.21.15.18:0/1477840306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d240ffda0 msgr2=0x7f2d24197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2a600640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d240ffda0 0x7f2d24197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.275+0000 7f2d2a600640 1 -- 172.21.15.18:0/1477840306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d18009560 con 0x7f2d24101950 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.276+0000 7f2d2a600640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d24101950 0x7f2d2419f580 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00eb10 tx=0x7f2d1c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.276+0000 7f2d22000640 1 -- 172.21.15.18:0/1477840306 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c004b20 con 0x7f2d24101950 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.276+0000 7f2d22000640 1 -- 172.21.15.18:0/1477840306 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d1c004c80 con 0x7f2d24101950 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.276+0000 7f2d22000640 1 -- 172.21.15.18:0/1477840306 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c010690 con 0x7f2d24101950 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.276+0000 7f2d2c600640 1 -- 172.21.15.18:0/1477840306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d241a00d0 con 0x7f2d24101950 2024-09-13T16:49:29.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.276+0000 7f2d2c600640 1 -- 172.21.15.18:0/1477840306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d241a0590 con 0x7f2d24101950 2024-09-13T16:49:29.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.277+0000 7f2d2c600640 1 -- 172.21.15.18:0/1477840306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2410b660 con 0x7f2d24101950 2024-09-13T16:49:29.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.279+0000 7f2d22000640 1 -- 172.21.15.18:0/1477840306 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2d1c004fd0 con 0x7f2d24101950 2024-09-13T16:49:29.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.280+0000 7f2d22000640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2d0c0a1110 0x7f2d0c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:29.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.280+0000 7f2d22000640 1 -- 172.21.15.18:0/1477840306 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8205+0+0 (secure 0 0 0) 0x7f2d1c014070 con 0x7f2d24101950 2024-09-13T16:49:29.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.280+0000 7f2d29c00640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2d0c0a1110 0x7f2d0c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:29.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.281+0000 7f2d29c00640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2d0c0a1110 0x7f2d0c0a35d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005ab0 tx=0x7f2d180314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:29.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.282+0000 7f2d22000640 1 -- 172.21.15.18:0/1477840306 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2d1c096770 con 0x7f2d24101950 2024-09-13T16:49:29.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:29.463+0000 7f2d2c600640 1 -- 172.21.15.18:0/1477840306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2d2410b840 con 0x7f2d24101950 2024-09-13T16:49:29.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:29 smithi094 ceph-mon[35259]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T16:49:29.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:29 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2240367971' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T16:49:29.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:29 smithi094 ceph-mon[35259]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T16:49:29.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:29 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] up:active 2024-09-13T16:49:29.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:29 smithi094 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:29.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:29 smithi094 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:29.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:29 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1477840306' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T16:49:29.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:29 smithi018 ceph-mon[30981]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T16:49:29.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:29 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2240367971' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T16:49:29.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:29 smithi018 ceph-mon[30981]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T16:49:29.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:29 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] up:active 2024-09-13T16:49:29.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:29 smithi018 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:29.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:29 smithi018 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:29.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:29 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1477840306' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T16:49:30.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:29 smithi144 ceph-mon[35328]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T16:49:30.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:29 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2240367971' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T16:49:30.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:29 smithi144 ceph-mon[35328]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T16:49:30.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:29 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] up:active 2024-09-13T16:49:30.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:29 smithi144 ceph-mon[35328]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:30.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:29 smithi144 ceph-mon[35328]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:30.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:29 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1477840306' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T16:49:31.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.100+0000 7f2d22000640 1 -- 172.21.15.18:0/1477840306 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) v1 ==== 228+0+0 (secure 0 0 0) 0x7f2d1c099d90 con 0x7f2d24101950 2024-09-13T16:49:31.102 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' created 2024-09-13T16:49:31.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.107+0000 7f2d2c600640 1 -- 172.21.15.18:0/1477840306 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2d0c0a1110 msgr2=0x7f2d0c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:31.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.107+0000 7f2d2c600640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2d0c0a1110 0x7f2d0c0a35d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005ab0 tx=0x7f2d180314a0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.107+0000 7f2d2c600640 1 -- 172.21.15.18:0/1477840306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d24101950 msgr2=0x7f2d2419f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:31.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.107+0000 7f2d2c600640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d24101950 0x7f2d2419f580 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00eb10 tx=0x7f2d1c00c2d0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.107+0000 7f2d2c600640 1 -- 172.21.15.18:0/1477840306 shutdown_connections 2024-09-13T16:49:31.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.107+0000 7f2d2c600640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2d0c0a1110 0x7f2d0c0a35d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.107+0000 7f2d2c600640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d24101950 0x7f2d2419f580 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.107+0000 7f2d2c600640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d24100f90 0x7f2d24198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.107+0000 7f2d2c600640 1 --2- 172.21.15.18:0/1477840306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d240ffda0 0x7f2d24197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.107+0000 7f2d2c600640 1 -- 172.21.15.18:0/1477840306 >> 172.21.15.18:0/1477840306 conn(0x7f2d240fb520 msgr2=0x7f2d241067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:31.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.108+0000 7f2d2c600640 1 -- 172.21.15.18:0/1477840306 shutdown_connections 2024-09-13T16:49:31.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.108+0000 7f2d2c600640 1 -- 172.21.15.18:0/1477840306 wait complete. 2024-09-13T16:49:31.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:30 smithi018 ceph-mon[30981]: pgmap v294: 97 pgs: 15 creating+peering, 41 active+clean, 41 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-13T16:49:31.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:30 smithi018 ceph-mon[30981]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T16:49:31.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:30 smithi018 ceph-mon[30981]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-13T16:49:31.129 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:30 smithi018 ceph-mon[30981]: Cluster is now healthy 2024-09-13T16:49:31.131 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T16:49:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:30 smithi094 ceph-mon[35259]: pgmap v294: 97 pgs: 15 creating+peering, 41 active+clean, 41 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-13T16:49:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:30 smithi094 ceph-mon[35259]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T16:49:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:30 smithi094 ceph-mon[35259]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-13T16:49:31.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:30 smithi094 ceph-mon[35259]: Cluster is now healthy 2024-09-13T16:49:31.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:30 smithi144 ceph-mon[35328]: pgmap v294: 97 pgs: 15 creating+peering, 41 active+clean, 41 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-13T16:49:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:30 smithi144 ceph-mon[35328]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T16:49:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:30 smithi144 ceph-mon[35328]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-13T16:49:31.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:30 smithi144 ceph-mon[35328]: Cluster is now healthy 2024-09-13T16:49:31.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.293+0000 7fb05d600640 1 -- 172.21.15.18:0/2711718197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb058103080 msgr2=0x7fb058103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:31.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.293+0000 7fb05d600640 1 --2- 172.21.15.18:0/2711718197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb058103080 0x7fb058103500 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb040009900 tx=0x7fb04002a410 comp rx=0 tx=0).stop 2024-09-13T16:49:31.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.293+0000 7fb05d600640 1 -- 172.21.15.18:0/2711718197 shutdown_connections 2024-09-13T16:49:31.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.293+0000 7fb05d600640 1 --2- 172.21.15.18:0/2711718197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb058103080 0x7fb058103500 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.293+0000 7fb05d600640 1 --2- 172.21.15.18:0/2711718197 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb058103a40 0x7fb05810a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.293+0000 7fb05d600640 1 --2- 172.21.15.18:0/2711718197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb058101ea0 0x7fb0581022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.293+0000 7fb05d600640 1 -- 172.21.15.18:0/2711718197 >> 172.21.15.18:0/2711718197 conn(0x7fb0580fd670 msgr2=0x7fb0580ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:31.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.293+0000 7fb05d600640 1 -- 172.21.15.18:0/2711718197 shutdown_connections 2024-09-13T16:49:31.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.293+0000 7fb05d600640 1 -- 172.21.15.18:0/2711718197 wait complete. 2024-09-13T16:49:31.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05d600640 1 Processor -- start 2024-09-13T16:49:31.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05d600640 1 -- start start 2024-09-13T16:49:31.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb058101ea0 0x7fb058197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:31.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05d600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb058103080 0x7fb0581983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:31.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb058103a40 0x7fb05819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:31.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05819f9a0 con 0x7fb058103a40 2024-09-13T16:49:31.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05d600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05819fb10 con 0x7fb058103080 2024-09-13T16:49:31.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05819fcd0 con 0x7fb058101ea0 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb058103a40 0x7fb05819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb058103a40 0x7fb05819f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36346/0 (socket says 172.21.15.18:36346) 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb05cc00640 1 -- 172.21.15.18:0/1935907138 learned_addr learned my addr 172.21.15.18:0/1935907138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb057e00640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb058101ea0 0x7fb058197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.294+0000 7fb04f400640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb058103080 0x7fb0581983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.295+0000 7fb05cc00640 1 -- 172.21.15.18:0/1935907138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb058101ea0 msgr2=0x7fb058197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.295+0000 7fb05cc00640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb058101ea0 0x7fb058197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.295+0000 7fb05cc00640 1 -- 172.21.15.18:0/1935907138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb058103080 msgr2=0x7fb0581983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.295+0000 7fb05cc00640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb058103080 0x7fb0581983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.295+0000 7fb05cc00640 1 -- 172.21.15.18:0/1935907138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040009560 con 0x7fb058103a40 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.295+0000 7fb05cc00640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb058103a40 0x7fb05819f460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb05000eb10 tx=0x7fb05000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.295+0000 7fb055600640 1 -- 172.21.15.18:0/1935907138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050004b20 con 0x7fb058103a40 2024-09-13T16:49:31.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.295+0000 7fb055600640 1 -- 172.21.15.18:0/1935907138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb050004c80 con 0x7fb058103a40 2024-09-13T16:49:31.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.295+0000 7fb05d600640 1 -- 172.21.15.18:0/1935907138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05819ffb0 con 0x7fb058103a40 2024-09-13T16:49:31.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.295+0000 7fb055600640 1 -- 172.21.15.18:0/1935907138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050010690 con 0x7fb058103a40 2024-09-13T16:49:31.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.296+0000 7fb05d600640 1 -- 172.21.15.18:0/1935907138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0581a03e0 con 0x7fb058103a40 2024-09-13T16:49:31.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.297+0000 7fb05d600640 1 -- 172.21.15.18:0/1935907138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0581093d0 con 0x7fb058103a40 2024-09-13T16:49:31.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.299+0000 7fb055600640 1 -- 172.21.15.18:0/1935907138 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb050004fd0 con 0x7fb058103a40 2024-09-13T16:49:31.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.300+0000 7fb055600640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb03c0a1090 0x7fb03c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:31.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.300+0000 7fb055600640 1 -- 172.21.15.18:0/1935907138 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8698+0+0 (secure 0 0 0) 0x7fb050014070 con 0x7fb058103a40 2024-09-13T16:49:31.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.300+0000 7fb057e00640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb03c0a1090 0x7fb03c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:31.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.301+0000 7fb057e00640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb03c0a1090 0x7fb03c0a3550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb058102bf0 tx=0x7fb048005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.302+0000 7fb055600640 1 -- 172.21.15.18:0/1935907138 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb0500967d0 con 0x7fb058103a40 2024-09-13T16:49:31.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:31.483+0000 7fb05d600640 1 -- 172.21.15.18:0/1935907138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fb05810d7d0 con 0x7fb058103a40 2024-09-13T16:49:32.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.107+0000 7fb055600640 1 -- 172.21.15.18:0/1935907138 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb050099df0 con 0x7fb058103a40 2024-09-13T16:49:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T16:49:32.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.114+0000 7fb05d600640 1 -- 172.21.15.18:0/1935907138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb03c0a1090 msgr2=0x7fb03c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.114+0000 7fb05d600640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb03c0a1090 0x7fb03c0a3550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb058102bf0 tx=0x7fb048005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.114+0000 7fb05d600640 1 -- 172.21.15.18:0/1935907138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb058103a40 msgr2=0x7fb05819f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.114+0000 7fb05d600640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb058103a40 0x7fb05819f460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb05000eb10 tx=0x7fb05000c2d0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.114+0000 7fb05d600640 1 -- 172.21.15.18:0/1935907138 shutdown_connections 2024-09-13T16:49:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.114+0000 7fb05d600640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb03c0a1090 0x7fb03c0a3550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.115+0000 7fb05d600640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb058103a40 0x7fb05819f460 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.115+0000 7fb05d600640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb058103080 0x7fb0581983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.115+0000 7fb05d600640 1 --2- 172.21.15.18:0/1935907138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb058101ea0 0x7fb058197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.115+0000 7fb05d600640 1 -- 172.21.15.18:0/1935907138 >> 172.21.15.18:0/1935907138 conn(0x7fb0580fd670 msgr2=0x7fb0581065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.117+0000 7fb05d600640 1 -- 172.21.15.18:0/1935907138 shutdown_connections 2024-09-13T16:49:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.117+0000 7fb05d600640 1 -- 172.21.15.18:0/1935907138 wait complete. 2024-09-13T16:49:32.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T16:49:32.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.304+0000 7f0b9ec00640 1 -- 172.21.15.18:0/360757390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b980744f0 msgr2=0x7f0b98072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.304+0000 7f0b9ec00640 1 --2- 172.21.15.18:0/360757390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b980744f0 0x7f0b98072940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009900 tx=0x7f0b8802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.304+0000 7f0b9ec00640 1 -- 172.21.15.18:0/360757390 shutdown_connections 2024-09-13T16:49:32.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.304+0000 7f0b9ec00640 1 --2- 172.21.15.18:0/360757390 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9810c340 0x7f0b9810e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.304+0000 7f0b9ec00640 1 --2- 172.21.15.18:0/360757390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b98072f10 0x7f0b98073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.304+0000 7f0b9ec00640 1 --2- 172.21.15.18:0/360757390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b980744f0 0x7f0b98072940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.304+0000 7f0b9ec00640 1 -- 172.21.15.18:0/360757390 >> 172.21.15.18:0/360757390 conn(0x7f0b980fb4d0 msgr2=0x7f0b980fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:32.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.304+0000 7f0b9ec00640 1 -- 172.21.15.18:0/360757390 shutdown_connections 2024-09-13T16:49:32.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.304+0000 7f0b9ec00640 1 -- 172.21.15.18:0/360757390 wait complete. 2024-09-13T16:49:32.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.305+0000 7f0b9ec00640 1 Processor -- start 2024-09-13T16:49:32.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.305+0000 7f0b9ec00640 1 -- start start 2024-09-13T16:49:32.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.305+0000 7f0b9ec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98072f10 0x7f0b9819c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:32.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.305+0000 7f0b9ec00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b980744f0 0x7f0b9819c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.305+0000 7f0b9ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9810c340 0x7f0b981a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b9ec00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b981a3ed0 con 0x7f0b98072f10 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b9ec00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b981a4040 con 0x7f0b980744f0 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b9ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b981a4200 con 0x7f0b9810c340 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b97e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98072f10 0x7f0b9819c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b97e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98072f10 0x7f0b9819c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36366/0 (socket says 172.21.15.18:36366) 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b97e00640 1 -- 172.21.15.18:0/749763941 learned_addr learned my addr 172.21.15.18:0/749763941 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b97400640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b980744f0 0x7f0b9819c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b9cc00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9810c340 0x7f0b981a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b97e00640 1 -- 172.21.15.18:0/749763941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9810c340 msgr2=0x7f0b981a3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b97e00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9810c340 0x7f0b981a3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b97e00640 1 -- 172.21.15.18:0/749763941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b980744f0 msgr2=0x7f0b9819c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b97e00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b980744f0 0x7f0b9819c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b97e00640 1 -- 172.21.15.18:0/749763941 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90009840 con 0x7f0b98072f10 2024-09-13T16:49:32.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.306+0000 7f0b97e00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98072f10 0x7f0b9819c3e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b88031500 tx=0x7f0b88003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:32.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.307+0000 7f0b94c00640 1 -- 172.21.15.18:0/749763941 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88005d50 con 0x7f0b98072f10 2024-09-13T16:49:32.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.307+0000 7f0b94c00640 1 -- 172.21.15.18:0/749763941 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b88003e00 con 0x7f0b98072f10 2024-09-13T16:49:32.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.307+0000 7f0b94c00640 1 -- 172.21.15.18:0/749763941 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8803bb50 con 0x7f0b98072f10 2024-09-13T16:49:32.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.307+0000 7f0b9ec00640 1 -- 172.21.15.18:0/749763941 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b88009560 con 0x7f0b98072f10 2024-09-13T16:49:32.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.307+0000 7f0b9ec00640 1 -- 172.21.15.18:0/749763941 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b981a47a0 con 0x7f0b98072f10 2024-09-13T16:49:32.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.308+0000 7f0b9ec00640 1 -- 172.21.15.18:0/749763941 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b98111cb0 con 0x7f0b98072f10 2024-09-13T16:49:32.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.310+0000 7f0b94c00640 1 -- 172.21.15.18:0/749763941 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0b8803bcb0 con 0x7f0b98072f10 2024-09-13T16:49:32.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.312+0000 7f0b94c00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b7c0a1110 0x7f0b7c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:32.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.312+0000 7f0b94c00640 1 -- 172.21.15.18:0/749763941 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f0b880ed380 con 0x7f0b98072f10 2024-09-13T16:49:32.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.312+0000 7f0b97400640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b7c0a1110 0x7f0b7c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:32.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.313+0000 7f0b97400640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b7c0a1110 0x7f0b7c0a35d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b9819d8f0 tx=0x7f0b84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:32.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.316+0000 7f0b94c00640 1 -- 172.21.15.18:0/749763941 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0b880b68e0 con 0x7f0b98072f10 2024-09-13T16:49:32.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:32 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1477840306' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T16:49:32.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:32 smithi094 ceph-mon[35259]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T16:49:32.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:32 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1935907138' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T16:49:32.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:32 smithi094 ceph-mon[35259]: pgmap v297: 129 pgs: 22 creating+peering, 68 active+clean, 39 unknown; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 8 op/s 2024-09-13T16:49:32.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:32 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1477840306' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T16:49:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:32 smithi018 ceph-mon[30981]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T16:49:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:32 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1935907138' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T16:49:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:32 smithi018 ceph-mon[30981]: pgmap v297: 129 pgs: 22 creating+peering, 68 active+clean, 39 unknown; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 8 op/s 2024-09-13T16:49:32.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:32 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1477840306' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T16:49:32.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:32 smithi144 ceph-mon[35328]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T16:49:32.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:32 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1935907138' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T16:49:32.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:32 smithi144 ceph-mon[35328]: pgmap v297: 129 pgs: 22 creating+peering, 68 active+clean, 39 unknown; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 8 op/s 2024-09-13T16:49:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.539+0000 7f0b9ec00640 1 -- 172.21.15.18:0/749763941 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f0b98111e90 con 0x7f0b98072f10 2024-09-13T16:49:32.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.545+0000 7f0b94c00640 1 -- 172.21.15.18:0/749763941 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0b880b9f00 con 0x7f0b98072f10 2024-09-13T16:49:32.546 INFO:teuthology.orchestra.run.smithi018.stderr:added data pool 4 to fsmap 2024-09-13T16:49:32.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 -- 172.21.15.18:0/749763941 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b7c0a1110 msgr2=0x7f0b7c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b7c0a1110 0x7f0b7c0a35d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b9819d8f0 tx=0x7f0b84005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:32.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 -- 172.21.15.18:0/749763941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98072f10 msgr2=0x7f0b9819c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98072f10 0x7f0b9819c3e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b88031500 tx=0x7f0b88003c10 comp rx=0 tx=0).stop 2024-09-13T16:49:32.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 -- 172.21.15.18:0/749763941 shutdown_connections 2024-09-13T16:49:32.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9810c340 0x7f0b981a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b980744f0 0x7f0b9819c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b7c0a1110 0x7f0b7c0a35d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 --2- 172.21.15.18:0/749763941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98072f10 0x7f0b9819c3e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 -- 172.21.15.18:0/749763941 >> 172.21.15.18:0/749763941 conn(0x7f0b980fb4d0 msgr2=0x7f0b980fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:32.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 -- 172.21.15.18:0/749763941 shutdown_connections 2024-09-13T16:49:32.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.547+0000 7f0b9ec00640 1 -- 172.21.15.18:0/749763941 wait complete. 2024-09-13T16:49:32.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:32.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.721+0000 7f9484400640 1 -- 172.21.15.18:0/1210063683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f947c103190 msgr2=0x7f947c103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.721+0000 7f9484400640 1 --2- 172.21.15.18:0/1210063683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f947c103190 0x7f947c103610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9468009900 tx=0x7f946802a410 comp rx=0 tx=0).stop 2024-09-13T16:49:32.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.721+0000 7f9484400640 1 -- 172.21.15.18:0/1210063683 shutdown_connections 2024-09-13T16:49:32.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.721+0000 7f9484400640 1 --2- 172.21.15.18:0/1210063683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f947c103190 0x7f947c103610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.721+0000 7f9484400640 1 --2- 172.21.15.18:0/1210063683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c103b50 0x7f947c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.721+0000 7f9484400640 1 --2- 172.21.15.18:0/1210063683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f947c101fa0 0x7f947c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.721+0000 7f9484400640 1 -- 172.21.15.18:0/1210063683 >> 172.21.15.18:0/1210063683 conn(0x7f947c0fd700 msgr2=0x7f947c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:32.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.721+0000 7f9484400640 1 -- 172.21.15.18:0/1210063683 shutdown_connections 2024-09-13T16:49:32.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.721+0000 7f9484400640 1 -- 172.21.15.18:0/1210063683 wait complete. 2024-09-13T16:49:32.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.722+0000 7f9484400640 1 Processor -- start 2024-09-13T16:49:32.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.722+0000 7f9484400640 1 -- start start 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.722+0000 7f9484400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f947c101fa0 0x7f947c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.722+0000 7f9484400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f947c103190 0x7f947c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.722+0000 7f9484400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c103b50 0x7f947c19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.722+0000 7f9484400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c19fa80 con 0x7f947c101fa0 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.722+0000 7f9484400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c19fbf0 con 0x7f947c103b50 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.722+0000 7f9484400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c19fdb0 con 0x7f947c103190 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.722+0000 7f9481a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f947c101fa0 0x7f947c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9481a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f947c101fa0 0x7f947c197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36376/0 (socket says 172.21.15.18:36376) 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9481a00640 1 -- 172.21.15.18:0/4087086534 learned_addr learned my addr 172.21.15.18:0/4087086534 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9481000640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f947c103190 0x7f947c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9482400640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c103b50 0x7f947c19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9481a00640 1 -- 172.21.15.18:0/4087086534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f947c103190 msgr2=0x7f947c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9481a00640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f947c103190 0x7f947c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9481a00640 1 -- 172.21.15.18:0/4087086534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c103b50 msgr2=0x7f947c19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9481a00640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c103b50 0x7f947c19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9481a00640 1 -- 172.21.15.18:0/4087086534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9468009560 con 0x7f947c101fa0 2024-09-13T16:49:32.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9481a00640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f947c101fa0 0x7f947c197f90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f947000e9c0 tx=0x7f947000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:32.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f947a000640 1 -- 172.21.15.18:0/4087086534 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94700096e0 con 0x7f947c101fa0 2024-09-13T16:49:32.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f947a000640 1 -- 172.21.15.18:0/4087086534 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94700044f0 con 0x7f947c101fa0 2024-09-13T16:49:32.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9484400640 1 -- 172.21.15.18:0/4087086534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c1a0090 con 0x7f947c101fa0 2024-09-13T16:49:32.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f947a000640 1 -- 172.21.15.18:0/4087086534 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470010430 con 0x7f947c101fa0 2024-09-13T16:49:32.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.723+0000 7f9484400640 1 -- 172.21.15.18:0/4087086534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c1a0570 con 0x7f947c101fa0 2024-09-13T16:49:32.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.724+0000 7f9484400640 1 -- 172.21.15.18:0/4087086534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c109420 con 0x7f947c101fa0 2024-09-13T16:49:32.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.726+0000 7f947a000640 1 -- 172.21.15.18:0/4087086534 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f94700035f0 con 0x7f947c101fa0 2024-09-13T16:49:32.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.728+0000 7f947a000640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94640a1110 0x7f94640a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:32.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.728+0000 7f947a000640 1 -- 172.21.15.18:0/4087086534 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9470014070 con 0x7f947c101fa0 2024-09-13T16:49:32.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.728+0000 7f9481000640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94640a1110 0x7f94640a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:32.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.728+0000 7f9481000640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94640a1110 0x7f94640a35d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9468005ab0 tx=0x7f9468005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:32.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.731+0000 7f947a000640 1 -- 172.21.15.18:0/4087086534 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9470096460 con 0x7f947c101fa0 2024-09-13T16:49:32.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.946+0000 7f9484400640 1 -- 172.21.15.18:0/4087086534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f947c10d8b0 con 0x7f947c101fa0 2024-09-13T16:49:32.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.947+0000 7f947a000640 1 -- 172.21.15.18:0/4087086534 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10792 (secure 0 0 0) 0x7f9470099a80 con 0x7f947c101fa0 2024-09-13T16:49:32.948 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:32.948 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24566,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:49:28.080578+0000","modified":"2024-09-13T16:49:32.540505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T16:49:32.949 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 17 2024-09-13T16:49:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 -- 172.21.15.18:0/4087086534 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94640a1110 msgr2=0x7f94640a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94640a1110 0x7f94640a35d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9468005ab0 tx=0x7f9468005780 comp rx=0 tx=0).stop 2024-09-13T16:49:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 -- 172.21.15.18:0/4087086534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f947c101fa0 msgr2=0x7f947c197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f947c101fa0 0x7f947c197f90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f947000e9c0 tx=0x7f947000ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 -- 172.21.15.18:0/4087086534 shutdown_connections 2024-09-13T16:49:32.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f947c103b50 0x7f947c19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f947c103190 0x7f947c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94640a1110 0x7f94640a35d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 --2- 172.21.15.18:0/4087086534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f947c101fa0 0x7f947c197f90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:32.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 -- 172.21.15.18:0/4087086534 >> 172.21.15.18:0/4087086534 conn(0x7f947c0fd700 msgr2=0x7f947c1065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:32.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 -- 172.21.15.18:0/4087086534 shutdown_connections 2024-09-13T16:49:32.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:32.949+0000 7f9484400640 1 -- 172.21.15.18:0/4087086534 wait complete. 2024-09-13T16:49:32.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:49:33.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.124+0000 7fee7ec00640 1 -- 172.21.15.18:0/3887437204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee78101db0 msgr2=0x7fee781021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.124+0000 7fee7ec00640 1 --2- 172.21.15.18:0/3887437204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee78101db0 0x7fee781021b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009900 tx=0x7fee6c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.124+0000 7fee7ec00640 1 -- 172.21.15.18:0/3887437204 shutdown_connections 2024-09-13T16:49:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.124+0000 7fee7ec00640 1 --2- 172.21.15.18:0/3887437204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee78103960 0x7fee7810a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.124+0000 7fee7ec00640 1 --2- 172.21.15.18:0/3887437204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee78102fa0 0x7fee78103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.124+0000 7fee7ec00640 1 --2- 172.21.15.18:0/3887437204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee78101db0 0x7fee781021b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.124+0000 7fee7ec00640 1 -- 172.21.15.18:0/3887437204 >> 172.21.15.18:0/3887437204 conn(0x7fee780fd530 msgr2=0x7fee780ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.125+0000 7fee7ec00640 1 -- 172.21.15.18:0/3887437204 shutdown_connections 2024-09-13T16:49:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.125+0000 7fee7ec00640 1 -- 172.21.15.18:0/3887437204 wait complete. 2024-09-13T16:49:33.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.125+0000 7fee7ec00640 1 Processor -- start 2024-09-13T16:49:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7ec00640 1 -- start start 2024-09-13T16:49:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee78101db0 0x7fee78197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7ec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee78102fa0 0x7fee78198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7ec00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee78103960 0x7fee7819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7ec00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7819f920 con 0x7fee78102fa0 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7ec00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7819fa90 con 0x7fee78103960 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7819fc50 con 0x7fee78101db0 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee78101db0 0x7fee78197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee78102fa0 0x7fee78198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee78101db0 0x7fee78197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:40732/0 (socket says 172.21.15.18:40732) 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7d800640 1 -- 172.21.15.18:0/3810845349 learned_addr learned my addr 172.21.15.18:0/3810845349 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.126+0000 7fee7e200640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee78103960 0x7fee7819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee7d800640 1 -- 172.21.15.18:0/3810845349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee78103960 msgr2=0x7fee7819f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee7d800640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee78103960 0x7fee7819f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee7d800640 1 -- 172.21.15.18:0/3810845349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee78102fa0 msgr2=0x7fee78198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee7d800640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee78102fa0 0x7fee78198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee7d800640 1 -- 172.21.15.18:0/3810845349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70009840 con 0x7fee78101db0 2024-09-13T16:49:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee7e200640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee78103960 0x7fee7819f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:49:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee7ce00640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee78102fa0 0x7fee78198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee7d800640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee78101db0 0x7fee78197e30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fee6c031500 tx=0x7fee6c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee76000640 1 -- 172.21.15.18:0/3810845349 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c003e00 con 0x7fee78101db0 2024-09-13T16:49:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee76000640 1 -- 172.21.15.18:0/3810845349 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee6c031c70 con 0x7fee78101db0 2024-09-13T16:49:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee7ec00640 1 -- 172.21.15.18:0/3810845349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c009560 con 0x7fee78101db0 2024-09-13T16:49:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee76000640 1 -- 172.21.15.18:0/3810845349 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c03bc50 con 0x7fee78101db0 2024-09-13T16:49:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.127+0000 7fee7ec00640 1 -- 172.21.15.18:0/3810845349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee781a0190 con 0x7fee78101db0 2024-09-13T16:49:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.128+0000 7fee7ec00640 1 -- 172.21.15.18:0/3810845349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee78109300 con 0x7fee78101db0 2024-09-13T16:49:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.130+0000 7fee76000640 1 -- 172.21.15.18:0/3810845349 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fee6c0317b0 con 0x7fee78101db0 2024-09-13T16:49:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.131+0000 7fee76000640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee600a1110 0x7fee600a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.131+0000 7fee76000640 1 -- 172.21.15.18:0/3810845349 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fee6c0ed370 con 0x7fee78101db0 2024-09-13T16:49:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.131+0000 7fee7ce00640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee600a1110 0x7fee600a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.132+0000 7fee7ce00640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee600a1110 0x7fee600a35d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee78199340 tx=0x7fee64005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:33.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.135+0000 7fee76000640 1 -- 172.21.15.18:0/3810845349 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fee6c0b68b0 con 0x7fee78101db0 2024-09-13T16:49:33.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.315+0000 7fee7ec00640 1 -- 172.21.15.18:0/3810845349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee7810d6c0 con 0x7fee78101db0 2024-09-13T16:49:33.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.317+0000 7fee76000640 1 -- 172.21.15.18:0/3810845349 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23874 (secure 0 0 0) 0x7fee6c0b9ed0 con 0x7fee78101db0 2024-09-13T16:49:33.319 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:33.319 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:49:32.540261+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:49:33.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.319+0000 7fee7ec00640 1 -- 172.21.15.18:0/3810845349 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee600a1110 msgr2=0x7fee600a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.319+0000 7fee7ec00640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee600a1110 0x7fee600a35d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee78199340 tx=0x7fee64005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:33.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.319+0000 7fee7ec00640 1 -- 172.21.15.18:0/3810845349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee78101db0 msgr2=0x7fee78197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.319+0000 7fee7ec00640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee78101db0 0x7fee78197e30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fee6c031500 tx=0x7fee6c003c10 comp rx=0 tx=0).stop 2024-09-13T16:49:33.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.319+0000 7fee7ec00640 1 -- 172.21.15.18:0/3810845349 shutdown_connections 2024-09-13T16:49:33.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.319+0000 7fee7ec00640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee600a1110 0x7fee600a35d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.319+0000 7fee7ec00640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee78102fa0 0x7fee78198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.319+0000 7fee7ec00640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee78103960 0x7fee7819f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.319+0000 7fee7ec00640 1 --2- 172.21.15.18:0/3810845349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee78101db0 0x7fee78197e30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.319+0000 7fee7ec00640 1 -- 172.21.15.18:0/3810845349 >> 172.21.15.18:0/3810845349 conn(0x7fee780fd530 msgr2=0x7fee781064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:33.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.320+0000 7fee7ec00640 1 -- 172.21.15.18:0/3810845349 shutdown_connections 2024-09-13T16:49:33.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.320+0000 7fee7ec00640 1 -- 172.21.15.18:0/3810845349 wait complete. 2024-09-13T16:49:33.334 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:33 smithi018 ceph-mon[30981]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T16:49:33.334 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1935907138' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T16:49:33.335 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:33 smithi018 ceph-mon[30981]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T16:49:33.335 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/749763941' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T16:49:33.335 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:33 smithi018 ceph-mon[30981]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T16:49:33.335 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/749763941' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T16:49:33.335 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:33 smithi018 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:33.335 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4087086534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:33.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:49:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:33 smithi094 ceph-mon[35259]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T16:49:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1935907138' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T16:49:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:33 smithi094 ceph-mon[35259]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T16:49:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/749763941' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T16:49:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:33 smithi094 ceph-mon[35259]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T16:49:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/749763941' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T16:49:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:33 smithi094 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/4087086534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.492+0000 7f0d5e200640 1 -- 172.21.15.18:0/2719951931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d58101db0 msgr2=0x7f0d581021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.492+0000 7f0d5e200640 1 --2- 172.21.15.18:0/2719951931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d58101db0 0x7f0d581021b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009900 tx=0x7f0d4802a410 comp rx=0 tx=0).stop 2024-09-13T16:49:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.493+0000 7f0d5e200640 1 -- 172.21.15.18:0/2719951931 shutdown_connections 2024-09-13T16:49:33.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.493+0000 7f0d5e200640 1 --2- 172.21.15.18:0/2719951931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d58103960 0x7f0d5810a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.493+0000 7f0d5e200640 1 --2- 172.21.15.18:0/2719951931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d58102fa0 0x7f0d58103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.493+0000 7f0d5e200640 1 --2- 172.21.15.18:0/2719951931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d58101db0 0x7f0d581021b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.493+0000 7f0d5e200640 1 -- 172.21.15.18:0/2719951931 >> 172.21.15.18:0/2719951931 conn(0x7f0d580fd530 msgr2=0x7f0d580ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:33.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.493+0000 7f0d5e200640 1 -- 172.21.15.18:0/2719951931 shutdown_connections 2024-09-13T16:49:33.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.493+0000 7f0d5e200640 1 -- 172.21.15.18:0/2719951931 wait complete. 2024-09-13T16:49:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5e200640 1 Processor -- start 2024-09-13T16:49:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5e200640 1 -- start start 2024-09-13T16:49:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d58101db0 0x7f0d58197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5e200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d58102fa0 0x7f0d58198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d58103960 0x7f0d5819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5e200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5819f840 con 0x7f0d58101db0 2024-09-13T16:49:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5e200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5819f9b0 con 0x7f0d58102fa0 2024-09-13T16:49:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5819fb70 con 0x7f0d58103960 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d58101db0 0x7f0d58197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d58101db0 0x7f0d58197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36410/0 (socket says 172.21.15.18:36410) 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.494+0000 7f0d5ce00640 1 -- 172.21.15.18:0/1812858354 learned_addr learned my addr 172.21.15.18:0/1812858354 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d4fe00640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d58102fa0 0x7f0d58198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d5d800640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d58103960 0x7f0d5819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d5ce00640 1 -- 172.21.15.18:0/1812858354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d58103960 msgr2=0x7f0d5819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d5ce00640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d58103960 0x7f0d5819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d5ce00640 1 -- 172.21.15.18:0/1812858354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d58102fa0 msgr2=0x7f0d58198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d5ce00640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d58102fa0 0x7f0d58198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d5ce00640 1 -- 172.21.15.18:0/1812858354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48009560 con 0x7f0d58101db0 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d5ce00640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d58101db0 0x7f0d58197d50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0d480057c0 tx=0x7f0d480055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d56000640 1 -- 172.21.15.18:0/1812858354 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48004bd0 con 0x7f0d58101db0 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d56000640 1 -- 172.21.15.18:0/1812858354 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d48004d30 con 0x7f0d58101db0 2024-09-13T16:49:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d5e200640 1 -- 172.21.15.18:0/1812858354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5819fdf0 con 0x7f0d58101db0 2024-09-13T16:49:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.495+0000 7f0d56000640 1 -- 172.21.15.18:0/1812858354 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48031b60 con 0x7f0d58101db0 2024-09-13T16:49:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.496+0000 7f0d5e200640 1 -- 172.21.15.18:0/1812858354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d581a0210 con 0x7f0d58101db0 2024-09-13T16:49:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.497+0000 7f0d5e200640 1 -- 172.21.15.18:0/1812858354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d581092d0 con 0x7f0d58101db0 2024-09-13T16:49:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.498+0000 7f0d56000640 1 -- 172.21.15.18:0/1812858354 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0d48003cb0 con 0x7f0d58101db0 2024-09-13T16:49:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.500+0000 7f0d56000640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1110 0x7f0d3c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.500+0000 7f0d56000640 1 -- 172.21.15.18:0/1812858354 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0d480ed9c0 con 0x7f0d58101db0 2024-09-13T16:49:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.500+0000 7f0d4fe00640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1110 0x7f0d3c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.501+0000 7f0d4fe00640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1110 0x7f0d3c0a35d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0d58199260 tx=0x7f0d4000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:33.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.503+0000 7f0d56000640 1 -- 172.21.15.18:0/1812858354 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0d480b7010 con 0x7f0d58101db0 2024-09-13T16:49:33.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:33 smithi144 ceph-mon[35328]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T16:49:33.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1935907138' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T16:49:33.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:33 smithi144 ceph-mon[35328]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T16:49:33.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/749763941' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T16:49:33.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:33 smithi144 ceph-mon[35328]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T16:49:33.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/749763941' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T16:49:33.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:33 smithi144 ceph-mon[35328]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:33.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/4087086534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:33.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.684+0000 7f0d5e200640 1 -- 172.21.15.18:0/1812858354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d5810d650 con 0x7f0d58101db0 2024-09-13T16:49:33.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.686+0000 7f0d56000640 1 -- 172.21.15.18:0/1812858354 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23874 (secure 0 0 0) 0x7f0d480ba630 con 0x7f0d58101db0 2024-09-13T16:49:33.688 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:33.688 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:49:32.540261+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:49:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 -- 172.21.15.18:0/1812858354 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1110 msgr2=0x7f0d3c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1110 0x7f0d3c0a35d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0d58199260 tx=0x7f0d4000b410 comp rx=0 tx=0).stop 2024-09-13T16:49:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 -- 172.21.15.18:0/1812858354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d58101db0 msgr2=0x7f0d58197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d58101db0 0x7f0d58197d50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0d480057c0 tx=0x7f0d480055a0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 -- 172.21.15.18:0/1812858354 shutdown_connections 2024-09-13T16:49:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d58103960 0x7f0d5819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d58102fa0 0x7f0d58198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0d3c0a1110 0x7f0d3c0a35d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 --2- 172.21.15.18:0/1812858354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d58101db0 0x7f0d58197d50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 -- 172.21.15.18:0/1812858354 >> 172.21.15.18:0/1812858354 conn(0x7f0d580fd530 msgr2=0x7f0d581064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 -- 172.21.15.18:0/1812858354 shutdown_connections 2024-09-13T16:49:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.688+0000 7f0d5e200640 1 -- 172.21.15.18:0/1812858354 wait complete. 2024-09-13T16:49:33.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:49:33.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.882+0000 7f7fcbe00640 1 -- 172.21.15.18:0/227514384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fcc103960 msgr2=0x7f7fcc10a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.882+0000 7f7fcbe00640 1 --2- 172.21.15.18:0/227514384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fcc103960 0x7f7fcc10a1f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009ca0 tx=0x7f7fc402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.882+0000 7f7fcbe00640 1 -- 172.21.15.18:0/227514384 shutdown_connections 2024-09-13T16:49:33.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.882+0000 7f7fcbe00640 1 --2- 172.21.15.18:0/227514384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fcc103960 0x7f7fcc10a1f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.882+0000 7f7fcbe00640 1 --2- 172.21.15.18:0/227514384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fcc102fa0 0x7f7fcc103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.882+0000 7f7fcbe00640 1 --2- 172.21.15.18:0/227514384 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fcc101db0 0x7f7fcc1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.882+0000 7f7fcbe00640 1 -- 172.21.15.18:0/227514384 >> 172.21.15.18:0/227514384 conn(0x7f7fcc0fd530 msgr2=0x7f7fcc0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:33.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.882+0000 7f7fcbe00640 1 -- 172.21.15.18:0/227514384 shutdown_connections 2024-09-13T16:49:33.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.882+0000 7f7fcbe00640 1 -- 172.21.15.18:0/227514384 wait complete. 2024-09-13T16:49:33.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.883+0000 7f7fcbe00640 1 Processor -- start 2024-09-13T16:49:33.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.883+0000 7f7fcbe00640 1 -- start start 2024-09-13T16:49:33.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.883+0000 7f7fcbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fcc101db0 0x7f7fcc197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.883+0000 7f7fcbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fcc102fa0 0x7f7fcc1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.883+0000 7f7fcbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fcc103960 0x7f7fcc19f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fcbe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc19f810 con 0x7f7fcc102fa0 2024-09-13T16:49:33.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fcbe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc19f980 con 0x7f7fcc101db0 2024-09-13T16:49:33.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fcbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc19fb40 con 0x7f7fcc103960 2024-09-13T16:49:33.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fcc102fa0 0x7f7fcc1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fcc102fa0 0x7f7fcc1982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36420/0 (socket says 172.21.15.18:36420) 2024-09-13T16:49:33.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fca000640 1 -- 172.21.15.18:0/808463419 learned_addr learned my addr 172.21.15.18:0/808463419 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:33.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fcaa00640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fcc101db0 0x7f7fcc197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fcb400640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fcc103960 0x7f7fcc19f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fca000640 1 -- 172.21.15.18:0/808463419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fcc103960 msgr2=0x7f7fcc19f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fca000640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fcc103960 0x7f7fcc19f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fca000640 1 -- 172.21.15.18:0/808463419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fcc101db0 msgr2=0x7f7fcc197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:33.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fca000640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fcc101db0 0x7f7fcc197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:33.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fca000640 1 -- 172.21.15.18:0/808463419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc009490 con 0x7f7fcc102fa0 2024-09-13T16:49:33.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.884+0000 7f7fca000640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fcc102fa0 0x7f7fcc1982c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800ea60 tx=0x7f7fb800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:33.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.885+0000 7f7fc3400640 1 -- 172.21.15.18:0/808463419 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800cde0 con 0x7f7fcc102fa0 2024-09-13T16:49:33.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.885+0000 7f7fc3400640 1 -- 172.21.15.18:0/808463419 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fb80035f0 con 0x7f7fcc102fa0 2024-09-13T16:49:33.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.885+0000 7f7fc3400640 1 -- 172.21.15.18:0/808463419 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80044e0 con 0x7f7fcc102fa0 2024-09-13T16:49:33.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.885+0000 7f7fcbe00640 1 -- 172.21.15.18:0/808463419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb8009490 con 0x7f7fcc102fa0 2024-09-13T16:49:33.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.885+0000 7f7fcbe00640 1 -- 172.21.15.18:0/808463419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc4009900 con 0x7f7fcc102fa0 2024-09-13T16:49:33.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.886+0000 7f7fcbe00640 1 -- 172.21.15.18:0/808463419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc10d6a0 con 0x7f7fcc102fa0 2024-09-13T16:49:33.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.888+0000 7f7fc3400640 1 -- 172.21.15.18:0/808463419 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7fb8003a60 con 0x7f7fcc102fa0 2024-09-13T16:49:33.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.889+0000 7f7fc3400640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7fb00a1110 0x7f7fb00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:33.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.889+0000 7f7fc3400640 1 -- 172.21.15.18:0/808463419 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7fb8014070 con 0x7f7fcc102fa0 2024-09-13T16:49:33.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.889+0000 7f7fcaa00640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7fb00a1110 0x7f7fb00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:33.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.890+0000 7f7fcaa00640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7fb00a1110 0x7f7fb00a35d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc199200 tx=0x7f7fbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:33.892+0000 7f7fc3400640 1 -- 172.21.15.18:0/808463419 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7fb80d0030 con 0x7f7fcc102fa0 2024-09-13T16:49:33.912 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b[65662]: 2024-09-13T16:49:33.416+0000 7f4883cf7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T16:49:34.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.111+0000 7f7fcbe00640 1 -- 172.21.15.18:0/808463419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fcc1a0200 con 0x7f7fcc102fa0 2024-09-13T16:49:34.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.113+0000 7f7fc3400640 1 -- 172.21.15.18:0/808463419 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10792 (secure 0 0 0) 0x7f7fcc1a0200 con 0x7f7fcc102fa0 2024-09-13T16:49:34.114 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:34.114 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24566,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T16:49:28.080578+0000","modified":"2024-09-13T16:49:32.540505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T16:49:34.114 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 17 2024-09-13T16:49:34.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 -- 172.21.15.18:0/808463419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7fb00a1110 msgr2=0x7f7fb00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7fb00a1110 0x7f7fb00a35d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc199200 tx=0x7f7fbc005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:34.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 -- 172.21.15.18:0/808463419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fcc102fa0 msgr2=0x7f7fcc1982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fcc102fa0 0x7f7fcc1982c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800ea60 tx=0x7f7fb800ef20 comp rx=0 tx=0).stop 2024-09-13T16:49:34.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 -- 172.21.15.18:0/808463419 shutdown_connections 2024-09-13T16:49:34.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7fb00a1110 0x7f7fb00a35d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fcc102fa0 0x7f7fcc1982c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fcc103960 0x7f7fcc19f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 --2- 172.21.15.18:0/808463419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7fcc101db0 0x7f7fcc197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 -- 172.21.15.18:0/808463419 >> 172.21.15.18:0/808463419 conn(0x7f7fcc0fd530 msgr2=0x7f7fcc0ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:34.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 -- 172.21.15.18:0/808463419 shutdown_connections 2024-09-13T16:49:34.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.115+0000 7f7fcbe00640 1 -- 172.21.15.18:0/808463419 wait complete. 2024-09-13T16:49:34.132 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:49:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.287+0000 7f8152200640 1 -- 172.21.15.18:0/1761764032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f814c102f90 msgr2=0x7f814c103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.287+0000 7f8152200640 1 --2- 172.21.15.18:0/1761764032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f814c102f90 0x7f814c103410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8138009900 tx=0x7f813802a410 comp rx=0 tx=0).stop 2024-09-13T16:49:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.288+0000 7f8152200640 1 -- 172.21.15.18:0/1761764032 shutdown_connections 2024-09-13T16:49:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.288+0000 7f8152200640 1 --2- 172.21.15.18:0/1761764032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f814c102f90 0x7f814c103410 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.288+0000 7f8152200640 1 --2- 172.21.15.18:0/1761764032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f814c103950 0x7f814c10a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.288+0000 7f8152200640 1 --2- 172.21.15.18:0/1761764032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814c101da0 0x7f814c1021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.288+0000 7f8152200640 1 -- 172.21.15.18:0/1761764032 >> 172.21.15.18:0/1761764032 conn(0x7f814c0fd540 msgr2=0x7f814c0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.288+0000 7f8152200640 1 -- 172.21.15.18:0/1761764032 shutdown_connections 2024-09-13T16:49:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.288+0000 7f8152200640 1 -- 172.21.15.18:0/1761764032 wait complete. 2024-09-13T16:49:34.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8152200640 1 Processor -- start 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8152200640 1 -- start start 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8152200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814c101da0 0x7f814c197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8152200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f814c102f90 0x7f814c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8152200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f814c103950 0x7f814c19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8152200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c19f860 con 0x7f814c103950 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8152200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c19f9d0 con 0x7f814c102f90 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8152200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c19fb90 con 0x7f814c101da0 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8150e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814c101da0 0x7f814c197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8151800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f814c103950 0x7f814c19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8150e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814c101da0 0x7f814c197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:40792/0 (socket says 172.21.15.18:40792) 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f8150e00640 1 -- 172.21.15.18:0/3955714634 learned_addr learned my addr 172.21.15.18:0/3955714634 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.289+0000 7f814be00640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f814c102f90 0x7f814c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8150e00640 1 -- 172.21.15.18:0/3955714634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f814c102f90 msgr2=0x7f814c1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8150e00640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f814c102f90 0x7f814c1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8150e00640 1 -- 172.21.15.18:0/3955714634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f814c103950 msgr2=0x7f814c19f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8150e00640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f814c103950 0x7f814c19f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8150e00640 1 -- 172.21.15.18:0/3955714634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8138009560 con 0x7f814c101da0 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8151800640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f814c103950 0x7f814c19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8150e00640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814c101da0 0x7f814c197d70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f814000e9c0 tx=0x7f814000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8149600640 1 -- 172.21.15.18:0/3955714634 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81400096e0 con 0x7f814c101da0 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8149600640 1 -- 172.21.15.18:0/3955714634 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81400044f0 con 0x7f814c101da0 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8152200640 1 -- 172.21.15.18:0/3955714634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814c19fe70 con 0x7f814c101da0 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8149600640 1 -- 172.21.15.18:0/3955714634 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140010430 con 0x7f814c101da0 2024-09-13T16:49:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.290+0000 7f8152200640 1 -- 172.21.15.18:0/3955714634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814c1a0240 con 0x7f814c101da0 2024-09-13T16:49:34.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.291+0000 7f8152200640 1 -- 172.21.15.18:0/3955714634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814c1092d0 con 0x7f814c101da0 2024-09-13T16:49:34.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.293+0000 7f8149600640 1 -- 172.21.15.18:0/3955714634 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f81400035f0 con 0x7f814c101da0 2024-09-13T16:49:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.294+0000 7f8149600640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f81340a1090 0x7f81340a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.295+0000 7f8149600640 1 -- 172.21.15.18:0/3955714634 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8140014070 con 0x7f814c101da0 2024-09-13T16:49:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.295+0000 7f814be00640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f81340a1090 0x7f81340a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.295+0000 7f814be00640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f81340a1090 0x7f81340a3550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f813802aa00 tx=0x7f81380314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.297+0000 7f8149600640 1 -- 172.21.15.18:0/3955714634 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8140096720 con 0x7f814c101da0 2024-09-13T16:49:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:34 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3810845349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:34 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1812858354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:34 smithi094 ceph-mon[35259]: pgmap v300: 129 pgs: 9 creating+peering, 104 active+clean, 16 unknown; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-13T16:49:34.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:34 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3810845349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:34.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:34 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1812858354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:34.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:34 smithi018 ceph-mon[30981]: pgmap v300: 129 pgs: 9 creating+peering, 104 active+clean, 16 unknown; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-13T16:49:34.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.482+0000 7f8152200640 1 -- 172.21.15.18:0/3955714634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f814c10d660 con 0x7f814c101da0 2024-09-13T16:49:34.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.484+0000 7f8149600640 1 -- 172.21.15.18:0/3955714634 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23874 (secure 0 0 0) 0x7f8140099d40 con 0x7f814c101da0 2024-09-13T16:49:34.485 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:34.485 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:49:32.540261+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:49:34.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 -- 172.21.15.18:0/3955714634 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f81340a1090 msgr2=0x7f81340a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f81340a1090 0x7f81340a3550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f813802aa00 tx=0x7f81380314a0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 -- 172.21.15.18:0/3955714634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814c101da0 msgr2=0x7f814c197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814c101da0 0x7f814c197d70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f814000e9c0 tx=0x7f814000ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 -- 172.21.15.18:0/3955714634 shutdown_connections 2024-09-13T16:49:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f81340a1090 0x7f81340a3550 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f814c103950 0x7f814c19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f814c102f90 0x7f814c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 --2- 172.21.15.18:0/3955714634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814c101da0 0x7f814c197d70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 -- 172.21.15.18:0/3955714634 >> 172.21.15.18:0/3955714634 conn(0x7f814c0fd540 msgr2=0x7f814c1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 -- 172.21.15.18:0/3955714634 shutdown_connections 2024-09-13T16:49:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.486+0000 7f8152200640 1 -- 172.21.15.18:0/3955714634 wait complete. 2024-09-13T16:49:34.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T16:49:28.080578+0000', 'modified': '2024-09-13T16:49:32.540505+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24590}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24590': {'gid': 24590, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6839/1508206800', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6838', 'nonce': 1508206800}, {'type': 'v1', 'addr': '172.21.15.94:6839', 'nonce': 1508206800}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T16:49:34.504 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T16:49:34.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T16:49:34.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:34 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3810845349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:34.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:34 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1812858354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:34.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:34 smithi144 ceph-mon[35328]: pgmap v300: 129 pgs: 9 creating+peering, 104 active+clean, 16 unknown; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-13T16:49:34.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.660+0000 7f65d0000640 1 -- 172.21.15.18:0/2420778379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65c8103130 msgr2=0x7f65c8105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.660+0000 7f65d0000640 1 --2- 172.21.15.18:0/2420778379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65c8103130 0x7f65c8105520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009900 tx=0x7f65b402a410 comp rx=0 tx=0).stop 2024-09-13T16:49:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.660+0000 7f65d0000640 1 -- 172.21.15.18:0/2420778379 shutdown_connections 2024-09-13T16:49:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.660+0000 7f65d0000640 1 --2- 172.21.15.18:0/2420778379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65c8103130 0x7f65c8105520 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.660+0000 7f65d0000640 1 --2- 172.21.15.18:0/2420778379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65c8105a60 0x7f65c8107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.660+0000 7f65d0000640 1 --2- 172.21.15.18:0/2420778379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c8100800 0x7f65c8102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.660+0000 7f65d0000640 1 -- 172.21.15.18:0/2420778379 >> 172.21.15.18:0/2420778379 conn(0x7f65c80fa3e0 msgr2=0x7f65c80fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.660+0000 7f65d0000640 1 -- 172.21.15.18:0/2420778379 shutdown_connections 2024-09-13T16:49:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.660+0000 7f65d0000640 1 -- 172.21.15.18:0/2420778379 wait complete. 2024-09-13T16:49:34.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.661+0000 7f65d0000640 1 Processor -- start 2024-09-13T16:49:34.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.661+0000 7f65d0000640 1 -- start start 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.661+0000 7f65d0000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65c8100800 0x7f65c8198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.661+0000 7f65d0000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65c8103130 0x7f65c8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65d0000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c8105a60 0x7f65c819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65d0000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c819fb20 con 0x7f65c8103130 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65d0000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c819fc90 con 0x7f65c8100800 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65d0000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c819fe50 con 0x7f65c8105a60 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65ccc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65c8103130 0x7f65c8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65cd600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65c8100800 0x7f65c8198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65cd600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65c8100800 0x7f65c8198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:56822/0 (socket says 172.21.15.18:56822) 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65cd600640 1 -- 172.21.15.18:0/3731957223 learned_addr learned my addr 172.21.15.18:0/3731957223 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65ccc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65c8103130 0x7f65c8198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36460/0 (socket says 172.21.15.18:36460) 2024-09-13T16:49:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65ce000640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c8105a60 0x7f65c819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65cd600640 1 -- 172.21.15.18:0/3731957223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c8105a60 msgr2=0x7f65c819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65cd600640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c8105a60 0x7f65c819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65cd600640 1 -- 172.21.15.18:0/3731957223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65c8103130 msgr2=0x7f65c8198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65cd600640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65c8103130 0x7f65c8198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65cd600640 1 -- 172.21.15.18:0/3731957223 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c0009840 con 0x7f65c8100800 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.662+0000 7f65cd600640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65c8100800 0x7f65c8198030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00e9f0 tx=0x7f65bc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.663+0000 7f65c6000640 1 -- 172.21.15.18:0/3731957223 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc009720 con 0x7f65c8100800 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.663+0000 7f65c6000640 1 -- 172.21.15.18:0/3731957223 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65bc00cd80 con 0x7f65c8100800 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.663+0000 7f65c6000640 1 -- 172.21.15.18:0/3731957223 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc010430 con 0x7f65c8100800 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.663+0000 7f65d0000640 1 -- 172.21.15.18:0/3731957223 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b4009560 con 0x7f65c8100800 2024-09-13T16:49:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.663+0000 7f65d0000640 1 -- 172.21.15.18:0/3731957223 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c81a0430 con 0x7f65c8100800 2024-09-13T16:49:34.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65d2e8c740 1 Processor -- start 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65d2e8c740 1 -- start start 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 0x5611cb4dff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e0470 0x5611cb4e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4e79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65c6000640 1 -- 172.21.15.18:0/3731957223 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f65bc005020 con 0x7f65c8100800 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb449ab0 con 0x5611cb4e5500 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb447240 con 0x5611cb4dfb30 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb442b30 con 0x5611cb4e0470 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65ccc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4e79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65ce000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 0x5611cb4dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65ccc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4e79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36466/0 (socket says 172.21.15.18:36466) 2024-09-13T16:49:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65ccc00640 1 -- 172.21.15.18:0/684175795 learned_addr learned my addr 172.21.15.18:0/684175795 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.666+0000 7f65cd600640 1 --2- 172.21.15.18:0/684175795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e0470 0x5611cb4e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.667+0000 7f65ce000640 1 -- 172.21.15.18:0/684175795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e0470 msgr2=0x5611cb4e4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:49:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.667+0000 7f65ce000640 1 --2- 172.21.15.18:0/684175795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e0470 0x5611cb4e4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.667+0000 7f65ce000640 1 -- 172.21.15.18:0/684175795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 msgr2=0x5611cb4e79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:49:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.667+0000 7f65ce000640 1 --2- 172.21.15.18:0/684175795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4e79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.667+0000 7f65ce000640 1 -- 172.21.15.18:0/684175795 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611cb40dbd0 con 0x5611cb4dfb30 2024-09-13T16:49:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.667+0000 7f65ce000640 1 --2- 172.21.15.18:0/684175795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 0x5611cb4dff30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f65c0005fd0 tx=0x7f65c0010960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b996e47b5c8c09c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.667+0000 7f65baa00640 1 -- 172.21.15.18:0/684175795 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c0011760 con 0x5611cb4dfb30 2024-09-13T16:49:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.667+0000 7f65baa00640 1 -- 172.21.15.18:0/684175795 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65c0011d80 con 0x5611cb4dfb30 2024-09-13T16:49:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.667+0000 7f65baa00640 1 -- 172.21.15.18:0/684175795 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c001bdf0 con 0x5611cb4dfb30 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65c6000640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f65b00a1090 0x7f65b00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65d2e8c740 1 -- 172.21.15.18:0/684175795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 msgr2=0x5611cb4dff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/684175795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 0x5611cb4dff30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f65c0005fd0 tx=0x7f65c0010960 comp rx=0 tx=0).stop 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65c6000640 1 -- 172.21.15.18:0/3731957223 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f65bc014070 con 0x7f65c8100800 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65d2e8c740 1 -- 172.21.15.18:0/684175795 shutdown_connections 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/684175795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4e79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/684175795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e0470 0x5611cb4e4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/684175795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 0x5611cb4dff30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65d2e8c740 1 -- 172.21.15.18:0/684175795 >> 172.21.15.18:0/684175795 conn(0x5611cb4db1a0 msgr2=0x5611cb4db5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65cd600640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f65b00a1090 0x7f65b00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65d2e8c740 1 -- 172.21.15.18:0/684175795 shutdown_connections 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.668+0000 7f65d2e8c740 1 -- 172.21.15.18:0/684175795 wait complete. 2024-09-13T16:49:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.669+0000 7f65cd600640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f65b00a1090 0x7f65b00a3550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c6a0 tx=0x7f65bc004a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.669+0000 7f65d2e8c740 1 -- start start 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.669+0000 7f65d2e8c740 1 Processor -- start 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.669+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4dfb30 0x5611cb4e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.669+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 0x5611cb4e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.669+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.669+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb3e4260 con 0x5611cb4e5500 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.669+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb3e3f00 con 0x5611cb4e0470 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.669+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb1a9f20 con 0x5611cb4dfb30 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.669+0000 7f65d2e8c740 10 client.0 _ll_register_callbacks cb 0x5611cb43c1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ce000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ce000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4f0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36480/0 (socket says 172.21.15.18:36480) 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ce000640 1 -- 172.21.15.18:0/1090508002 learned_addr learned my addr 172.21.15.18:0/1090508002 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ccc00640 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 0x5611cb4e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ce000640 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4dfb30 0x5611cb4e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ccc00640 1 -- 172.21.15.18:0/1090508002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4dfb30 msgr2=0x5611cb4e9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ccc00640 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4dfb30 0x5611cb4e9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ccc00640 1 -- 172.21.15.18:0/1090508002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 msgr2=0x5611cb4f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ccc00640 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ccc00640 1 -- 172.21.15.18:0/1090508002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c0009d40 con 0x5611cb4e0470 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ce000640 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65ccc00640 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 0x5611cb4e9c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f65b4000c00 tx=0x7f65b4005230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cc8d45f96bae2ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.670+0000 7f65af400640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.671+0000 7f65af400640 1 -- 172.21.15.18:0/1090508002 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40048c0 con 0x5611cb4e0470 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.671+0000 7f65d2e8c740 1 -- 172.21.15.18:0/1090508002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611cb46ccd0 con 0x5611cb4e0470 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.671+0000 7f65af400640 1 -- 172.21.15.18:0/1090508002 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f65b4004a20 con 0x5611cb4e0470 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.671+0000 7f65af400640 1 -- 172.21.15.18:0/1090508002 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65b4004be0 con 0x5611cb4e0470 2024-09-13T16:49:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.671+0000 7f65d2e8c740 10 client.24698 fetch_fsmap learned FSMap version 17 2024-09-13T16:49:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.671+0000 7f65d2e8c740 1 -- 172.21.15.18:0/1090508002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x5611cb4411b0 con 0x5611cb4e0470 2024-09-13T16:49:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.671+0000 7f65af400640 1 -- 172.21.15.18:0/1090508002 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5611cb46ccd0 con 0x5611cb4e0470 2024-09-13T16:49:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.672+0000 7f65af400640 1 -- 172.21.15.18:0/1090508002 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f65b4031760 con 0x5611cb4e0470 2024-09-13T16:49:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.672+0000 7f65d2e8c740 10 client.24698 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T16:49:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.672+0000 7f65d2e8c740 10 client.24698 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:49:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.672+0000 7f65d2e8c740 20 client.24698 populate_metadata read hostname 'smithi018' 2024-09-13T16:49:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.672+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5611cb4f5b90 0x5611cb4f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.672+0000 7f65d2e8c740 4 client.24698 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:49:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.672+0000 7f65d2e8c740 1 -- 172.21.15.18:0/1090508002 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611cb1363c0 con 0x5611cb4f5b90 2024-09-13T16:49:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.672+0000 7f65ce000640 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5611cb4f5b90 0x5611cb4f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.673+0000 7f65ce000640 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5611cb4f5b90 0x5611cb4f9cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ae4e65b680bc630 server_cookie=544585daef991f58 in_seq=0 out_seq=0 2024-09-13T16:49:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.673+0000 7f65af400640 10 client.24698 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:49:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65af400640 1 -- 172.21.15.18:0/1090508002 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5611cb1363c0 con 0x5611cb4f5b90 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65af400640 10 client.24698 handle_command_reply: tid=0 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 client.24698 shutdown 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 -- 172.21.15.18:0/1090508002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 msgr2=0x5611cb4e9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 0x5611cb4e9c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f65b4000c00 tx=0x7f65b4005230 comp rx=0 tx=0).stop 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 -- 172.21.15.18:0/1090508002 shutdown_connections 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5611cb4f5b90 0x5611cb4f9cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 0x5611cb4e9c40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65af400640 0 client.24698 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/1090508002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4dfb30 0x5611cb4e9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 -- 172.21.15.18:0/1090508002 >> 172.21.15.18:0/1090508002 conn(0x5611cb4db1a0 msgr2=0x5611cb4dc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 -- 172.21.15.18:0/1090508002 shutdown_connections 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 1 -- 172.21.15.18:0/1090508002 wait complete. 2024-09-13T16:49:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.674+0000 7f65d2e8c740 20 client.24698 trim_cache size 0 max 16384 2024-09-13T16:49:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.689+0000 7f65d2e8c740 1 Processor -- start 2024-09-13T16:49:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65d2e8c740 1 -- start start 2024-09-13T16:49:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 0x5611cb4e4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e0470 0x5611cb4f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e5500 0x5611cb4e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb4db060 con 0x5611cb4e0470 2024-09-13T16:49:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb4e7f00 con 0x5611cb4dfb30 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb4e80d0 con 0x5611cb4e5500 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ccc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e0470 0x5611cb4f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ccc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e0470 0x5611cb4f0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36488/0 (socket says 172.21.15.18:36488) 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ccc00640 1 -- 172.21.15.18:0/4167526968 learned_addr learned my addr 172.21.15.18:0/4167526968 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ce000640 1 --2- 172.21.15.18:0/4167526968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 0x5611cb4e4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ce000640 1 --2- 172.21.15.18:0/4167526968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e5500 0x5611cb4e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ccc00640 1 -- 172.21.15.18:0/4167526968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e5500 msgr2=0x5611cb4e4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ccc00640 1 --2- 172.21.15.18:0/4167526968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e5500 0x5611cb4e4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ccc00640 1 -- 172.21.15.18:0/4167526968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 msgr2=0x5611cb4e4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ccc00640 1 --2- 172.21.15.18:0/4167526968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 0x5611cb4e4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ccc00640 1 -- 172.21.15.18:0/4167526968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611cb3e3470 con 0x5611cb4e0470 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.690+0000 7f65ce000640 1 --2- 172.21.15.18:0/4167526968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e5500 0x5611cb4e4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:49:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.691+0000 7f65ccc00640 1 --2- 172.21.15.18:0/4167526968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e0470 0x5611cb4f0c40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009900 tx=0x7f65b4005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1050917571b97eda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.691+0000 7f65bb400640 1 -- 172.21.15.18:0/4167526968 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b403d650 con 0x5611cb4e0470 2024-09-13T16:49:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.691+0000 7f65bb400640 1 -- 172.21.15.18:0/4167526968 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65b4031a60 con 0x5611cb4e0470 2024-09-13T16:49:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.691+0000 7f65bb400640 1 -- 172.21.15.18:0/4167526968 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b403de80 con 0x5611cb4e0470 2024-09-13T16:49:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.691+0000 7f65d2e8c740 1 -- 172.21.15.18:0/4167526968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e0470 msgr2=0x5611cb4f0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.691+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/4167526968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e0470 0x5611cb4f0c40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009900 tx=0x7f65b4005d70 comp rx=0 tx=0).stop 2024-09-13T16:49:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 -- 172.21.15.18:0/4167526968 shutdown_connections 2024-09-13T16:49:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/4167526968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e0470 0x5611cb4f0c40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/4167526968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4e5500 0x5611cb4e4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/4167526968 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4dfb30 0x5611cb4e4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 -- 172.21.15.18:0/4167526968 >> 172.21.15.18:0/4167526968 conn(0x5611cb4db1a0 msgr2=0x5611cb4e1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 -- 172.21.15.18:0/4167526968 shutdown_connections 2024-09-13T16:49:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 -- 172.21.15.18:0/4167526968 wait complete. 2024-09-13T16:49:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 -- start start 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 Processor -- start 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4dfb30 0x5611cb4eb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.692+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 0x5611cb4f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65d2e8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4eba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb4ec090 con 0x5611cb4e5500 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb54b9b0 con 0x5611cb4e0470 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65d2e8c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611cb54baf0 con 0x5611cb4dfb30 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65d2e8c740 10 client.0 _ll_register_callbacks cb 0x7f65b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ce000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ccc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 0x5611cb4f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ce000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4eba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36504/0 (socket says 172.21.15.18:36504) 2024-09-13T16:49:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ce000640 1 -- 172.21.15.18:0/312059366 learned_addr learned my addr 172.21.15.18:0/312059366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ce000640 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4dfb30 0x5611cb4eb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ce000640 1 -- 172.21.15.18:0/312059366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4dfb30 msgr2=0x5611cb4eb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ce000640 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4dfb30 0x5611cb4eb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ce000640 1 -- 172.21.15.18:0/312059366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 msgr2=0x5611cb4f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ce000640 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 0x5611cb4f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ce000640 1 -- 172.21.15.18:0/312059366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611cb4411b0 con 0x5611cb4e5500 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.693+0000 7f65ccc00640 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 0x5611cb4f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.694+0000 7f65ce000640 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4eba80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f65c0006010 tx=0x7f65c001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cc1153e5dbb6b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.694+0000 7f65af400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.694+0000 7f65af400640 1 -- 172.21.15.18:0/312059366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00049e0 con 0x5611cb4e5500 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.694+0000 7f65af400640 1 -- 172.21.15.18:0/312059366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f65c0017030 con 0x5611cb4e5500 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.694+0000 7f65d2e8c740 1 -- 172.21.15.18:0/312059366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65c0011d80 con 0x5611cb4e5500 2024-09-13T16:49:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.694+0000 7f65af400640 1 -- 172.21.15.18:0/312059366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65c0004b40 con 0x5611cb4e5500 2024-09-13T16:49:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.694+0000 7f65d2e8c740 10 client.14661 fetch_fsmap learned FSMap version 17 2024-09-13T16:49:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.694+0000 7f65d2e8c740 1 -- 172.21.15.18:0/312059366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x5611cb408980 con 0x5611cb4e5500 2024-09-13T16:49:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.694+0000 7f65af400640 1 -- 172.21.15.18:0/312059366 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65c0011d80 con 0x5611cb4e5500 2024-09-13T16:49:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.694+0000 7f65af400640 1 -- 172.21.15.18:0/312059366 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f65c0011560 con 0x5611cb4e5500 2024-09-13T16:49:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.695+0000 7f65d2e8c740 10 client.14661 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T16:49:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.695+0000 7f65d2e8c740 10 client.14661 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:49:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.695+0000 7f65d2e8c740 20 client.14661 populate_metadata read hostname 'smithi018' 2024-09-13T16:49:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.695+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5611cb550790 0x5611cb54d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.695+0000 7f65d2e8c740 4 client.14661 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.695+0000 7f65d2e8c740 1 -- 172.21.15.18:0/312059366 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611cb1476c0 con 0x5611cb550790 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.695+0000 7f65ccc00640 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5611cb550790 0x5611cb54d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.695+0000 7f65ccc00640 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5611cb550790 0x5611cb54d0c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f269fa7e4ded8d2 server_cookie=758705e9910ff2cb in_seq=0 out_seq=0 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.695+0000 7f65af400640 10 client.14661 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65af400640 1 -- 172.21.15.18:0/312059366 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5611cb1476c0 con 0x5611cb550790 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65af400640 10 client.14661 handle_command_reply: tid=0 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 client.14661 shutdown 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 -- 172.21.15.18:0/312059366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 msgr2=0x5611cb4eba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4eba80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f65c0006010 tx=0x7f65c001e040 comp rx=0 tx=0).stop 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 -- 172.21.15.18:0/312059366 shutdown_connections 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5611cb550790 0x5611cb54d0c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611cb4e5500 0x5611cb4eba80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5611cb4e0470 0x5611cb4f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 --2- 172.21.15.18:0/312059366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5611cb4dfb30 0x5611cb4eb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 -- 172.21.15.18:0/312059366 >> 172.21.15.18:0/312059366 conn(0x5611cb4db1a0 msgr2=0x5611cb4e94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65af400640 0 client.14661 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:49:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 -- 172.21.15.18:0/312059366 shutdown_connections 2024-09-13T16:49:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 1 -- 172.21.15.18:0/312059366 wait complete. 2024-09-13T16:49:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.696+0000 7f65d2e8c740 20 client.14661 trim_cache size 0 max 16384 2024-09-13T16:49:34.703 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T16:49:34.703 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "d8ff35a0-71ee-11ef-bceb-c7b262605968", 2024-09-13T16:49:34.703 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-13T16:49:34.704 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24590, 2024-09-13T16:49:34.704 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-13T16:49:34.704 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-13T16:49:34.704 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-13T16:49:34.704 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 6.6125339270000003, 2024-09-13T16:49:34.704 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 17, 2024-09-13T16:49:34.704 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 89, 2024-09-13T16:49:34.704 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 88, 2024-09-13T16:49:34.704 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 11.625084085999999 2024-09-13T16:49:34.704 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T16:49:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 -- 172.21.15.18:0/3731957223 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f65b00a1090 msgr2=0x7f65b00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f65b00a1090 0x7f65b00a3550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c6a0 tx=0x7f65bc004a20 comp rx=0 tx=0).stop 2024-09-13T16:49:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 -- 172.21.15.18:0/3731957223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65c8100800 msgr2=0x7f65c8198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65c8100800 0x7f65c8198030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00e9f0 tx=0x7f65bc00edf0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 -- 172.21.15.18:0/3731957223 shutdown_connections 2024-09-13T16:49:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f65b00a1090 0x7f65b00a3550 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65c8103130 0x7f65c8198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c8105a60 0x7f65c819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 --2- 172.21.15.18:0/3731957223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65c8100800 0x7f65c8198030 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 -- 172.21.15.18:0/3731957223 >> 172.21.15.18:0/3731957223 conn(0x7f65c80fa3e0 msgr2=0x7f65c80fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 -- 172.21.15.18:0/3731957223 shutdown_connections 2024-09-13T16:49:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:34.697+0000 7f65d0000640 1 -- 172.21.15.18:0/3731957223 wait complete. 2024-09-13T16:49:34.714 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T16:49:34.714 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:49:34.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T16:49:35.033 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:49:35.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:35 smithi018 ceph-mon[30981]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T16:49:35.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:35 smithi018 ceph-mon[30981]: Cluster is now healthy 2024-09-13T16:49:35.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:35 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/808463419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:35.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:35 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3955714634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:35.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:35 smithi094 ceph-mon[35259]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T16:49:35.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:35 smithi094 ceph-mon[35259]: Cluster is now healthy 2024-09-13T16:49:35.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:35 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/808463419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:35.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:35 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3955714634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:35 smithi144 ceph-mon[35328]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T16:49:35.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:35 smithi144 ceph-mon[35328]: Cluster is now healthy 2024-09-13T16:49:35.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:35 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/808463419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:49:35.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:35 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3955714634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:36.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:36 smithi094 ceph-mon[35259]: pgmap v301: 129 pgs: 9 creating+peering, 118 active+clean, 2 unknown; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-13T16:49:36.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:36 smithi018 ceph-mon[30981]: pgmap v301: 129 pgs: 9 creating+peering, 118 active+clean, 2 unknown; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-13T16:49:36.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:36 smithi144 ceph-mon[35328]: pgmap v301: 129 pgs: 9 creating+peering, 118 active+clean, 2 unknown; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-13T16:49:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.161+0000 7fac16200640 1 -- 172.21.15.18:0/3629360165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac10107330 msgr2=0x7fac1010eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.161+0000 7fac16200640 1 --2- 172.21.15.18:0/3629360165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac10107330 0x7fac1010eeb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fac08009ca0 tx=0x7fac0802a8b0 comp rx=0 tx=0).stop 2024-09-13T16:49:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.161+0000 7fac16200640 1 -- 172.21.15.18:0/3629360165 shutdown_connections 2024-09-13T16:49:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.161+0000 7fac16200640 1 --2- 172.21.15.18:0/3629360165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac10107330 0x7fac1010eeb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.161+0000 7fac16200640 1 --2- 172.21.15.18:0/3629360165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac10102bb0 0x7fac10106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.161+0000 7fac16200640 1 --2- 172.21.15.18:0/3629360165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac10102200 0x7fac101025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.161+0000 7fac16200640 1 -- 172.21.15.18:0/3629360165 >> 172.21.15.18:0/3629360165 conn(0x7fac100fdc40 msgr2=0x7fac10100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.161+0000 7fac16200640 1 -- 172.21.15.18:0/3629360165 shutdown_connections 2024-09-13T16:49:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.161+0000 7fac16200640 1 -- 172.21.15.18:0/3629360165 wait complete. 2024-09-13T16:49:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.162+0000 7fac16200640 1 Processor -- start 2024-09-13T16:49:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac16200640 1 -- start start 2024-09-13T16:49:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac16200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac10102200 0x7fac101984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac16200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac10102bb0 0x7fac10198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac16200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac10107330 0x7fac1019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac16200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1019d420 con 0x7fac10107330 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac16200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1019d590 con 0x7fac10102bb0 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac16200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1019d700 con 0x7fac10102200 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac0fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac10107330 0x7fac1019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac0f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac10102200 0x7fac101984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac0f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac10102200 0x7fac101984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:40860/0 (socket says 172.21.15.18:40860) 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac0f400640 1 -- 172.21.15.18:0/3847864166 learned_addr learned my addr 172.21.15.18:0/3847864166 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.163+0000 7fac0ea00640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac10102bb0 0x7fac10198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac0fe00640 1 -- 172.21.15.18:0/3847864166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac10102200 msgr2=0x7fac101984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac0fe00640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac10102200 0x7fac101984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac0fe00640 1 -- 172.21.15.18:0/3847864166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac10102bb0 msgr2=0x7fac10198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac0fe00640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac10102bb0 0x7fac10198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac0fe00640 1 -- 172.21.15.18:0/3847864166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08009900 con 0x7fac10107330 2024-09-13T16:49:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac0ea00640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac10102bb0 0x7fac10198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac0f400640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac10102200 0x7fac101984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac0fe00640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac10107330 0x7fac1019ce20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac0802aea0 tx=0x7fac08030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac07e00640 1 -- 172.21.15.18:0/3847864166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac080318d0 con 0x7fac10107330 2024-09-13T16:49:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac16200640 1 -- 172.21.15.18:0/3847864166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1019d980 con 0x7fac10107330 2024-09-13T16:49:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac07e00640 1 -- 172.21.15.18:0/3847864166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac0803f070 con 0x7fac10107330 2024-09-13T16:49:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.164+0000 7fac07e00640 1 -- 172.21.15.18:0/3847864166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0803b400 con 0x7fac10107330 2024-09-13T16:49:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.165+0000 7fac16200640 1 -- 172.21.15.18:0/3847864166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac101a52a0 con 0x7fac10107330 2024-09-13T16:49:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.166+0000 7fac16200640 1 -- 172.21.15.18:0/3847864166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac101036e0 con 0x7fac10107330 2024-09-13T16:49:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.167+0000 7fac07e00640 1 -- 172.21.15.18:0/3847864166 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fac0800a040 con 0x7fac10107330 2024-09-13T16:49:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.169+0000 7fac07e00640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fabf40a1100 0x7fabf40a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.169+0000 7fac07e00640 1 -- 172.21.15.18:0/3847864166 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fac08041070 con 0x7fac10107330 2024-09-13T16:49:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.169+0000 7fac0f400640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fabf40a1100 0x7fabf40a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:37.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.170+0000 7fac0f400640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fabf40a1100 0x7fabf40a35c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fac00011550 tx=0x7fac00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:37.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.173+0000 7fac07e00640 1 -- 172.21.15.18:0/3847864166 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fac080b6f40 con 0x7fac10107330 2024-09-13T16:49:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.388+0000 7fac16200640 1 -- 172.21.15.18:0/3847864166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac1010a5a0 con 0x7fac10107330 2024-09-13T16:49:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.389+0000 7fac07e00640 1 -- 172.21.15.18:0/3847864166 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7fac080ba560 con 0x7fac10107330 2024-09-13T16:49:37.390 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T16:49:37.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 -- 172.21.15.18:0/3847864166 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fabf40a1100 msgr2=0x7fabf40a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fabf40a1100 0x7fabf40a35c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fac00011550 tx=0x7fac00005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 -- 172.21.15.18:0/3847864166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac10107330 msgr2=0x7fac1019ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac10107330 0x7fac1019ce20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac0802aea0 tx=0x7fac08030d70 comp rx=0 tx=0).stop 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 -- 172.21.15.18:0/3847864166 shutdown_connections 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fabf40a1100 0x7fabf40a35c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac10107330 0x7fac1019ce20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac10102bb0 0x7fac10198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 --2- 172.21.15.18:0/3847864166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac10102200 0x7fac101984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 -- 172.21.15.18:0/3847864166 >> 172.21.15.18:0/3847864166 conn(0x7fac100fdc40 msgr2=0x7fac100feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 -- 172.21.15.18:0/3847864166 shutdown_connections 2024-09-13T16:49:37.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:37.391+0000 7fac16200640 1 -- 172.21.15.18:0/3847864166 wait complete. 2024-09-13T16:49:37.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:37 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3847864166' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:49:37.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:37 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3847864166' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:49:37.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:37 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3847864166' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:49:38.129 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T16:49:38.129 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T16:49:38.129 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-13T16:49:38.129 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T16:49:38.129 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:49:38.130 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T16:49:38.130 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T16:49:38.130 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T16:49:38.130 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T16:49:38.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:38.130 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-13T16:49:38.167 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:49:38.167 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:49:38.167 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:49:38.167 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:49:38.167 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-13T16:49:38.167 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:49:38.168 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:49:38.168 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:49:38.168 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-13T16:49:38.168 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:49:38.168 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:49:38.168 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-13T16:49:38.168 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T16:49:38.168 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:49:38.168 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-13T16:49:38.169 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T16:49:38.169 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42244sec preferred_lft 42244sec 2024-09-13T16:49:38.169 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-13T16:49:38.169 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:49:38.169 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:49:38.169 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:49:38.169 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-13T16:49:38.170 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T16:49:38.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:38.170 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-09-13T16:49:38.170 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-13T16:49:38.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-09-13T16:49:38.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-09-13T16:49:38.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-09-13T16:49:38.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T16:49:38.170 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-13T16:49:38.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:38.565 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T16:49:38.622 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-13T16:49:38.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:38.625 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-13T16:49:38.678 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-13T16:49:38.679 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T16:49:38.679 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T16:49:38.679 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T16:49:38.679 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T16:49:38.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:38.679 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-09-13T16:49:38.679 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-13T16:49:38.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T16:49:38.680 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T16:49:38.680 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T16:49:38.680 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-13T16:49:38.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:38 smithi018 ceph-mon[30981]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 1 op/s 2024-09-13T16:49:38.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:38 smithi144 ceph-mon[35328]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 1 op/s 2024-09-13T16:49:38.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:38 smithi094 ceph-mon[35259]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 1 op/s 2024-09-13T16:49:39.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:39.226 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-13T16:49:39.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:39.302 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-13T16:49:39.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:39.378 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-09-13T16:49:39.378 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-13T16:49:39.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T16:49:39.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T16:49:39.378 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-13T16:49:39.505 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T16:49:39.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:39.505 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-09-13T16:49:39.505 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-13T16:49:39.505 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T16:49:39.505 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T16:49:39.508 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T16:49:39.508 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T16:49:39.508 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T16:49:39.508 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-13T16:49:39.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:39.817 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-09-13T16:49:39.817 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-13T16:49:39.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-13T16:49:39.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T16:49:39.817 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-13T16:49:39.933 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T16:49:40.006 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:49:40.007 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:49:40.042 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T16:49:40.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:49:40.042 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:49:40.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-09-13T16:49:40.215 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T16:49:40.216 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T16:49:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T16:49:40.272 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T16:49:40.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:40.273 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-09-13T16:49:40.308 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T16:49:40.308 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T16:49:40.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-09-13T16:49:40.408 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T16:49:40.408 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T16:49:40.463 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T16:49:40.465 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T16:49:40.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:40.465 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-09-13T16:49:40.529 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:2024-09-13T16:49:40.527+0000 7ffa66a71480 -1 init, newargv = 0x55a2f3876920 newargc=15 2024-09-13T16:49:40.529 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[74348]: starting ceph client 2024-09-13T16:49:40.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[74348]: starting fuse 2024-09-13T16:49:41.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:40 smithi094 ceph-mon[35259]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 1 op/s 2024-09-13T16:49:41.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:40 smithi018 ceph-mon[30981]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 1 op/s 2024-09-13T16:49:41.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:40 smithi144 ceph-mon[35328]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 1 op/s 2024-09-13T16:49:41.603 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-09-13T16:49:41.669 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T16:49:41.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T16:49:41.726 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T16:49:41.728 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T16:49:41.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:41.729 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-09-13T16:49:41.765 INFO:teuthology.orchestra.run.smithi018.stdout:120 2024-09-13T16:49:41.765 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-13T16:49:41.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> import re 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2024-09-13T16:49:41.766 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> return f 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.admin")) 2024-09-13T16:49:41.767 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-13T16:49:41.931 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.admin.74348.asok 2024-09-13T16:49:41.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:41 smithi018 ceph-mon[30981]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 212 B/s wr, 0 op/s 2024-09-13T16:49:42.114 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74348.asok 2024-09-13T16:49:42.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:42.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74348.asok status 2024-09-13T16:49:42.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:41 smithi094 ceph-mon[35259]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 212 B/s wr, 0 op/s 2024-09-13T16:49:42.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:41 smithi144 ceph-mon[35328]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 212 B/s wr, 0 op/s 2024-09-13T16:49:42.302 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T16:49:42.302 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2024-09-13T16:49:42.302 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "50bbe7f395997dcd871813949c49addbbf630361", 2024-09-13T16:49:42.302 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T16:49:42.302 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "admin", 2024-09-13T16:49:42.302 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2024-09-13T16:49:42.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T16:49:42.302 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "74348", 2024-09-13T16:49:42.302 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2024-09-13T16:49:42.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24716, 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 24716 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-13T16:49:42.303 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3962792775 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3962792775 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.24716 172.21.15.18:0/3962792775", 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "172.21.15.18:0/3962792775", 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 17, 2024-09-13T16:49:42.304 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 89, 2024-09-13T16:49:42.305 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2024-09-13T16:49:42.305 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2024-09-13T16:49:42.305 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2024-09-13T16:49:42.305 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T16:49:42.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:42.314 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2024-09-13T16:49:42.314 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:49:42.350 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2024-09-13T16:49:42.351 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:49:42.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:42.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:49:42.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:42.448 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T16:49:42.505 INFO:teuthology.orchestra.run.smithi018.stdout:# file: . 2024-09-13T16:49:42.505 INFO:teuthology.orchestra.run.smithi018.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T16:49:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:42.506 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:49:42.507 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:49:42.543 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:49:42.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.738+0000 7fd52fe00640 1 -- 172.21.15.18:0/3399189409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5301039a0 msgr2=0x7fd53010a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:42.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.738+0000 7fd52fe00640 1 --2- 172.21.15.18:0/3399189409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5301039a0 0x7fd53010a230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd528009ca0 tx=0x7fd52802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:49:42.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.738+0000 7fd52fe00640 1 -- 172.21.15.18:0/3399189409 shutdown_connections 2024-09-13T16:49:42.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.738+0000 7fd52fe00640 1 --2- 172.21.15.18:0/3399189409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5301039a0 0x7fd53010a230 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:42.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.738+0000 7fd52fe00640 1 --2- 172.21.15.18:0/3399189409 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd530102fe0 0x7fd530103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:42.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.738+0000 7fd52fe00640 1 --2- 172.21.15.18:0/3399189409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530101df0 0x7fd5301021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:42.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.738+0000 7fd52fe00640 1 -- 172.21.15.18:0/3399189409 >> 172.21.15.18:0/3399189409 conn(0x7fd5300fd570 msgr2=0x7fd5300ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:42.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.738+0000 7fd52fe00640 1 -- 172.21.15.18:0/3399189409 shutdown_connections 2024-09-13T16:49:42.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.738+0000 7fd52fe00640 1 -- 172.21.15.18:0/3399189409 wait complete. 2024-09-13T16:49:42.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.739+0000 7fd52fe00640 1 Processor -- start 2024-09-13T16:49:42.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.739+0000 7fd52fe00640 1 -- start start 2024-09-13T16:49:42.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.739+0000 7fd52fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd530101df0 0x7fd530197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.739+0000 7fd52fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd530102fe0 0x7fd530198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.739+0000 7fd52fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5301039a0 0x7fd53019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.739+0000 7fd52fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53019f8b0 con 0x7fd530101df0 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.739+0000 7fd52fe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53019fa20 con 0x7fd530102fe0 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.739+0000 7fd52fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53019fbe0 con 0x7fd5301039a0 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.739+0000 7fd52ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd530101df0 0x7fd530197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.739+0000 7fd52ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd530101df0 0x7fd530197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56744/0 (socket says 172.21.15.18:56744) 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd52ea00640 1 -- 172.21.15.18:0/596422855 learned_addr learned my addr 172.21.15.18:0/596422855 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd52e000640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd530102fe0 0x7fd530198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd52f400640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5301039a0 0x7fd53019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd52ea00640 1 -- 172.21.15.18:0/596422855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5301039a0 msgr2=0x7fd53019f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd52ea00640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5301039a0 0x7fd53019f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd52ea00640 1 -- 172.21.15.18:0/596422855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd530102fe0 msgr2=0x7fd530198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd52ea00640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd530102fe0 0x7fd530198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd52ea00640 1 -- 172.21.15.18:0/596422855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528009900 con 0x7fd530101df0 2024-09-13T16:49:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd52e000640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd530102fe0 0x7fd530198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:49:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd52ea00640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd530101df0 0x7fd530197dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd52000e9c0 tx=0x7fd52000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd527400640 1 -- 172.21.15.18:0/596422855 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5200096e0 con 0x7fd530101df0 2024-09-13T16:49:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd527400640 1 -- 172.21.15.18:0/596422855 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5200044f0 con 0x7fd530101df0 2024-09-13T16:49:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.740+0000 7fd527400640 1 -- 172.21.15.18:0/596422855 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520010430 con 0x7fd530101df0 2024-09-13T16:49:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.741+0000 7fd52fe00640 1 -- 172.21.15.18:0/596422855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53019fec0 con 0x7fd530101df0 2024-09-13T16:49:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.741+0000 7fd52fe00640 1 -- 172.21.15.18:0/596422855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5301a0290 con 0x7fd530101df0 2024-09-13T16:49:42.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.742+0000 7fd52fe00640 1 -- 172.21.15.18:0/596422855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5301021f0 con 0x7fd530101df0 2024-09-13T16:49:42.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.743+0000 7fd527400640 1 -- 172.21.15.18:0/596422855 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd5200035f0 con 0x7fd530101df0 2024-09-13T16:49:42.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.745+0000 7fd527400640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5140a1090 0x7fd5140a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:42.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.745+0000 7fd527400640 1 -- 172.21.15.18:0/596422855 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd520014070 con 0x7fd530101df0 2024-09-13T16:49:42.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.745+0000 7fd52e000640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5140a1090 0x7fd5140a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:42.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.746+0000 7fd52e000640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5140a1090 0x7fd5140a3550 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd5301992d0 tx=0x7fd51c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:42.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.749+0000 7fd527400640 1 -- 172.21.15.18:0/596422855 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd5200d1070 con 0x7fd530101df0 2024-09-13T16:49:42.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.931+0000 7fd52fe00640 1 -- 172.21.15.18:0/596422855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5301092d0 con 0x7fd530101df0 2024-09-13T16:49:42.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.932+0000 7fd527400640 1 -- 172.21.15.18:0/596422855 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23874 (secure 0 0 0) 0x7fd520099f40 con 0x7fd530101df0 2024-09-13T16:49:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:42.936 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:49:32.540261+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:49:42.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.934+0000 7fd52fe00640 1 -- 172.21.15.18:0/596422855 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5140a1090 msgr2=0x7fd5140a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:42.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.934+0000 7fd52fe00640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5140a1090 0x7fd5140a3550 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd5301992d0 tx=0x7fd51c005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:42.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.934+0000 7fd52fe00640 1 -- 172.21.15.18:0/596422855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd530101df0 msgr2=0x7fd530197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:42.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.935+0000 7fd52fe00640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd530101df0 0x7fd530197dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd52000e9c0 tx=0x7fd52000ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:42.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.935+0000 7fd52fe00640 1 -- 172.21.15.18:0/596422855 shutdown_connections 2024-09-13T16:49:42.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.935+0000 7fd52fe00640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5301039a0 0x7fd53019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:42.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.935+0000 7fd52fe00640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd530102fe0 0x7fd530198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:42.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.935+0000 7fd52fe00640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5140a1090 0x7fd5140a3550 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:42.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.935+0000 7fd52fe00640 1 --2- 172.21.15.18:0/596422855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd530101df0 0x7fd530197dc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:42.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.935+0000 7fd52fe00640 1 -- 172.21.15.18:0/596422855 >> 172.21.15.18:0/596422855 conn(0x7fd5300fd570 msgr2=0x7fd5301064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:42.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.935+0000 7fd52fe00640 1 -- 172.21.15.18:0/596422855 shutdown_connections 2024-09-13T16:49:42.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:42.935+0000 7fd52fe00640 1 -- 172.21.15.18:0/596422855 wait complete. 2024-09-13T16:49:42.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:49:26.572697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:49:27.624038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:49:30.629093+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:49:42.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:49:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.112+0000 7fa568c00640 1 -- 172.21.15.18:0/3051312903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa564100f60 msgr2=0x7fa5641013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.112+0000 7fa568c00640 1 --2- 172.21.15.18:0/3051312903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa564100f60 0x7fa5641013e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009900 tx=0x7fa54c02a410 comp rx=0 tx=0).stop 2024-09-13T16:49:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.112+0000 7fa568c00640 1 -- 172.21.15.18:0/3051312903 shutdown_connections 2024-09-13T16:49:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.112+0000 7fa568c00640 1 --2- 172.21.15.18:0/3051312903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa564100f60 0x7fa5641013e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.112+0000 7fa568c00640 1 --2- 172.21.15.18:0/3051312903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa564101920 0x7fa5641081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.112+0000 7fa568c00640 1 --2- 172.21.15.18:0/3051312903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5640ffd70 0x7fa564100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.112+0000 7fa568c00640 1 -- 172.21.15.18:0/3051312903 >> 172.21.15.18:0/3051312903 conn(0x7fa5640fb4d0 msgr2=0x7fa5640fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.112+0000 7fa568c00640 1 -- 172.21.15.18:0/3051312903 shutdown_connections 2024-09-13T16:49:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.112+0000 7fa568c00640 1 -- 172.21.15.18:0/3051312903 wait complete. 2024-09-13T16:49:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa568c00640 1 Processor -- start 2024-09-13T16:49:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa568c00640 1 -- start start 2024-09-13T16:49:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa568c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5640ffd70 0x7fa564197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa568c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa564100f60 0x7fa5641984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa568c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa564101920 0x7fa56419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa568c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56419fa50 con 0x7fa564100f60 2024-09-13T16:49:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa568c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56419fbc0 con 0x7fa564101920 2024-09-13T16:49:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa568c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56419fd80 con 0x7fa5640ffd70 2024-09-13T16:49:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa55be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa564100f60 0x7fa5641984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa562800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa564101920 0x7fa56419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa561e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5640ffd70 0x7fa564197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa55be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa564100f60 0x7fa5641984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56758/0 (socket says 172.21.15.18:56758) 2024-09-13T16:49:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.113+0000 7fa55be00640 1 -- 172.21.15.18:0/1884456911 learned_addr learned my addr 172.21.15.18:0/1884456911 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.114+0000 7fa562800640 1 -- 172.21.15.18:0/1884456911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5640ffd70 msgr2=0x7fa564197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.114+0000 7fa562800640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5640ffd70 0x7fa564197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.114+0000 7fa562800640 1 -- 172.21.15.18:0/1884456911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa564100f60 msgr2=0x7fa5641984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.114+0000 7fa562800640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa564100f60 0x7fa5641984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.114+0000 7fa562800640 1 -- 172.21.15.18:0/1884456911 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c009560 con 0x7fa564101920 2024-09-13T16:49:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.114+0000 7fa562800640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa564101920 0x7fa56419f510 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009fd0 tx=0x7fa55c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.114+0000 7fa55aa00640 1 -- 172.21.15.18:0/1884456911 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c00ce20 con 0x7fa564101920 2024-09-13T16:49:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.114+0000 7fa55aa00640 1 -- 172.21.15.18:0/1884456911 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa55c005020 con 0x7fa564101920 2024-09-13T16:49:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.114+0000 7fa568c00640 1 -- 172.21.15.18:0/1884456911 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5641a0060 con 0x7fa564101920 2024-09-13T16:49:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.114+0000 7fa55aa00640 1 -- 172.21.15.18:0/1884456911 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c010670 con 0x7fa564101920 2024-09-13T16:49:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.115+0000 7fa568c00640 1 -- 172.21.15.18:0/1884456911 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5641a0520 con 0x7fa564101920 2024-09-13T16:49:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.115+0000 7fa568c00640 1 -- 172.21.15.18:0/1884456911 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56410b630 con 0x7fa564101920 2024-09-13T16:49:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.117+0000 7fa55aa00640 1 -- 172.21.15.18:0/1884456911 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa55c005450 con 0x7fa564101920 2024-09-13T16:49:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.119+0000 7fa55aa00640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa5480a1090 0x7fa5480a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.119+0000 7fa55aa00640 1 -- 172.21.15.18:0/1884456911 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa55c014070 con 0x7fa564101920 2024-09-13T16:49:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.119+0000 7fa561e00640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa5480a1090 0x7fa5480a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.120+0000 7fa561e00640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa5480a1090 0x7fa5480a3550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa554005fd0 tx=0x7fa55400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.121+0000 7fa55aa00640 1 -- 172.21.15.18:0/1884456911 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa55c096710 con 0x7fa564101920 2024-09-13T16:49:43.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:42 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/596422855' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:43.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:42 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/596422855' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.300+0000 7fa568c00640 1 -- 172.21.15.18:0/1884456911 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5641a0920 con 0x7fa564101920 2024-09-13T16:49:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.301+0000 7fa55aa00640 1 -- 172.21.15.18:0/1884456911 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa55c099d30 con 0x7fa564101920 2024-09-13T16:49:43.303 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T16:49:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 -- 172.21.15.18:0/1884456911 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa5480a1090 msgr2=0x7fa5480a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa5480a1090 0x7fa5480a3550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa554005fd0 tx=0x7fa55400b390 comp rx=0 tx=0).stop 2024-09-13T16:49:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 -- 172.21.15.18:0/1884456911 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa564101920 msgr2=0x7fa56419f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa564101920 0x7fa56419f510 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009fd0 tx=0x7fa55c00ef10 comp rx=0 tx=0).stop 2024-09-13T16:49:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 -- 172.21.15.18:0/1884456911 shutdown_connections 2024-09-13T16:49:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa5480a1090 0x7fa5480a3550 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa564100f60 0x7fa5641984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa564101920 0x7fa56419f510 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 --2- 172.21.15.18:0/1884456911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5640ffd70 0x7fa564197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 -- 172.21.15.18:0/1884456911 >> 172.21.15.18:0/1884456911 conn(0x7fa5640fb4d0 msgr2=0x7fa5641067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 -- 172.21.15.18:0/1884456911 shutdown_connections 2024-09-13T16:49:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.303+0000 7fa568c00640 1 -- 172.21.15.18:0/1884456911 wait complete. 2024-09-13T16:49:43.321 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:49:43.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:42 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/596422855' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:43.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.479+0000 7fa1aee00640 1 -- 172.21.15.18:0/4241826759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a8103a40 msgr2=0x7fa1a810a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.479+0000 7fa1aee00640 1 --2- 172.21.15.18:0/4241826759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a8103a40 0x7fa1a810a360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009be0 tx=0x7fa1a002a6c0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.479+0000 7fa1aee00640 1 -- 172.21.15.18:0/4241826759 shutdown_connections 2024-09-13T16:49:43.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.479+0000 7fa1aee00640 1 --2- 172.21.15.18:0/4241826759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a8103a40 0x7fa1a810a360 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.479+0000 7fa1aee00640 1 --2- 172.21.15.18:0/4241826759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1a8103080 0x7fa1a8103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.479+0000 7fa1aee00640 1 --2- 172.21.15.18:0/4241826759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1a8101ea0 0x7fa1a81022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.479+0000 7fa1aee00640 1 -- 172.21.15.18:0/4241826759 >> 172.21.15.18:0/4241826759 conn(0x7fa1a80fd670 msgr2=0x7fa1a80ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:43.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.479+0000 7fa1aee00640 1 -- 172.21.15.18:0/4241826759 shutdown_connections 2024-09-13T16:49:43.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.479+0000 7fa1aee00640 1 -- 172.21.15.18:0/4241826759 wait complete. 2024-09-13T16:49:43.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.480+0000 7fa1aee00640 1 Processor -- start 2024-09-13T16:49:43.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.480+0000 7fa1aee00640 1 -- start start 2024-09-13T16:49:43.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.480+0000 7fa1aee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1a8101ea0 0x7fa1a8197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.480+0000 7fa1aee00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1a8103080 0x7fa1a8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.480+0000 7fa1aee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a8103a40 0x7fa1a819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.480+0000 7fa1aee00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a819f9e0 con 0x7fa1a8101ea0 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.480+0000 7fa1aee00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a819fb50 con 0x7fa1a8103080 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.480+0000 7fa1aee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a819fd10 con 0x7fa1a8103a40 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ada00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1a8101ea0 0x7fa1a8197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ae400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a8103a40 0x7fa1a819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ad000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1a8103080 0x7fa1a8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ada00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1a8101ea0 0x7fa1a8197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56766/0 (socket says 172.21.15.18:56766) 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ada00640 1 -- 172.21.15.18:0/3522885307 learned_addr learned my addr 172.21.15.18:0/3522885307 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ae400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a8103a40 0x7fa1a819f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:45592/0 (socket says 172.21.15.18:45592) 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ada00640 1 -- 172.21.15.18:0/3522885307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a8103a40 msgr2=0x7fa1a819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ada00640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a8103a40 0x7fa1a819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ada00640 1 -- 172.21.15.18:0/3522885307 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1a8103080 msgr2=0x7fa1a8198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ada00640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1a8103080 0x7fa1a8198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ada00640 1 -- 172.21.15.18:0/3522885307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a0009840 con 0x7fa1a8101ea0 2024-09-13T16:49:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1ada00640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1a8101ea0 0x7fa1a8197ef0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e9f0 tx=0x7fa19c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.481+0000 7fa1a6000640 1 -- 172.21.15.18:0/3522885307 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00ccc0 con 0x7fa1a8101ea0 2024-09-13T16:49:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.482+0000 7fa1a6000640 1 -- 172.21.15.18:0/3522885307 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa19c00ce20 con 0x7fa1a8101ea0 2024-09-13T16:49:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.482+0000 7fa1aee00640 1 -- 172.21.15.18:0/3522885307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a819fff0 con 0x7fa1a8101ea0 2024-09-13T16:49:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.482+0000 7fa1a6000640 1 -- 172.21.15.18:0/3522885307 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c010430 con 0x7fa1a8101ea0 2024-09-13T16:49:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.482+0000 7fa1aee00640 1 -- 172.21.15.18:0/3522885307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a81a0470 con 0x7fa1a8101ea0 2024-09-13T16:49:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.483+0000 7fa1aee00640 1 -- 172.21.15.18:0/3522885307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a8109350 con 0x7fa1a8101ea0 2024-09-13T16:49:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.485+0000 7fa1a6000640 1 -- 172.21.15.18:0/3522885307 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa19c003f20 con 0x7fa1a8101ea0 2024-09-13T16:49:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.486+0000 7fa1a6000640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1900a1110 0x7fa1900a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.486+0000 7fa1a6000640 1 -- 172.21.15.18:0/3522885307 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa19c014070 con 0x7fa1a8101ea0 2024-09-13T16:49:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.486+0000 7fa1ad000640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1900a1110 0x7fa1900a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.487+0000 7fa1ad000640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1900a1110 0x7fa1900a35d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8199400 tx=0x7fa19400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.490+0000 7fa1a6000640 1 -- 172.21.15.18:0/3522885307 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa19c096250 con 0x7fa1a8101ea0 2024-09-13T16:49:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.673+0000 7fa1aee00640 1 -- 172.21.15.18:0/3522885307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1a810d7b0 con 0x7fa1a8101ea0 2024-09-13T16:49:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.674+0000 7fa1a6000640 1 -- 172.21.15.18:0/3522885307 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa19c099870 con 0x7fa1a8101ea0 2024-09-13T16:49:43.676 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:49:43.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.676+0000 7fa1aee00640 1 -- 172.21.15.18:0/3522885307 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1900a1110 msgr2=0x7fa1900a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.676+0000 7fa1aee00640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1900a1110 0x7fa1900a35d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8199400 tx=0x7fa19400b410 comp rx=0 tx=0).stop 2024-09-13T16:49:43.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.676+0000 7fa1aee00640 1 -- 172.21.15.18:0/3522885307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1a8101ea0 msgr2=0x7fa1a8197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.676+0000 7fa1aee00640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1a8101ea0 0x7fa1a8197ef0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e9f0 tx=0x7fa19c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.676+0000 7fa1aee00640 1 -- 172.21.15.18:0/3522885307 shutdown_connections 2024-09-13T16:49:43.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.676+0000 7fa1aee00640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a8103a40 0x7fa1a819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.676+0000 7fa1aee00640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1a8103080 0x7fa1a8198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.676+0000 7fa1aee00640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1900a1110 0x7fa1900a35d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.676+0000 7fa1aee00640 1 --2- 172.21.15.18:0/3522885307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1a8101ea0 0x7fa1a8197ef0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.676+0000 7fa1aee00640 1 -- 172.21.15.18:0/3522885307 >> 172.21.15.18:0/3522885307 conn(0x7fa1a80fd670 msgr2=0x7fa1a8106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:43.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.677+0000 7fa1aee00640 1 -- 172.21.15.18:0/3522885307 shutdown_connections 2024-09-13T16:49:43.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.677+0000 7fa1aee00640 1 -- 172.21.15.18:0/3522885307 wait complete. 2024-09-13T16:49:43.694 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:49:43.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.851+0000 7f5a2e000640 1 -- 172.21.15.18:0/3020092749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a28103b30 msgr2=0x7f5a2810a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.851+0000 7f5a2e000640 1 --2- 172.21.15.18:0/3020092749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a28103b30 0x7f5a2810a3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009ca0 tx=0x7f5a2002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.851+0000 7f5a2e000640 1 -- 172.21.15.18:0/3020092749 shutdown_connections 2024-09-13T16:49:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.851+0000 7f5a2e000640 1 --2- 172.21.15.18:0/3020092749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a28103b30 0x7f5a2810a3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.851+0000 7f5a2e000640 1 --2- 172.21.15.18:0/3020092749 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a28103170 0x7f5a281035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.851+0000 7f5a2e000640 1 --2- 172.21.15.18:0/3020092749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a28101f80 0x7f5a28102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.851+0000 7f5a2e000640 1 -- 172.21.15.18:0/3020092749 >> 172.21.15.18:0/3020092749 conn(0x7f5a280fd700 msgr2=0x7f5a280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.851+0000 7f5a2e000640 1 -- 172.21.15.18:0/3020092749 shutdown_connections 2024-09-13T16:49:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.851+0000 7f5a2e000640 1 -- 172.21.15.18:0/3020092749 wait complete. 2024-09-13T16:49:43.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.852+0000 7f5a2e000640 1 Processor -- start 2024-09-13T16:49:43.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.852+0000 7f5a2e000640 1 -- start start 2024-09-13T16:49:43.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.852+0000 7f5a2e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a28101f80 0x7f5a28197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.852+0000 7f5a2e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a28103170 0x7f5a281984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.852+0000 7f5a2e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a28103b30 0x7f5a2819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.852+0000 7f5a2e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2819fa40 con 0x7f5a28103170 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.852+0000 7f5a2e000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2819fbb0 con 0x7f5a28103b30 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.852+0000 7f5a2e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2819fd70 con 0x7f5a28101f80 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a1ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a28103170 0x7f5a281984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a1ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a28103170 0x7f5a281984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56784/0 (socket says 172.21.15.18:56784) 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a1ea00640 1 -- 172.21.15.18:0/2958784420 learned_addr learned my addr 172.21.15.18:0/2958784420 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a27400640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a28101f80 0x7f5a28197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a27e00640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a28103b30 0x7f5a2819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a1ea00640 1 -- 172.21.15.18:0/2958784420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a28101f80 msgr2=0x7f5a28197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a1ea00640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a28101f80 0x7f5a28197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a1ea00640 1 -- 172.21.15.18:0/2958784420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a28103b30 msgr2=0x7f5a2819f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a1ea00640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a28103b30 0x7f5a2819f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a1ea00640 1 -- 172.21.15.18:0/2958784420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a10009490 con 0x7f5a28103170 2024-09-13T16:49:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a27400640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a28101f80 0x7f5a28197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a27e00640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a28103b30 0x7f5a2819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:49:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.853+0000 7f5a1ea00640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a28103170 0x7f5a281984e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000ea60 tx=0x7f5a1000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.854+0000 7f5a24c00640 1 -- 172.21.15.18:0/2958784420 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000cde0 con 0x7f5a28103170 2024-09-13T16:49:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.854+0000 7f5a24c00640 1 -- 172.21.15.18:0/2958784420 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a100035f0 con 0x7f5a28103170 2024-09-13T16:49:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.854+0000 7f5a24c00640 1 -- 172.21.15.18:0/2958784420 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100044e0 con 0x7f5a28103170 2024-09-13T16:49:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.854+0000 7f5a2e000640 1 -- 172.21.15.18:0/2958784420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a20009900 con 0x7f5a28103170 2024-09-13T16:49:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.854+0000 7f5a2e000640 1 -- 172.21.15.18:0/2958784420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a281a02f0 con 0x7f5a28103170 2024-09-13T16:49:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.855+0000 7f5a2e000640 1 -- 172.21.15.18:0/2958784420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a281093c0 con 0x7f5a28103170 2024-09-13T16:49:43.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.857+0000 7f5a24c00640 1 -- 172.21.15.18:0/2958784420 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5a10003a60 con 0x7f5a28103170 2024-09-13T16:49:43.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.859+0000 7f5a24c00640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5a0c0a1110 0x7f5a0c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:43.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.859+0000 7f5a24c00640 1 -- 172.21.15.18:0/2958784420 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5a10014070 con 0x7f5a28103170 2024-09-13T16:49:43.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.859+0000 7f5a27400640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5a0c0a1110 0x7f5a0c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:43.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.860+0000 7f5a27400640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5a0c0a1110 0x7f5a0c0a35d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5a28102fd0 tx=0x7f5a18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:43.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:43.862+0000 7f5a24c00640 1 -- 172.21.15.18:0/2958784420 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5a10096540 con 0x7f5a28103170 2024-09-13T16:49:44.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.046+0000 7f5a2e000640 1 -- 172.21.15.18:0/2958784420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a2802c4e0 con 0x7f5a28103170 2024-09-13T16:49:44.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.046+0000 7f5a24c00640 1 -- 172.21.15.18:0/2958784420 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a10099b60 con 0x7f5a28103170 2024-09-13T16:49:44.049 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.048+0000 7f5a2e000640 1 -- 172.21.15.18:0/2958784420 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5a0c0a1110 msgr2=0x7f5a0c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.048+0000 7f5a2e000640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5a0c0a1110 0x7f5a0c0a35d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5a28102fd0 tx=0x7f5a18005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.048+0000 7f5a2e000640 1 -- 172.21.15.18:0/2958784420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a28103170 msgr2=0x7f5a281984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.048+0000 7f5a2e000640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a28103170 0x7f5a281984e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000ea60 tx=0x7f5a1000ef20 comp rx=0 tx=0).stop 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.048+0000 7f5a2e000640 1 -- 172.21.15.18:0/2958784420 shutdown_connections 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.048+0000 7f5a2e000640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5a0c0a1110 0x7f5a0c0a35d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.048+0000 7f5a2e000640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a28103170 0x7f5a281984e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.048+0000 7f5a2e000640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a28103b30 0x7f5a2819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.048+0000 7f5a2e000640 1 --2- 172.21.15.18:0/2958784420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a28101f80 0x7f5a28197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.048+0000 7f5a2e000640 1 -- 172.21.15.18:0/2958784420 >> 172.21.15.18:0/2958784420 conn(0x7f5a280fd700 msgr2=0x7f5a28106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:44.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.049+0000 7f5a2e000640 1 -- 172.21.15.18:0/2958784420 shutdown_connections 2024-09-13T16:49:44.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.049+0000 7f5a2e000640 1 -- 172.21.15.18:0/2958784420 wait complete. 2024-09-13T16:49:44.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:49:44.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.233+0000 7f5481a00640 1 -- 172.21.15.18:0/2765932408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c103b30 msgr2=0x7f547c10a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.233+0000 7f5481a00640 1 --2- 172.21.15.18:0/2765932408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c103b30 0x7f547c10a3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5474009ca0 tx=0x7f547402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.233+0000 7f5481a00640 1 -- 172.21.15.18:0/2765932408 shutdown_connections 2024-09-13T16:49:44.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.233+0000 7f5481a00640 1 --2- 172.21.15.18:0/2765932408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c103b30 0x7f547c10a3c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.233+0000 7f5481a00640 1 --2- 172.21.15.18:0/2765932408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f547c103170 0x7f547c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.233+0000 7f5481a00640 1 --2- 172.21.15.18:0/2765932408 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f547c101f80 0x7f547c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.233+0000 7f5481a00640 1 -- 172.21.15.18:0/2765932408 >> 172.21.15.18:0/2765932408 conn(0x7f547c0fd700 msgr2=0x7f547c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:44.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.233+0000 7f5481a00640 1 -- 172.21.15.18:0/2765932408 shutdown_connections 2024-09-13T16:49:44.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.233+0000 7f5481a00640 1 -- 172.21.15.18:0/2765932408 wait complete. 2024-09-13T16:49:44.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.234+0000 7f5481a00640 1 Processor -- start 2024-09-13T16:49:44.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.234+0000 7f5481a00640 1 -- start start 2024-09-13T16:49:44.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.234+0000 7f5481a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f547c101f80 0x7f547c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:44.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.234+0000 7f5481a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c103170 0x7f547c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:44.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.234+0000 7f5481a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f547c103b30 0x7f547c19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:44.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.234+0000 7f5481a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c19fa20 con 0x7f547c103170 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.234+0000 7f5481a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c19fb90 con 0x7f547c101f80 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.234+0000 7f5481a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c19fd50 con 0x7f547c103b30 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c103170 0x7f547c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c103170 0x7f547c1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56810/0 (socket says 172.21.15.18:56810) 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547a000640 1 -- 172.21.15.18:0/1584949433 learned_addr learned my addr 172.21.15.18:0/1584949433 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547b400640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f547c103b30 0x7f547c19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547aa00640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f547c101f80 0x7f547c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547a000640 1 -- 172.21.15.18:0/1584949433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f547c103b30 msgr2=0x7f547c19f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547a000640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f547c103b30 0x7f547c19f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547a000640 1 -- 172.21.15.18:0/1584949433 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f547c101f80 msgr2=0x7f547c197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547a000640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f547c101f80 0x7f547c197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547a000640 1 -- 172.21.15.18:0/1584949433 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5474009900 con 0x7f547c103170 2024-09-13T16:49:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.235+0000 7f547a000640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c103170 0x7f547c1984c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f546800e9f0 tx=0x7f546800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:44.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.236+0000 7f5473400640 1 -- 172.21.15.18:0/1584949433 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468009700 con 0x7f547c103170 2024-09-13T16:49:44.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.236+0000 7f5473400640 1 -- 172.21.15.18:0/1584949433 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f546800cd80 con 0x7f547c103170 2024-09-13T16:49:44.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.236+0000 7f5481a00640 1 -- 172.21.15.18:0/1584949433 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c19ffd0 con 0x7f547c103170 2024-09-13T16:49:44.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.236+0000 7f5473400640 1 -- 172.21.15.18:0/1584949433 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468018860 con 0x7f547c103170 2024-09-13T16:49:44.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.236+0000 7f5481a00640 1 -- 172.21.15.18:0/1584949433 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c1a0500 con 0x7f547c103170 2024-09-13T16:49:44.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.237+0000 7f5481a00640 1 -- 172.21.15.18:0/1584949433 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c1093c0 con 0x7f547c103170 2024-09-13T16:49:44.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.239+0000 7f5473400640 1 -- 172.21.15.18:0/1584949433 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f54680189c0 con 0x7f547c103170 2024-09-13T16:49:44.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.240+0000 7f5473400640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f54600a1110 0x7f54600a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:44.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.240+0000 7f5473400640 1 -- 172.21.15.18:0/1584949433 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5468014070 con 0x7f547c103170 2024-09-13T16:49:44.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.240+0000 7f547aa00640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f54600a1110 0x7f54600a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.241+0000 7f547aa00640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f54600a1110 0x7f54600a35d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f547c102fd0 tx=0x7f546c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.244+0000 7f5473400640 1 -- 172.21.15.18:0/1584949433 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5468052e20 con 0x7f547c103170 2024-09-13T16:49:44.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:43 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1884456911' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:49:44.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:43 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3522885307' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:49:44.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:43 smithi144 ceph-mon[35328]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 182 B/s wr, 0 op/s 2024-09-13T16:49:44.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:43 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1884456911' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:49:44.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:43 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3522885307' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:49:44.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:43 smithi094 ceph-mon[35259]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 182 B/s wr, 0 op/s 2024-09-13T16:49:44.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.425+0000 7f5481a00640 1 -- 172.21.15.18:0/1584949433 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f547c02c480 con 0x7f547c103170 2024-09-13T16:49:44.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.426+0000 7f5473400640 1 -- 172.21.15.18:0/1584949433 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5468096390 con 0x7f547c103170 2024-09-13T16:49:44.428 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:49:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 -- 172.21.15.18:0/1584949433 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f54600a1110 msgr2=0x7f54600a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f54600a1110 0x7f54600a35d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f547c102fd0 tx=0x7f546c00b390 comp rx=0 tx=0).stop 2024-09-13T16:49:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 -- 172.21.15.18:0/1584949433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c103170 msgr2=0x7f547c1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c103170 0x7f547c1984c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f546800e9f0 tx=0x7f546800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 -- 172.21.15.18:0/1584949433 shutdown_connections 2024-09-13T16:49:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f54600a1110 0x7f54600a35d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c103170 0x7f547c1984c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f547c103b30 0x7f547c19f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 --2- 172.21.15.18:0/1584949433 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f547c101f80 0x7f547c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 -- 172.21.15.18:0/1584949433 >> 172.21.15.18:0/1584949433 conn(0x7f547c0fd700 msgr2=0x7f547c106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 -- 172.21.15.18:0/1584949433 shutdown_connections 2024-09-13T16:49:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.428+0000 7f5481a00640 1 -- 172.21.15.18:0/1584949433 wait complete. 2024-09-13T16:49:44.443 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:43 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1884456911' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:49:44.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:43 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3522885307' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:49:44.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:43 smithi018 ceph-mon[30981]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 182 B/s wr, 0 op/s 2024-09-13T16:49:44.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:49:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.601+0000 7f16bb200640 1 -- 172.21.15.18:0/3807715960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16b4106710 msgr2=0x7f16b4106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.601+0000 7f16bb200640 1 --2- 172.21.15.18:0/3807715960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16b4106710 0x7f16b4106b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009930 tx=0x7f16a402a420 comp rx=0 tx=0).stop 2024-09-13T16:49:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.601+0000 7f16bb200640 1 -- 172.21.15.18:0/3807715960 shutdown_connections 2024-09-13T16:49:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.601+0000 7f16bb200640 1 --2- 172.21.15.18:0/3807715960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4107fb0 0x7f16b410e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.601+0000 7f16bb200640 1 --2- 172.21.15.18:0/3807715960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16b41075f0 0x7f16b4107a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.601+0000 7f16bb200640 1 --2- 172.21.15.18:0/3807715960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16b4106710 0x7f16b4106b10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.601+0000 7f16bb200640 1 -- 172.21.15.18:0/3807715960 >> 172.21.15.18:0/3807715960 conn(0x7f16b4075570 msgr2=0x7f16b40779b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.601+0000 7f16bb200640 1 -- 172.21.15.18:0/3807715960 shutdown_connections 2024-09-13T16:49:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.601+0000 7f16bb200640 1 -- 172.21.15.18:0/3807715960 wait complete. 2024-09-13T16:49:44.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.602+0000 7f16bb200640 1 Processor -- start 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.602+0000 7f16bb200640 1 -- start start 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16bb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4106710 0x7f16b419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16bb200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16b41075f0 0x7f16b419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16bb200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16b4107fb0 0x7f16b41a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16bb200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b41a3f30 con 0x7f16b4107fb0 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16bb200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b41a40a0 con 0x7f16b41075f0 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16bb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b41a4260 con 0x7f16b4106710 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16b41075f0 0x7f16b419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16b4107fb0 0x7f16b41a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4106710 0x7f16b419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16b4107fb0 0x7f16b41a39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56816/0 (socket says 172.21.15.18:56816) 2024-09-13T16:49:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b9200640 1 -- 172.21.15.18:0/3207767193 learned_addr learned my addr 172.21.15.18:0/3207767193 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16b41075f0 0x7f16b419c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:37084/0 (socket says 172.21.15.18:37084) 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b9200640 1 -- 172.21.15.18:0/3207767193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4106710 msgr2=0x7f16b419c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b9200640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4106710 0x7f16b419c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b9200640 1 -- 172.21.15.18:0/3207767193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16b41075f0 msgr2=0x7f16b419c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b9200640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16b41075f0 0x7f16b419c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.603+0000 7f16b9200640 1 -- 172.21.15.18:0/3207767193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a4009560 con 0x7f16b4107fb0 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.604+0000 7f16b9200640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16b4107fb0 0x7f16b41a39f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00eb10 tx=0x7f16ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.604+0000 7f16b0c00640 1 -- 172.21.15.18:0/3207767193 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac004b20 con 0x7f16b4107fb0 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.604+0000 7f16b0c00640 1 -- 172.21.15.18:0/3207767193 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16ac004c80 con 0x7f16b4107fb0 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.604+0000 7f16b0c00640 1 -- 172.21.15.18:0/3207767193 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac010690 con 0x7f16b4107fb0 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.604+0000 7f16bb200640 1 -- 172.21.15.18:0/3207767193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b41a4540 con 0x7f16b4107fb0 2024-09-13T16:49:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.604+0000 7f16bb200640 1 -- 172.21.15.18:0/3207767193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b41a4a00 con 0x7f16b4107fb0 2024-09-13T16:49:44.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.605+0000 7f16bb200640 1 -- 172.21.15.18:0/3207767193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b410d830 con 0x7f16b4107fb0 2024-09-13T16:49:44.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.607+0000 7f16b0c00640 1 -- 172.21.15.18:0/3207767193 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f16ac005020 con 0x7f16b4107fb0 2024-09-13T16:49:44.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.608+0000 7f16b0c00640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16980a1090 0x7f16980a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:44.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.609+0000 7f16b0c00640 1 -- 172.21.15.18:0/3207767193 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f16ac014070 con 0x7f16b4107fb0 2024-09-13T16:49:44.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.609+0000 7f16b3e00640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16980a1090 0x7f16980a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:44.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.609+0000 7f16b3e00640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16980a1090 0x7f16980a3550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009230 tx=0x7f16a4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:44.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.612+0000 7f16b0c00640 1 -- 172.21.15.18:0/3207767193 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f16ac0965e0 con 0x7f16b4107fb0 2024-09-13T16:49:44.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.805+0000 7f16bb200640 1 -- 172.21.15.18:0/3207767193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f16b4111d50 con 0x7f16b4107fb0 2024-09-13T16:49:44.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.805+0000 7f16b0c00640 1 -- 172.21.15.18:0/3207767193 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+588 (secure 0 0 0) 0x7f16ac099c00 con 0x7f16b4107fb0 2024-09-13T16:49:44.808 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/920683112 2024-09-14T16:42:11.669513+0000 2024-09-13T16:49:44.808 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/920683112 2024-09-14T16:42:11.669513+0000 2024-09-13T16:49:44.808 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3837246804 2024-09-14T16:42:11.669513+0000 2024-09-13T16:49:44.809 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4227001658 2024-09-14T16:42:11.669513+0000 2024-09-13T16:49:44.809 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2737842128 2024-09-14T16:41:44.259356+0000 2024-09-13T16:49:44.809 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/295009687 2024-09-14T16:41:44.259356+0000 2024-09-13T16:49:44.809 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1872401951 2024-09-14T16:41:44.259356+0000 2024-09-13T16:49:44.809 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/1236399643 2024-09-14T16:41:44.259356+0000 2024-09-13T16:49:44.809 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/237199304 2024-09-14T16:42:11.669513+0000 2024-09-13T16:49:44.810 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/1236399643 2024-09-14T16:41:44.259356+0000 2024-09-13T16:49:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:listed 10 entries 2024-09-13T16:49:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 -- 172.21.15.18:0/3207767193 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16980a1090 msgr2=0x7f16980a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16980a1090 0x7f16980a3550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009230 tx=0x7f16a4031400 comp rx=0 tx=0).stop 2024-09-13T16:49:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 -- 172.21.15.18:0/3207767193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16b4107fb0 msgr2=0x7f16b41a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16b4107fb0 0x7f16b41a39f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00eb10 tx=0x7f16ac00c2d0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 -- 172.21.15.18:0/3207767193 shutdown_connections 2024-09-13T16:49:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16980a1090 0x7f16980a3550 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16b4107fb0 0x7f16b41a39f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16b41075f0 0x7f16b419c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 --2- 172.21.15.18:0/3207767193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4106710 0x7f16b419c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:44.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 -- 172.21.15.18:0/3207767193 >> 172.21.15.18:0/3207767193 conn(0x7f16b4075570 msgr2=0x7f16b410aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:44.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 -- 172.21.15.18:0/3207767193 shutdown_connections 2024-09-13T16:49:44.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:44.807+0000 7f16bb200640 1 -- 172.21.15.18:0/3207767193 wait complete. 2024-09-13T16:49:44.826 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:49:44.826 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:49:44.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:49:45.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.056+0000 7f0aecc00640 1 -- 172.21.15.18:0/2288814941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae80fe070 msgr2=0x7f0ae80fe470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.056+0000 7f0aecc00640 1 --2- 172.21.15.18:0/2288814941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae80fe070 0x7f0ae80fe470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009860 tx=0x7f0ad802a340 comp rx=0 tx=0).stop 2024-09-13T16:49:45.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.056+0000 7f0aecc00640 1 -- 172.21.15.18:0/2288814941 shutdown_connections 2024-09-13T16:49:45.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.056+0000 7f0aecc00640 1 --2- 172.21.15.18:0/2288814941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ae80ff790 0x7f0ae8100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.056+0000 7f0aecc00640 1 --2- 172.21.15.18:0/2288814941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae80fedd0 0x7f0ae80ff250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.056+0000 7f0aecc00640 1 --2- 172.21.15.18:0/2288814941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae80fe070 0x7f0ae80fe470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.056+0000 7f0aecc00640 1 -- 172.21.15.18:0/2288814941 >> 172.21.15.18:0/2288814941 conn(0x7f0ae80f9bb0 msgr2=0x7f0ae80fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:45.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.056+0000 7f0aecc00640 1 -- 172.21.15.18:0/2288814941 shutdown_connections 2024-09-13T16:49:45.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.056+0000 7f0aecc00640 1 -- 172.21.15.18:0/2288814941 wait complete. 2024-09-13T16:49:45.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.057+0000 7f0aecc00640 1 Processor -- start 2024-09-13T16:49:45.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.057+0000 7f0aecc00640 1 -- start start 2024-09-13T16:49:45.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0aecc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ae80fe070 0x7f0ae8198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0aecc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae80fedd0 0x7f0ae8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0aecc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae80ff790 0x7f0ae819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0aecc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae819fb20 con 0x7f0ae80fe070 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0aecc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae819fc90 con 0x7f0ae80ff790 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0aecc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae819fe50 con 0x7f0ae80fedd0 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0ae5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ae80fe070 0x7f0ae8198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0adfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae80fedd0 0x7f0ae8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0ae5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ae80fe070 0x7f0ae8198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56828/0 (socket says 172.21.15.18:56828) 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0ae5e00640 1 -- 172.21.15.18:0/335038359 learned_addr learned my addr 172.21.15.18:0/335038359 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0ae6800640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae80ff790 0x7f0ae819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0ae5e00640 1 -- 172.21.15.18:0/335038359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae80fedd0 msgr2=0x7f0ae8198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0ae5e00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae80fedd0 0x7f0ae8198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0ae5e00640 1 -- 172.21.15.18:0/335038359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae80ff790 msgr2=0x7f0ae819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0ae5e00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae80ff790 0x7f0ae819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.058+0000 7f0ae5e00640 1 -- 172.21.15.18:0/335038359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae0009900 con 0x7f0ae80fe070 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.059+0000 7f0ae5e00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ae80fe070 0x7f0ae8198030 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80057c0 tx=0x7f0ad8032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:45.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.059+0000 7f0adea00640 1 -- 172.21.15.18:0/335038359 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8030890 con 0x7f0ae80fe070 2024-09-13T16:49:45.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.059+0000 7f0aecc00640 1 -- 172.21.15.18:0/335038359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad8009490 con 0x7f0ae80fe070 2024-09-13T16:49:45.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.059+0000 7f0adea00640 1 -- 172.21.15.18:0/335038359 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ad8004510 con 0x7f0ae80fe070 2024-09-13T16:49:45.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.059+0000 7f0adea00640 1 -- 172.21.15.18:0/335038359 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80048c0 con 0x7f0ae80fe070 2024-09-13T16:49:45.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.059+0000 7f0aecc00640 1 -- 172.21.15.18:0/335038359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae81a03f0 con 0x7f0ae80fe070 2024-09-13T16:49:45.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.060+0000 7f0aecc00640 1 -- 172.21.15.18:0/335038359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae8109e50 con 0x7f0ae80fe070 2024-09-13T16:49:45.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.062+0000 7f0adea00640 1 -- 172.21.15.18:0/335038359 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0ad8004a20 con 0x7f0ae80fe070 2024-09-13T16:49:45.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.064+0000 7f0adea00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0acc0a1090 0x7f0acc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.064+0000 7f0adea00640 1 -- 172.21.15.18:0/335038359 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0ad80ed480 con 0x7f0ae80fe070 2024-09-13T16:49:45.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.064+0000 7f0adfe00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0acc0a1090 0x7f0acc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.065+0000 7f0adfe00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0acc0a1090 0x7f0acc0a3550 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8199540 tx=0x7f0ad0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:45.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.069+0000 7f0adea00640 1 -- 172.21.15.18:0/335038359 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0ad80b69c0 con 0x7f0ae80fe070 2024-09-13T16:49:45.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:44 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2958784420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:49:45.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:44 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1584949433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:49:45.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:44 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3207767193' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:49:45.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.251+0000 7f0aecc00640 1 -- 172.21.15.18:0/335038359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ae81098c0 con 0x7f0ae80fe070 2024-09-13T16:49:45.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.252+0000 7f0adea00640 1 -- 172.21.15.18:0/335038359 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23874 (secure 0 0 0) 0x7f0ad80b9fe0 con 0x7f0ae80fe070 2024-09-13T16:49:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:45.256 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:49:32.540261+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:49:45.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 -- 172.21.15.18:0/335038359 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0acc0a1090 msgr2=0x7f0acc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0acc0a1090 0x7f0acc0a3550 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8199540 tx=0x7f0ad0005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:45.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 -- 172.21.15.18:0/335038359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ae80fe070 msgr2=0x7f0ae8198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ae80fe070 0x7f0ae8198030 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80057c0 tx=0x7f0ad8032d20 comp rx=0 tx=0).stop 2024-09-13T16:49:45.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 -- 172.21.15.18:0/335038359 shutdown_connections 2024-09-13T16:49:45.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ae80ff790 0x7f0ae819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae80fedd0 0x7f0ae8198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0acc0a1090 0x7f0acc0a3550 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 --2- 172.21.15.18:0/335038359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ae80fe070 0x7f0ae8198030 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 -- 172.21.15.18:0/335038359 >> 172.21.15.18:0/335038359 conn(0x7f0ae80f9bb0 msgr2=0x7f0ae80fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:45.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 -- 172.21.15.18:0/335038359 shutdown_connections 2024-09-13T16:49:45.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.255+0000 7f0aecc00640 1 -- 172.21.15.18:0/335038359 wait complete. 2024-09-13T16:49:45.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:44 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2958784420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:49:45.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:44 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1584949433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:49:45.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:44 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3207767193' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:49:45.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:49:26.572697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:49:27.624038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:49:30.629093+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:49:45.274 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:49:45.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:44 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2958784420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:49:45.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:44 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1584949433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:49:45.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:44 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3207767193' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:49:45.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.431+0000 7f92ec600640 1 -- 172.21.15.18:0/2726717432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92e4103120 msgr2=0x7f92e4105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.431+0000 7f92ec600640 1 --2- 172.21.15.18:0/2726717432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92e4103120 0x7f92e4105510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009900 tx=0x7f92d002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.431+0000 7f92ec600640 1 -- 172.21.15.18:0/2726717432 shutdown_connections 2024-09-13T16:49:45.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.431+0000 7f92ec600640 1 --2- 172.21.15.18:0/2726717432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92e4103120 0x7f92e4105510 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.431+0000 7f92ec600640 1 --2- 172.21.15.18:0/2726717432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e4105a50 0x7f92e4107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.431+0000 7f92ec600640 1 --2- 172.21.15.18:0/2726717432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e41007f0 0x7f92e4102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.431+0000 7f92ec600640 1 -- 172.21.15.18:0/2726717432 >> 172.21.15.18:0/2726717432 conn(0x7f92e40fa3d0 msgr2=0x7f92e40fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:45.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.431+0000 7f92ec600640 1 -- 172.21.15.18:0/2726717432 shutdown_connections 2024-09-13T16:49:45.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.431+0000 7f92ec600640 1 -- 172.21.15.18:0/2726717432 wait complete. 2024-09-13T16:49:45.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.432+0000 7f92ec600640 1 Processor -- start 2024-09-13T16:49:45.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.432+0000 7f92ec600640 1 -- start start 2024-09-13T16:49:45.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.432+0000 7f92ec600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92e41007f0 0x7f92e4100160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.432+0000 7f92ec600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e4103120 0x7f92e40fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.432+0000 7f92ec600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e4105a50 0x7f92e40fece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.432+0000 7f92ec600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e40ff440 con 0x7f92e41007f0 2024-09-13T16:49:45.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.432+0000 7f92ec600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e40ff5b0 con 0x7f92e4103120 2024-09-13T16:49:45.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.432+0000 7f92ec600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e419fe90 con 0x7f92e4105a50 2024-09-13T16:49:45.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92e9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92e41007f0 0x7f92e4100160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92e9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92e41007f0 0x7f92e4100160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56836/0 (socket says 172.21.15.18:56836) 2024-09-13T16:49:45.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92e9c00640 1 -- 172.21.15.18:0/3021710871 learned_addr learned my addr 172.21.15.18:0/3021710871 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:45.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92e9200640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e4103120 0x7f92e40fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92ea600640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e4105a50 0x7f92e40fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92e9c00640 1 -- 172.21.15.18:0/3021710871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e4105a50 msgr2=0x7f92e40fece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92e9c00640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e4105a50 0x7f92e40fece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92e9c00640 1 -- 172.21.15.18:0/3021710871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e4103120 msgr2=0x7f92e40fe7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92e9c00640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e4103120 0x7f92e40fe7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92e9c00640 1 -- 172.21.15.18:0/3021710871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0009560 con 0x7f92e41007f0 2024-09-13T16:49:45.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.433+0000 7f92e9c00640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92e41007f0 0x7f92e4100160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f92d800ea20 tx=0x7f92d800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:45.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.434+0000 7f92e2000640 1 -- 172.21.15.18:0/3021710871 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8009700 con 0x7f92e41007f0 2024-09-13T16:49:45.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.434+0000 7f92e2000640 1 -- 172.21.15.18:0/3021710871 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92d800cd80 con 0x7f92e41007f0 2024-09-13T16:49:45.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.434+0000 7f92ec600640 1 -- 172.21.15.18:0/3021710871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e41a0140 con 0x7f92e41007f0 2024-09-13T16:49:45.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.434+0000 7f92e2000640 1 -- 172.21.15.18:0/3021710871 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d80187e0 con 0x7f92e41007f0 2024-09-13T16:49:45.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.434+0000 7f92ec600640 1 -- 172.21.15.18:0/3021710871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e41a0670 con 0x7f92e41007f0 2024-09-13T16:49:45.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.435+0000 7f92ec600640 1 -- 172.21.15.18:0/3021710871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e40fbec0 con 0x7f92e41007f0 2024-09-13T16:49:45.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.437+0000 7f92e2000640 1 -- 172.21.15.18:0/3021710871 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f92d8018940 con 0x7f92e41007f0 2024-09-13T16:49:45.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.438+0000 7f92e2000640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92cc0a1110 0x7f92cc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.438+0000 7f92e2000640 1 -- 172.21.15.18:0/3021710871 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f92d8014070 con 0x7f92e41007f0 2024-09-13T16:49:45.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.438+0000 7f92e9200640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92cc0a1110 0x7f92cc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.439+0000 7f92e9200640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92cc0a1110 0x7f92cc0a35d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f92d0031500 tx=0x7f92d0005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:45.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.441+0000 7f92e2000640 1 -- 172.21.15.18:0/3021710871 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f92d8052e20 con 0x7f92e41007f0 2024-09-13T16:49:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.619+0000 7f92ec600640 1 -- 172.21.15.18:0/3021710871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92e410b690 con 0x7f92e41007f0 2024-09-13T16:49:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.620+0000 7f92e2000640 1 -- 172.21.15.18:0/3021710871 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92d80963b0 con 0x7f92e41007f0 2024-09-13T16:49:45.622 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T16:49:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.621+0000 7f92ec600640 1 -- 172.21.15.18:0/3021710871 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92cc0a1110 msgr2=0x7f92cc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.621+0000 7f92ec600640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92cc0a1110 0x7f92cc0a35d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f92d0031500 tx=0x7f92d0005780 comp rx=0 tx=0).stop 2024-09-13T16:49:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.621+0000 7f92ec600640 1 -- 172.21.15.18:0/3021710871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92e41007f0 msgr2=0x7f92e4100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.621+0000 7f92ec600640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92e41007f0 0x7f92e4100160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f92d800ea20 tx=0x7f92d800eee0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.622+0000 7f92ec600640 1 -- 172.21.15.18:0/3021710871 shutdown_connections 2024-09-13T16:49:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.622+0000 7f92ec600640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e4105a50 0x7f92e40fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.622+0000 7f92ec600640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92e4103120 0x7f92e40fe7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.622+0000 7f92ec600640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92cc0a1110 0x7f92cc0a35d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.622+0000 7f92ec600640 1 --2- 172.21.15.18:0/3021710871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92e41007f0 0x7f92e4100160 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.622+0000 7f92ec600640 1 -- 172.21.15.18:0/3021710871 >> 172.21.15.18:0/3021710871 conn(0x7f92e40fa3d0 msgr2=0x7f92e41010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.622+0000 7f92ec600640 1 -- 172.21.15.18:0/3021710871 shutdown_connections 2024-09-13T16:49:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.622+0000 7f92ec600640 1 -- 172.21.15.18:0/3021710871 wait complete. 2024-09-13T16:49:45.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:49:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.796+0000 7fee2f400640 1 -- 172.21.15.18:0/2475116080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28105a50 msgr2=0x7fee28107ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.796+0000 7fee2f400640 1 --2- 172.21.15.18:0/2475116080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28105a50 0x7fee28107ec0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fee20009ca0 tx=0x7fee2002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.796+0000 7fee2f400640 1 -- 172.21.15.18:0/2475116080 shutdown_connections 2024-09-13T16:49:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.796+0000 7fee2f400640 1 --2- 172.21.15.18:0/2475116080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28105a50 0x7fee28107ec0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.796+0000 7fee2f400640 1 --2- 172.21.15.18:0/2475116080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee28103120 0x7fee28105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.796+0000 7fee2f400640 1 --2- 172.21.15.18:0/2475116080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee281007f0 0x7fee28102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.796+0000 7fee2f400640 1 -- 172.21.15.18:0/2475116080 >> 172.21.15.18:0/2475116080 conn(0x7fee280fa3d0 msgr2=0x7fee280fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.796+0000 7fee2f400640 1 -- 172.21.15.18:0/2475116080 shutdown_connections 2024-09-13T16:49:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.796+0000 7fee2f400640 1 -- 172.21.15.18:0/2475116080 wait complete. 2024-09-13T16:49:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.797+0000 7fee2f400640 1 Processor -- start 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.797+0000 7fee2f400640 1 -- start start 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.797+0000 7fee2f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee281007f0 0x7fee28195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.797+0000 7fee2f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28103120 0x7fee281962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.797+0000 7fee2f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee28105a50 0x7fee2819d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee2f400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2819d880 con 0x7fee28103120 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee2f400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2819d9f0 con 0x7fee28105a50 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee2f400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2819dbb0 con 0x7fee281007f0 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee27e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28103120 0x7fee281962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee27e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28103120 0x7fee281962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56852/0 (socket says 172.21.15.18:56852) 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee27e00640 1 -- 172.21.15.18:0/1737894924 learned_addr learned my addr 172.21.15.18:0/1737894924 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee2d400640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee28105a50 0x7fee2819d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee2ca00640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee281007f0 0x7fee28195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee27e00640 1 -- 172.21.15.18:0/1737894924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee281007f0 msgr2=0x7fee28195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee27e00640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee281007f0 0x7fee28195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee27e00640 1 -- 172.21.15.18:0/1737894924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee28105a50 msgr2=0x7fee2819d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee27e00640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee28105a50 0x7fee2819d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee27e00640 1 -- 172.21.15.18:0/1737894924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee20009900 con 0x7fee28103120 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.798+0000 7fee2d400640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee28105a50 0x7fee2819d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.799+0000 7fee27e00640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28103120 0x7fee281962e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee1400e9c0 tx=0x7fee1400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.799+0000 7fee25600640 1 -- 172.21.15.18:0/1737894924 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14009700 con 0x7fee28103120 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.799+0000 7fee25600640 1 -- 172.21.15.18:0/1737894924 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee1400cd80 con 0x7fee28103120 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.799+0000 7fee2f400640 1 -- 172.21.15.18:0/1737894924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2819de90 con 0x7fee28103120 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.799+0000 7fee25600640 1 -- 172.21.15.18:0/1737894924 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14010430 con 0x7fee28103120 2024-09-13T16:49:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.799+0000 7fee2f400640 1 -- 172.21.15.18:0/1737894924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2819e310 con 0x7fee28103120 2024-09-13T16:49:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.800+0000 7fee2f400640 1 -- 172.21.15.18:0/1737894924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee280fbec0 con 0x7fee28103120 2024-09-13T16:49:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.802+0000 7fee25600640 1 -- 172.21.15.18:0/1737894924 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fee14004f90 con 0x7fee28103120 2024-09-13T16:49:45.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.803+0000 7fee25600640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee100a1110 0x7fee100a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:45.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.803+0000 7fee25600640 1 -- 172.21.15.18:0/1737894924 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fee14014070 con 0x7fee28103120 2024-09-13T16:49:45.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.803+0000 7fee2ca00640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee100a1110 0x7fee100a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.804+0000 7fee2ca00640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee100a1110 0x7fee100a35d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fee28197270 tx=0x7fee1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.807+0000 7fee25600640 1 -- 172.21.15.18:0/1737894924 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fee14096530 con 0x7fee28103120 2024-09-13T16:49:45.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.990+0000 7fee2f400640 1 -- 172.21.15.18:0/1737894924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee2802c410 con 0x7fee28103120 2024-09-13T16:49:45.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.990+0000 7fee25600640 1 -- 172.21.15.18:0/1737894924 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee14098460 con 0x7fee28103120 2024-09-13T16:49:45.993 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:49:45.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 -- 172.21.15.18:0/1737894924 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee100a1110 msgr2=0x7fee100a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee100a1110 0x7fee100a35d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fee28197270 tx=0x7fee1c005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:45.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 -- 172.21.15.18:0/1737894924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28103120 msgr2=0x7fee281962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:45.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28103120 0x7fee281962e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee1400e9c0 tx=0x7fee1400ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:45.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 -- 172.21.15.18:0/1737894924 shutdown_connections 2024-09-13T16:49:45.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fee100a1110 0x7fee100a35d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28103120 0x7fee281962e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee28105a50 0x7fee2819d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 --2- 172.21.15.18:0/1737894924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee281007f0 0x7fee28195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:45.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 -- 172.21.15.18:0/1737894924 >> 172.21.15.18:0/1737894924 conn(0x7fee280fa3d0 msgr2=0x7fee281011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:45.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 -- 172.21.15.18:0/1737894924 shutdown_connections 2024-09-13T16:49:45.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:45.993+0000 7fee2f400640 1 -- 172.21.15.18:0/1737894924 wait complete. 2024-09-13T16:49:46.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:49:46.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.170+0000 7f1414400640 1 -- 172.21.15.18:0/4068331786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f140c1019c0 msgr2=0x7f140c108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.170+0000 7f1414400640 1 --2- 172.21.15.18:0/4068331786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f140c1019c0 0x7f140c108250 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1404009ca0 tx=0x7f140402a8b0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.170+0000 7f1414400640 1 -- 172.21.15.18:0/4068331786 shutdown_connections 2024-09-13T16:49:46.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.170+0000 7f1414400640 1 --2- 172.21.15.18:0/4068331786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f140c1019c0 0x7f140c108250 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.170+0000 7f1414400640 1 --2- 172.21.15.18:0/4068331786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140c101000 0x7f140c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.170+0000 7f1414400640 1 --2- 172.21.15.18:0/4068331786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f140c0fe030 0x7f140c0fe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.170+0000 7f1414400640 1 -- 172.21.15.18:0/4068331786 >> 172.21.15.18:0/4068331786 conn(0x7f140c0f9b50 msgr2=0x7f140c0fbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:46.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.170+0000 7f1414400640 1 -- 172.21.15.18:0/4068331786 shutdown_connections 2024-09-13T16:49:46.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.171+0000 7f1414400640 1 -- 172.21.15.18:0/4068331786 wait complete. 2024-09-13T16:49:46.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.171+0000 7f1414400640 1 Processor -- start 2024-09-13T16:49:46.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1414400640 1 -- start start 2024-09-13T16:49:46.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1414400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f140c0fe030 0x7f140c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1414400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140c101000 0x7f140c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1414400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f140c1019c0 0x7f140c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1414400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c19fa40 con 0x7f140c0fe030 2024-09-13T16:49:46.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1414400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c19fbb0 con 0x7f140c1019c0 2024-09-13T16:49:46.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1414400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c19fd70 con 0x7f140c101000 2024-09-13T16:49:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1411a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f140c0fe030 0x7f140c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1411000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140c101000 0x7f140c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1411000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140c101000 0x7f140c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:45720/0 (socket says 172.21.15.18:45720) 2024-09-13T16:49:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1411a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f140c0fe030 0x7f140c197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56862/0 (socket says 172.21.15.18:56862) 2024-09-13T16:49:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1411000640 1 -- 172.21.15.18:0/2930093381 learned_addr learned my addr 172.21.15.18:0/2930093381 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.172+0000 7f1412400640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f140c1019c0 0x7f140c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f1411000640 1 -- 172.21.15.18:0/2930093381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f140c1019c0 msgr2=0x7f140c19f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f1411000640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f140c1019c0 0x7f140c19f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f1411000640 1 -- 172.21.15.18:0/2930093381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f140c0fe030 msgr2=0x7f140c197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f1411000640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f140c0fe030 0x7f140c197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f1411000640 1 -- 172.21.15.18:0/2930093381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400009490 con 0x7f140c101000 2024-09-13T16:49:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f1411a00640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f140c0fe030 0x7f140c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f1411000640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140c101000 0x7f140c198490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f13f800e9f0 tx=0x7f13f800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f140a000640 1 -- 172.21.15.18:0/2930093381 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8009720 con 0x7f140c101000 2024-09-13T16:49:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f140a000640 1 -- 172.21.15.18:0/2930093381 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13f800cd80 con 0x7f140c101000 2024-09-13T16:49:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f1414400640 1 -- 172.21.15.18:0/2930093381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1404009900 con 0x7f140c101000 2024-09-13T16:49:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f140a000640 1 -- 172.21.15.18:0/2930093381 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8010430 con 0x7f140c101000 2024-09-13T16:49:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.173+0000 7f1414400640 1 -- 172.21.15.18:0/2930093381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c1a0340 con 0x7f140c101000 2024-09-13T16:49:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.174+0000 7f1414400640 1 -- 172.21.15.18:0/2930093381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c10b640 con 0x7f140c101000 2024-09-13T16:49:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.176+0000 7f140a000640 1 -- 172.21.15.18:0/2930093381 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f13f8004f40 con 0x7f140c101000 2024-09-13T16:49:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.178+0000 7f140a000640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f13f40a1110 0x7f13f40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.178+0000 7f140a000640 1 -- 172.21.15.18:0/2930093381 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f13f8014070 con 0x7f140c101000 2024-09-13T16:49:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.178+0000 7f1411a00640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f13f40a1110 0x7f13f40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.178+0000 7f1411a00640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f13f40a1110 0x7f13f40a35d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f140c068410 tx=0x7f1400005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.179+0000 7f140a000640 1 -- 172.21.15.18:0/2930093381 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f13f8096580 con 0x7f140c101000 2024-09-13T16:49:46.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:45 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/335038359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:46.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:45 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3021710871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:49:46.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:45 smithi144 ceph-mon[35328]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:49:46.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:45 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1737894924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:49:46.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.360+0000 7f1414400640 1 -- 172.21.15.18:0/2930093381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f140c1a07c0 con 0x7f140c101000 2024-09-13T16:49:46.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.361+0000 7f140a000640 1 -- 172.21.15.18:0/2930093381 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13f8099ba0 con 0x7f140c101000 2024-09-13T16:49:46.363 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-13T16:49:46.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 -- 172.21.15.18:0/2930093381 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f13f40a1110 msgr2=0x7f13f40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f13f40a1110 0x7f13f40a35d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f140c068410 tx=0x7f1400005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:46.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 -- 172.21.15.18:0/2930093381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140c101000 msgr2=0x7f140c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140c101000 0x7f140c198490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f13f800e9f0 tx=0x7f13f800edf0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 -- 172.21.15.18:0/2930093381 shutdown_connections 2024-09-13T16:49:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f140c1019c0 0x7f140c19f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140c101000 0x7f140c198490 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f13f40a1110 0x7f13f40a35d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 --2- 172.21.15.18:0/2930093381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f140c0fe030 0x7f140c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 -- 172.21.15.18:0/2930093381 >> 172.21.15.18:0/2930093381 conn(0x7f140c0f9b50 msgr2=0x7f140c1067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 -- 172.21.15.18:0/2930093381 shutdown_connections 2024-09-13T16:49:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.363+0000 7f1414400640 1 -- 172.21.15.18:0/2930093381 wait complete. 2024-09-13T16:49:46.379 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:45 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/335038359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:46.379 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:45 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3021710871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:49:46.379 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:45 smithi018 ceph-mon[30981]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:49:46.379 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:45 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1737894924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:49:46.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:49:46.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:45 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/335038359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:46.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:45 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3021710871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:49:46.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:45 smithi094 ceph-mon[35259]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:49:46.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:45 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1737894924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:49:46.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.537+0000 7f1093e00640 1 -- 172.21.15.18:0/1230893718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1094101ea0 msgr2=0x7f10941022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.537+0000 7f1093e00640 1 --2- 172.21.15.18:0/1230893718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1094101ea0 0x7f10941022a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1084009900 tx=0x7f108402a410 comp rx=0 tx=0).stop 2024-09-13T16:49:46.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.537+0000 7f1093e00640 1 -- 172.21.15.18:0/1230893718 shutdown_connections 2024-09-13T16:49:46.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.537+0000 7f1093e00640 1 --2- 172.21.15.18:0/1230893718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1094103a40 0x7f109410a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.537+0000 7f1093e00640 1 --2- 172.21.15.18:0/1230893718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1094103080 0x7f1094103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.537+0000 7f1093e00640 1 --2- 172.21.15.18:0/1230893718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1094101ea0 0x7f10941022a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.537+0000 7f1093e00640 1 -- 172.21.15.18:0/1230893718 >> 172.21.15.18:0/1230893718 conn(0x7f10940fd670 msgr2=0x7f10940ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:46.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.538+0000 7f1093e00640 1 -- 172.21.15.18:0/1230893718 shutdown_connections 2024-09-13T16:49:46.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.538+0000 7f1093e00640 1 -- 172.21.15.18:0/1230893718 wait complete. 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.538+0000 7f1093e00640 1 Processor -- start 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f1093e00640 1 -- start start 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f1093e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1094101ea0 0x7f1094197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f1093e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1094103080 0x7f1094198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f1093e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1094103a40 0x7f109419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f1093e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109419fa00 con 0x7f1094103080 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f1093e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109419fb70 con 0x7f1094101ea0 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f1093e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109419fd30 con 0x7f1094103a40 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f108be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1094103080 0x7f1094198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f1092a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1094101ea0 0x7f1094197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f108be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1094103080 0x7f1094198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56870/0 (socket says 172.21.15.18:56870) 2024-09-13T16:49:46.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f108be00640 1 -- 172.21.15.18:0/92669377 learned_addr learned my addr 172.21.15.18:0/92669377 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.539+0000 7f1093400640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1094103a40 0x7f109419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f108be00640 1 -- 172.21.15.18:0/92669377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1094103a40 msgr2=0x7f109419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f108be00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1094103a40 0x7f109419f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f108be00640 1 -- 172.21.15.18:0/92669377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1094101ea0 msgr2=0x7f1094197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f108be00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1094101ea0 0x7f1094197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f108be00640 1 -- 172.21.15.18:0/92669377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084009560 con 0x7f1094103080 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f108be00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1094103080 0x7f1094198450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f107c00e9f0 tx=0x7f107c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f108b400640 1 -- 172.21.15.18:0/92669377 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c009700 con 0x7f1094103080 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f108b400640 1 -- 172.21.15.18:0/92669377 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f107c00cd80 con 0x7f1094103080 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f108b400640 1 -- 172.21.15.18:0/92669377 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c018860 con 0x7f1094103080 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f1093e00640 1 -- 172.21.15.18:0/92669377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109419ffb0 con 0x7f1094103080 2024-09-13T16:49:46.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.540+0000 7f1093e00640 1 -- 172.21.15.18:0/92669377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10941a0440 con 0x7f1094103080 2024-09-13T16:49:46.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.541+0000 7f1093e00640 1 -- 172.21.15.18:0/92669377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10941093d0 con 0x7f1094103080 2024-09-13T16:49:46.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.544+0000 7f108b400640 1 -- 172.21.15.18:0/92669377 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f107c0189c0 con 0x7f1094103080 2024-09-13T16:49:46.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.545+0000 7f108b400640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10780a1090 0x7f10780a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.545+0000 7f108b400640 1 -- 172.21.15.18:0/92669377 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f107c014070 con 0x7f1094103080 2024-09-13T16:49:46.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.545+0000 7f1092a00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10780a1090 0x7f10780a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.546+0000 7f1092a00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10780a1090 0x7f10780a3550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1084031500 tx=0x7f1084005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:46.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.549+0000 7f108b400640 1 -- 172.21.15.18:0/92669377 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f107c052e20 con 0x7f1094103080 2024-09-13T16:49:46.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.730+0000 7f1093e00640 1 -- 172.21.15.18:0/92669377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1094108e40 con 0x7f1094103080 2024-09-13T16:49:46.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.731+0000 7f108b400640 1 -- 172.21.15.18:0/92669377 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f107c096440 con 0x7f1094103080 2024-09-13T16:49:46.733 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 -- 172.21.15.18:0/92669377 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10780a1090 msgr2=0x7f10780a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10780a1090 0x7f10780a3550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1084031500 tx=0x7f1084005780 comp rx=0 tx=0).stop 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 -- 172.21.15.18:0/92669377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1094103080 msgr2=0x7f1094198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1094103080 0x7f1094198450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f107c00e9f0 tx=0x7f107c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 -- 172.21.15.18:0/92669377 shutdown_connections 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10780a1090 0x7f10780a3550 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1094103080 0x7f1094198450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1094103a40 0x7f109419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 --2- 172.21.15.18:0/92669377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1094101ea0 0x7f1094197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 -- 172.21.15.18:0/92669377 >> 172.21.15.18:0/92669377 conn(0x7f10940fd670 msgr2=0x7f10941065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:46.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 -- 172.21.15.18:0/92669377 shutdown_connections 2024-09-13T16:49:46.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.733+0000 7f1093e00640 1 -- 172.21.15.18:0/92669377 wait complete. 2024-09-13T16:49:46.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:49:46.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.907+0000 7fafede00640 1 -- 172.21.15.18:0/2542673513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafe8102f80 msgr2=0x7fafe8103400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.907+0000 7fafede00640 1 --2- 172.21.15.18:0/2542673513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafe8102f80 0x7fafe8103400 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009900 tx=0x7fafd402a410 comp rx=0 tx=0).stop 2024-09-13T16:49:46.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.907+0000 7fafede00640 1 -- 172.21.15.18:0/2542673513 shutdown_connections 2024-09-13T16:49:46.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.907+0000 7fafede00640 1 --2- 172.21.15.18:0/2542673513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafe8102f80 0x7fafe8103400 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.907+0000 7fafede00640 1 --2- 172.21.15.18:0/2542673513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe8103940 0x7fafe810a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.907+0000 7fafede00640 1 --2- 172.21.15.18:0/2542673513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafe8101d90 0x7fafe8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.907+0000 7fafede00640 1 -- 172.21.15.18:0/2542673513 >> 172.21.15.18:0/2542673513 conn(0x7fafe80fd530 msgr2=0x7fafe80ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:46.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.907+0000 7fafede00640 1 -- 172.21.15.18:0/2542673513 shutdown_connections 2024-09-13T16:49:46.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.907+0000 7fafede00640 1 -- 172.21.15.18:0/2542673513 wait complete. 2024-09-13T16:49:46.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.908+0000 7fafede00640 1 Processor -- start 2024-09-13T16:49:46.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.908+0000 7fafede00640 1 -- start start 2024-09-13T16:49:46.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.908+0000 7fafede00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafe8101d90 0x7fafe8197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.908+0000 7fafede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafe8102f80 0x7fafe8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafede00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe8103940 0x7fafe819f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafede00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe819f8a0 con 0x7fafe8101d90 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafede00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe819fa10 con 0x7fafe8103940 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafede00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe819fbd0 con 0x7fafe8102f80 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafeca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafe8101d90 0x7fafe8197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafeca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafe8101d90 0x7fafe8197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56882/0 (socket says 172.21.15.18:56882) 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafeca00640 1 -- 172.21.15.18:0/3780271401 learned_addr learned my addr 172.21.15.18:0/3780271401 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafed400640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe8103940 0x7fafe819f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafe7e00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafe8102f80 0x7fafe8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafeca00640 1 -- 172.21.15.18:0/3780271401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafe8102f80 msgr2=0x7fafe8198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafeca00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafe8102f80 0x7fafe8198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafeca00640 1 -- 172.21.15.18:0/3780271401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe8103940 msgr2=0x7fafe819f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafeca00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe8103940 0x7fafe819f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:46.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.909+0000 7fafeca00640 1 -- 172.21.15.18:0/3780271401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd4009560 con 0x7fafe8101d90 2024-09-13T16:49:46.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.910+0000 7fafeca00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafe8101d90 0x7fafe8197dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00e9c0 tx=0x7fafdc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:46.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.910+0000 7fafe5600640 1 -- 172.21.15.18:0/3780271401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0096e0 con 0x7fafe8101d90 2024-09-13T16:49:46.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.910+0000 7fafe5600640 1 -- 172.21.15.18:0/3780271401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafdc0044f0 con 0x7fafe8101d90 2024-09-13T16:49:46.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.910+0000 7fafede00640 1 -- 172.21.15.18:0/3780271401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe819feb0 con 0x7fafe8101d90 2024-09-13T16:49:46.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.910+0000 7fafe5600640 1 -- 172.21.15.18:0/3780271401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc010430 con 0x7fafe8101d90 2024-09-13T16:49:46.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.910+0000 7fafede00640 1 -- 172.21.15.18:0/3780271401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe81a02d0 con 0x7fafe8101d90 2024-09-13T16:49:46.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.911+0000 7fafede00640 1 -- 172.21.15.18:0/3780271401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe81092c0 con 0x7fafe8101d90 2024-09-13T16:49:46.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.913+0000 7fafe5600640 1 -- 172.21.15.18:0/3780271401 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fafdc0035f0 con 0x7fafe8101d90 2024-09-13T16:49:46.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.914+0000 7fafe5600640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafd00a1110 0x7fafd00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:46.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.914+0000 7fafe5600640 1 -- 172.21.15.18:0/3780271401 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fafdc014070 con 0x7fafe8101d90 2024-09-13T16:49:46.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.914+0000 7fafe7e00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafd00a1110 0x7fafd00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:46.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.915+0000 7fafe7e00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafd00a1110 0x7fafd00a35d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fafd4005ab0 tx=0x7fafd4005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:46.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:46.918+0000 7fafe5600640 1 -- 172.21.15.18:0/3780271401 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fafdc0d3080 con 0x7fafe8101d90 2024-09-13T16:49:47.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.114+0000 7fafede00640 1 -- 172.21.15.18:0/3780271401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fafe810d6a0 con 0x7fafe8101d90 2024-09-13T16:49:47.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.114+0000 7fafe5600640 1 -- 172.21.15.18:0/3780271401 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+588 (secure 0 0 0) 0x7fafdc096330 con 0x7fafe8101d90 2024-09-13T16:49:47.117 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/920683112 2024-09-14T16:42:11.669513+0000 2024-09-13T16:49:47.117 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/920683112 2024-09-14T16:42:11.669513+0000 2024-09-13T16:49:47.117 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3837246804 2024-09-14T16:42:11.669513+0000 2024-09-13T16:49:47.117 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4227001658 2024-09-14T16:42:11.669513+0000 2024-09-13T16:49:47.117 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2737842128 2024-09-14T16:41:44.259356+0000 2024-09-13T16:49:47.118 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/295009687 2024-09-14T16:41:44.259356+0000 2024-09-13T16:49:47.118 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1872401951 2024-09-14T16:41:44.259356+0000 2024-09-13T16:49:47.118 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/1236399643 2024-09-14T16:41:44.259356+0000 2024-09-13T16:49:47.118 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/237199304 2024-09-14T16:42:11.669513+0000 2024-09-13T16:49:47.118 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/1236399643 2024-09-14T16:41:44.259356+0000 2024-09-13T16:49:47.118 INFO:teuthology.orchestra.run.smithi018.stderr:listed 10 entries 2024-09-13T16:49:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 -- 172.21.15.18:0/3780271401 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafd00a1110 msgr2=0x7fafd00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafd00a1110 0x7fafd00a35d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fafd4005ab0 tx=0x7fafd4005780 comp rx=0 tx=0).stop 2024-09-13T16:49:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 -- 172.21.15.18:0/3780271401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafe8101d90 msgr2=0x7fafe8197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafe8101d90 0x7fafe8197dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00e9c0 tx=0x7fafdc00ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 -- 172.21.15.18:0/3780271401 shutdown_connections 2024-09-13T16:49:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe8103940 0x7fafe819f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafe8102f80 0x7fafe8198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fafd00a1110 0x7fafd00a35d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 --2- 172.21.15.18:0/3780271401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafe8101d90 0x7fafe8197dc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 -- 172.21.15.18:0/3780271401 >> 172.21.15.18:0/3780271401 conn(0x7fafe80fd530 msgr2=0x7fafe8106490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 -- 172.21.15.18:0/3780271401 shutdown_connections 2024-09-13T16:49:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:47.117+0000 7fafede00640 1 -- 172.21.15.18:0/3780271401 wait complete. 2024-09-13T16:49:47.135 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2024-09-13T16:49:47.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:47.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T16:49:47.189 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[74348]: fuse finished with error 0 and tester_r 0 2024-09-13T16:49:47.192 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T16:49:47.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:47 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2930093381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:49:47.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:47 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/92669377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:49:47.299 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:47 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2930093381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:49:47.299 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:47 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/92669377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:49:47.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:47 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2930093381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:49:47.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:47 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/92669377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:49:48.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:48 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3780271401' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:49:48.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:48 smithi144 ceph-mon[35328]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:49:48.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:48 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3780271401' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:49:48.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:48 smithi094 ceph-mon[35259]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:49:48.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:48 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3780271401' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:49:48.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:48 smithi018 ceph-mon[30981]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:49:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:49 smithi094 ceph-mon[35259]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:49:50.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:49 smithi018 ceph-mon[30981]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:49:50.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:49 smithi144 ceph-mon[35328]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T16:49:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:51 smithi094 ceph-mon[35259]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-13T16:49:52.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:51 smithi018 ceph-mon[30981]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-13T16:49:52.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:51 smithi144 ceph-mon[35328]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-13T16:49:53.294 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T16:49:53.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:49:53.294 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T16:49:53.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:49:53.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.510+0000 7fa0d3e00640 1 -- 172.21.15.18:0/1859325986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0d41017f0 msgr2=0x7fa0d4108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:53.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.510+0000 7fa0d3e00640 1 --2- 172.21.15.18:0/1859325986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0d41017f0 0x7fa0d4108080 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009ca0 tx=0x7fa0cc02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.510+0000 7fa0d3e00640 1 -- 172.21.15.18:0/1859325986 shutdown_connections 2024-09-13T16:49:53.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.510+0000 7fa0d3e00640 1 --2- 172.21.15.18:0/1859325986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0d41017f0 0x7fa0d4108080 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.510+0000 7fa0d3e00640 1 --2- 172.21.15.18:0/1859325986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0d4100e30 0x7fa0d41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.510+0000 7fa0d3e00640 1 --2- 172.21.15.18:0/1859325986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d40fde60 0x7fa0d40fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.510+0000 7fa0d3e00640 1 -- 172.21.15.18:0/1859325986 >> 172.21.15.18:0/1859325986 conn(0x7fa0d40f9980 msgr2=0x7fa0d40fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:53.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.510+0000 7fa0d3e00640 1 -- 172.21.15.18:0/1859325986 shutdown_connections 2024-09-13T16:49:53.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.510+0000 7fa0d3e00640 1 -- 172.21.15.18:0/1859325986 wait complete. 2024-09-13T16:49:53.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.511+0000 7fa0d3e00640 1 Processor -- start 2024-09-13T16:49:53.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.511+0000 7fa0d3e00640 1 -- start start 2024-09-13T16:49:53.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.511+0000 7fa0d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0d40fde60 0x7fa0d4195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:53.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.511+0000 7fa0d3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0d4100e30 0x7fa0d4196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:53.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.511+0000 7fa0d3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d41017f0 0x7fa0d419d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.511+0000 7fa0d3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d419d640 con 0x7fa0d40fde60 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.511+0000 7fa0d3e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d419d7b0 con 0x7fa0d4100e30 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.511+0000 7fa0d3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d419d970 con 0x7fa0d41017f0 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0d40fde60 0x7fa0d4195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0ca000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0d4100e30 0x7fa0d4196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0ca000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0d4100e30 0x7fa0d4196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:43530/0 (socket says 172.21.15.18:43530) 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0d40fde60 0x7fa0d4195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53474/0 (socket says 172.21.15.18:53474) 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0ca000640 1 -- 172.21.15.18:0/822589345 learned_addr learned my addr 172.21.15.18:0/822589345 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0d3400640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d41017f0 0x7fa0d419d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0ca000640 1 -- 172.21.15.18:0/822589345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d41017f0 msgr2=0x7fa0d419d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0ca000640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d41017f0 0x7fa0d419d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0ca000640 1 -- 172.21.15.18:0/822589345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0d40fde60 msgr2=0x7fa0d4195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:53.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0ca000640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0d40fde60 0x7fa0d4195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0ca000640 1 -- 172.21.15.18:0/822589345 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc009900 con 0x7fa0d4100e30 2024-09-13T16:49:53.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0d2a00640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0d40fde60 0x7fa0d4195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:53.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.512+0000 7fa0ca000640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0d4100e30 0x7fa0d4196090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00e9f0 tx=0x7fa0bc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:53.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.513+0000 7fa0cbe00640 1 -- 172.21.15.18:0/822589345 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc009700 con 0x7fa0d4100e30 2024-09-13T16:49:53.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.513+0000 7fa0cbe00640 1 -- 172.21.15.18:0/822589345 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0bc00cd80 con 0x7fa0d4100e30 2024-09-13T16:49:53.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.513+0000 7fa0d3e00640 1 -- 172.21.15.18:0/822589345 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d419dc50 con 0x7fa0d4100e30 2024-09-13T16:49:53.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.513+0000 7fa0cbe00640 1 -- 172.21.15.18:0/822589345 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc018860 con 0x7fa0d4100e30 2024-09-13T16:49:53.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.513+0000 7fa0d3e00640 1 -- 172.21.15.18:0/822589345 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d419e1b0 con 0x7fa0d4100e30 2024-09-13T16:49:53.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.514+0000 7fa0d3e00640 1 -- 172.21.15.18:0/822589345 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d4107070 con 0x7fa0d4100e30 2024-09-13T16:49:53.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.516+0000 7fa0cbe00640 1 -- 172.21.15.18:0/822589345 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa0bc0189c0 con 0x7fa0d4100e30 2024-09-13T16:49:53.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.518+0000 7fa0cbe00640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa0b80a1110 0x7fa0b80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:53.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.518+0000 7fa0cbe00640 1 -- 172.21.15.18:0/822589345 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa0bc014070 con 0x7fa0d4100e30 2024-09-13T16:49:53.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.518+0000 7fa0d2a00640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa0b80a1110 0x7fa0b80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:53.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.519+0000 7fa0d2a00640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa0b80a1110 0x7fa0b80a35d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4068240 tx=0x7fa0c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:53.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.519+0000 7fa0cbe00640 1 -- 172.21.15.18:0/822589345 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa0bc096880 con 0x7fa0d4100e30 2024-09-13T16:49:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.702+0000 7fa0d3e00640 1 -- 172.21.15.18:0/822589345 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0d410b4c0 con 0x7fa0d4100e30 2024-09-13T16:49:53.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.705+0000 7fa0cbe00640 1 -- 172.21.15.18:0/822589345 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23874 (secure 0 0 0) 0x7fa0bc099ea0 con 0x7fa0d4100e30 2024-09-13T16:49:53.707 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:53.707 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:49:32.540261+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:49:53.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 -- 172.21.15.18:0/822589345 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa0b80a1110 msgr2=0x7fa0b80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa0b80a1110 0x7fa0b80a35d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4068240 tx=0x7fa0c4005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 -- 172.21.15.18:0/822589345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0d4100e30 msgr2=0x7fa0d4196090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0d4100e30 0x7fa0d4196090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00e9f0 tx=0x7fa0bc00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 -- 172.21.15.18:0/822589345 shutdown_connections 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d41017f0 0x7fa0d419d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0d4100e30 0x7fa0d4196090 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa0b80a1110 0x7fa0b80a35d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 --2- 172.21.15.18:0/822589345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0d40fde60 0x7fa0d4195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 -- 172.21.15.18:0/822589345 >> 172.21.15.18:0/822589345 conn(0x7fa0d40f9980 msgr2=0x7fa0d4104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 -- 172.21.15.18:0/822589345 shutdown_connections 2024-09-13T16:49:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.706+0000 7fa0d3e00640 1 -- 172.21.15.18:0/822589345 wait complete. 2024-09-13T16:49:53.724 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:49:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.880+0000 7f27ae200640 1 -- 172.21.15.18:0/252070650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27a8103b60 msgr2=0x7f27a810a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.880+0000 7f27ae200640 1 --2- 172.21.15.18:0/252070650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27a8103b60 0x7f27a810a3f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009ca0 tx=0x7f27a002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.880+0000 7f27ae200640 1 -- 172.21.15.18:0/252070650 shutdown_connections 2024-09-13T16:49:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.880+0000 7f27ae200640 1 --2- 172.21.15.18:0/252070650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27a8103b60 0x7f27a810a3f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.880+0000 7f27ae200640 1 --2- 172.21.15.18:0/252070650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a81031a0 0x7f27a8103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.880+0000 7f27ae200640 1 --2- 172.21.15.18:0/252070650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a8101fb0 0x7f27a81023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.880+0000 7f27ae200640 1 -- 172.21.15.18:0/252070650 >> 172.21.15.18:0/252070650 conn(0x7f27a80fd730 msgr2=0x7f27a80ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.880+0000 7f27ae200640 1 -- 172.21.15.18:0/252070650 shutdown_connections 2024-09-13T16:49:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.880+0000 7f27ae200640 1 -- 172.21.15.18:0/252070650 wait complete. 2024-09-13T16:49:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.881+0000 7f27ae200640 1 Processor -- start 2024-09-13T16:49:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.881+0000 7f27ae200640 1 -- start start 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27ae200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a8101fb0 0x7f27a8197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27ae200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27a81031a0 0x7f27a8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27ae200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a8103b60 0x7f27a819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27ae200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a819f9e0 con 0x7f27a81031a0 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27ae200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a819fb50 con 0x7f27a8103b60 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27ae200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a819fd10 con 0x7f27a8101fb0 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27a6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27a81031a0 0x7f27a8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27a6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27a81031a0 0x7f27a8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53496/0 (socket says 172.21.15.18:53496) 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27a6a00640 1 -- 172.21.15.18:0/4195229847 learned_addr learned my addr 172.21.15.18:0/4195229847 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27a7e00640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a8103b60 0x7f27a819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27a7400640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a8101fb0 0x7f27a8197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27a6a00640 1 -- 172.21.15.18:0/4195229847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a8101fb0 msgr2=0x7f27a8197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27a6a00640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a8101fb0 0x7f27a8197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27a6a00640 1 -- 172.21.15.18:0/4195229847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a8103b60 msgr2=0x7f27a819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27a6a00640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a8103b60 0x7f27a819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.882+0000 7f27a6a00640 1 -- 172.21.15.18:0/4195229847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a0009900 con 0x7f27a81031a0 2024-09-13T16:49:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.883+0000 7f27a6a00640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27a81031a0 0x7f27a8198430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f279400e9f0 tx=0x7f279400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.883+0000 7f279fe00640 1 -- 172.21.15.18:0/4195229847 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794009720 con 0x7f27a81031a0 2024-09-13T16:49:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.883+0000 7f279fe00640 1 -- 172.21.15.18:0/4195229847 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f279400cd80 con 0x7f27a81031a0 2024-09-13T16:49:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.883+0000 7f27ae200640 1 -- 172.21.15.18:0/4195229847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a819fff0 con 0x7f27a81031a0 2024-09-13T16:49:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.883+0000 7f279fe00640 1 -- 172.21.15.18:0/4195229847 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794010430 con 0x7f27a81031a0 2024-09-13T16:49:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.883+0000 7f27ae200640 1 -- 172.21.15.18:0/4195229847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a81a0420 con 0x7f27a81031a0 2024-09-13T16:49:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.884+0000 7f27ae200640 1 -- 172.21.15.18:0/4195229847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a81093f0 con 0x7f27a81031a0 2024-09-13T16:49:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.887+0000 7f279fe00640 1 -- 172.21.15.18:0/4195229847 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2794005020 con 0x7f27a81031a0 2024-09-13T16:49:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.888+0000 7f279fe00640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f278c0a1090 0x7f278c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.888+0000 7f279fe00640 1 -- 172.21.15.18:0/4195229847 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2794014070 con 0x7f27a81031a0 2024-09-13T16:49:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.888+0000 7f27a7400640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f278c0a1090 0x7f278c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.889+0000 7f27a7400640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f278c0a1090 0x7f278c0a3550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27a8103000 tx=0x7f2798005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:53.892+0000 7f279fe00640 1 -- 172.21.15.18:0/4195229847 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f27940963d0 con 0x7f27a81031a0 2024-09-13T16:49:54.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:53 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/822589345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.071+0000 7f27ae200640 1 -- 172.21.15.18:0/4195229847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27a802c410 con 0x7f27a81031a0 2024-09-13T16:49:54.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.073+0000 7f279fe00640 1 -- 172.21.15.18:0/4195229847 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23874 (secure 0 0 0) 0x7f27940999f0 con 0x7f27a81031a0 2024-09-13T16:49:54.076 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:49:54.076 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:49:32.540261+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:49:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 -- 172.21.15.18:0/4195229847 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f278c0a1090 msgr2=0x7f278c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f278c0a1090 0x7f278c0a3550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27a8103000 tx=0x7f2798005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 -- 172.21.15.18:0/4195229847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27a81031a0 msgr2=0x7f27a8198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27a81031a0 0x7f27a8198430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f279400e9f0 tx=0x7f279400edf0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 -- 172.21.15.18:0/4195229847 shutdown_connections 2024-09-13T16:49:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f278c0a1090 0x7f278c0a3550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27a81031a0 0x7f27a8198430 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a8103b60 0x7f27a819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 --2- 172.21.15.18:0/4195229847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a8101fb0 0x7f27a8197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 -- 172.21.15.18:0/4195229847 >> 172.21.15.18:0/4195229847 conn(0x7f27a80fd730 msgr2=0x7f27a81065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 -- 172.21.15.18:0/4195229847 shutdown_connections 2024-09-13T16:49:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.075+0000 7f27ae200640 1 -- 172.21.15.18:0/4195229847 wait complete. 2024-09-13T16:49:54.091 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:53 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/822589345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:54.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T16:49:54.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:53 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/822589345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:54.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.252+0000 7f2592000640 1 -- 172.21.15.18:0/984774655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c103190 msgr2=0x7f258c103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:54.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.252+0000 7f2592000640 1 --2- 172.21.15.18:0/984774655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c103190 0x7f258c103610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2574009900 tx=0x7f257402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.252+0000 7f2592000640 1 -- 172.21.15.18:0/984774655 shutdown_connections 2024-09-13T16:49:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.252+0000 7f2592000640 1 --2- 172.21.15.18:0/984774655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f258c103b50 0x7f258c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.252+0000 7f2592000640 1 --2- 172.21.15.18:0/984774655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c103190 0x7f258c103610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.252+0000 7f2592000640 1 --2- 172.21.15.18:0/984774655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f258c101fa0 0x7f258c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.252+0000 7f2592000640 1 -- 172.21.15.18:0/984774655 >> 172.21.15.18:0/984774655 conn(0x7f258c0fd700 msgr2=0x7f258c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.252+0000 7f2592000640 1 -- 172.21.15.18:0/984774655 shutdown_connections 2024-09-13T16:49:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.252+0000 7f2592000640 1 -- 172.21.15.18:0/984774655 wait complete. 2024-09-13T16:49:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.253+0000 7f2592000640 1 Processor -- start 2024-09-13T16:49:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.253+0000 7f2592000640 1 -- start start 2024-09-13T16:49:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.253+0000 7f2592000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c101fa0 0x7f258c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.253+0000 7f2592000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f258c103190 0x7f258c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.253+0000 7f2592000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f258c103b50 0x7f258c19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.253+0000 7f2592000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c19fa80 con 0x7f258c103b50 2024-09-13T16:49:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.253+0000 7f2592000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c19fbf0 con 0x7f258c101fa0 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.253+0000 7f2592000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c19fdb0 con 0x7f258c103190 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.253+0000 7f258be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f258c103b50 0x7f258c19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f2582a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f258c103190 0x7f258c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f2582a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f258c103190 0x7f258c1984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:48568/0 (socket says 172.21.15.18:48568) 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f2582a00640 1 -- 172.21.15.18:0/3560331404 learned_addr learned my addr 172.21.15.18:0/3560331404 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f258b400640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c101fa0 0x7f258c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f258be00640 1 -- 172.21.15.18:0/3560331404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f258c103190 msgr2=0x7f258c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f258be00640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f258c103190 0x7f258c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f258be00640 1 -- 172.21.15.18:0/3560331404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c101fa0 msgr2=0x7f258c197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f258be00640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c101fa0 0x7f258c197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f258be00640 1 -- 172.21.15.18:0/3560331404 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009560 con 0x7f258c103b50 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f2582a00640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f258c103190 0x7f258c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.254+0000 7f258be00640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f258c103b50 0x7f258c19f540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2584009fd0 tx=0x7f258400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.255+0000 7f2588c00640 1 -- 172.21.15.18:0/3560331404 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258400ce20 con 0x7f258c103b50 2024-09-13T16:49:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.255+0000 7f2588c00640 1 -- 172.21.15.18:0/3560331404 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2584005020 con 0x7f258c103b50 2024-09-13T16:49:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.255+0000 7f2592000640 1 -- 172.21.15.18:0/3560331404 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258c1a0090 con 0x7f258c103b50 2024-09-13T16:49:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.255+0000 7f2588c00640 1 -- 172.21.15.18:0/3560331404 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584010670 con 0x7f258c103b50 2024-09-13T16:49:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.255+0000 7f2592000640 1 -- 172.21.15.18:0/3560331404 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c1a0550 con 0x7f258c103b50 2024-09-13T16:49:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.256+0000 7f2592000640 1 -- 172.21.15.18:0/3560331404 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258c109420 con 0x7f258c103b50 2024-09-13T16:49:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.257+0000 7f2588c00640 1 -- 172.21.15.18:0/3560331404 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2584005450 con 0x7f258c103b50 2024-09-13T16:49:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.259+0000 7f2588c00640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25700a1090 0x7f25700a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.259+0000 7f2588c00640 1 -- 172.21.15.18:0/3560331404 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2584014070 con 0x7f258c103b50 2024-09-13T16:49:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.259+0000 7f258b400640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25700a1090 0x7f25700a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.260+0000 7f258b400640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25700a1090 0x7f25700a3550 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f258c102ff0 tx=0x7f257c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:54.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.262+0000 7f2588c00640 1 -- 172.21.15.18:0/3560331404 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2584096740 con 0x7f258c103b50 2024-09-13T16:49:54.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.480+0000 7f2592000640 1 -- 172.21.15.18:0/3560331404 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f258c10d860 con 0x7f258c103b50 2024-09-13T16:49:54.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.764+0000 7f2588c00640 1 -- 172.21.15.18:0/3560331404 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2584099d60 con 0x7f258c103b50 2024-09-13T16:49:54.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.766+0000 7f2592000640 1 -- 172.21.15.18:0/3560331404 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25700a1090 msgr2=0x7f25700a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:54.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.766+0000 7f2592000640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25700a1090 0x7f25700a3550 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f258c102ff0 tx=0x7f257c005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:54.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.766+0000 7f2592000640 1 -- 172.21.15.18:0/3560331404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f258c103b50 msgr2=0x7f258c19f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:54.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.766+0000 7f2592000640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f258c103b50 0x7f258c19f540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2584009fd0 tx=0x7f258400ef10 comp rx=0 tx=0).stop 2024-09-13T16:49:54.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.767+0000 7f2592000640 1 -- 172.21.15.18:0/3560331404 shutdown_connections 2024-09-13T16:49:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.767+0000 7f2592000640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25700a1090 0x7f25700a3550 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.767+0000 7f2592000640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f258c103b50 0x7f258c19f540 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.767+0000 7f2592000640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f258c103190 0x7f258c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.767+0000 7f2592000640 1 --2- 172.21.15.18:0/3560331404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c101fa0 0x7f258c197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.767+0000 7f2592000640 1 -- 172.21.15.18:0/3560331404 >> 172.21.15.18:0/3560331404 conn(0x7f258c0fd700 msgr2=0x7f258c1065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.767+0000 7f2592000640 1 -- 172.21.15.18:0/3560331404 shutdown_connections 2024-09-13T16:49:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.767+0000 7f2592000640 1 -- 172.21.15.18:0/3560331404 wait complete. 2024-09-13T16:49:54.784 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-13T16:49:54.785 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T16:49:54.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.943+0000 7f310ca00640 1 -- 172.21.15.18:0/4092944789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3108101ea0 msgr2=0x7f31081022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:54.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.943+0000 7f310ca00640 1 --2- 172.21.15.18:0/4092944789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3108101ea0 0x7f31081022a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009860 tx=0x7f30f802a340 comp rx=0 tx=0).stop 2024-09-13T16:49:54.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.943+0000 7f310ca00640 1 -- 172.21.15.18:0/4092944789 shutdown_connections 2024-09-13T16:49:54.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.943+0000 7f310ca00640 1 --2- 172.21.15.18:0/4092944789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3108103080 0x7f3108103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.943+0000 7f310ca00640 1 --2- 172.21.15.18:0/4092944789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103a40 0x7f310810a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.943+0000 7f310ca00640 1 --2- 172.21.15.18:0/4092944789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3108101ea0 0x7f31081022a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.943+0000 7f310ca00640 1 -- 172.21.15.18:0/4092944789 >> 172.21.15.18:0/4092944789 conn(0x7f31080fd670 msgr2=0x7f31080ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:54.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.943+0000 7f310ca00640 1 -- 172.21.15.18:0/4092944789 shutdown_connections 2024-09-13T16:49:54.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.943+0000 7f310ca00640 1 -- 172.21.15.18:0/4092944789 wait complete. 2024-09-13T16:49:54.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.944+0000 7f310ca00640 1 Processor -- start 2024-09-13T16:49:54.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.944+0000 7f310ca00640 1 -- start start 2024-09-13T16:49:54.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.944+0000 7f310ca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3108101ea0 0x7f3108197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:54.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.944+0000 7f310ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103080 0x7f3108198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:54.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.944+0000 7f310ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3108103a40 0x7f310819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:54.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.944+0000 7f310ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819fa00 con 0x7f3108103a40 2024-09-13T16:49:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.944+0000 7f310ca00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819fb70 con 0x7f3108101ea0 2024-09-13T16:49:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.944+0000 7f310ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819fd30 con 0x7f3108103080 2024-09-13T16:49:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f3107200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3108103a40 0x7f310819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f30fde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103080 0x7f3108198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f30fde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103080 0x7f3108198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:48596/0 (socket says 172.21.15.18:48596) 2024-09-13T16:49:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f3107200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3108103a40 0x7f310819f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53518/0 (socket says 172.21.15.18:53518) 2024-09-13T16:49:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f30fde00640 1 -- 172.21.15.18:0/1995317551 learned_addr learned my addr 172.21.15.18:0/1995317551 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f3106800640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3108101ea0 0x7f3108197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f30fde00640 1 -- 172.21.15.18:0/1995317551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3108101ea0 msgr2=0x7f3108197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f30fde00640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3108101ea0 0x7f3108197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f30fde00640 1 -- 172.21.15.18:0/1995317551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3108103a40 msgr2=0x7f310819f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f30fde00640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3108103a40 0x7f310819f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f30fde00640 1 -- 172.21.15.18:0/1995317551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0009560 con 0x7f3108103080 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f3107200640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3108103a40 0x7f310819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f30fde00640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103080 0x7f3108198450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f30f000e9c0 tx=0x7f30f000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.945+0000 7f30ffe00640 1 -- 172.21.15.18:0/1995317551 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000cde0 con 0x7f3108103080 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.946+0000 7f30ffe00640 1 -- 172.21.15.18:0/1995317551 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30f00035f0 con 0x7f3108103080 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.946+0000 7f310ca00640 1 -- 172.21.15.18:0/1995317551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f8009490 con 0x7f3108103080 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.946+0000 7f30ffe00640 1 -- 172.21.15.18:0/1995317551 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00044e0 con 0x7f3108103080 2024-09-13T16:49:54.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.946+0000 7f310ca00640 1 -- 172.21.15.18:0/1995317551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31081a0350 con 0x7f3108103080 2024-09-13T16:49:54.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.947+0000 7f310ca00640 1 -- 172.21.15.18:0/1995317551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3108109450 con 0x7f3108103080 2024-09-13T16:49:54.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.949+0000 7f30ffe00640 1 -- 172.21.15.18:0/1995317551 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f30f0003760 con 0x7f3108103080 2024-09-13T16:49:54.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.950+0000 7f30ffe00640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f30ec0a1110 0x7f30ec0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:54.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.951+0000 7f30ffe00640 1 -- 172.21.15.18:0/1995317551 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f30f0014070 con 0x7f3108103080 2024-09-13T16:49:54.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.951+0000 7f3106800640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f30ec0a1110 0x7f30ec0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:54.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.951+0000 7f3106800640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f30ec0a1110 0x7f30ec0a35d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f30f80304b0 tx=0x7f30f8030580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:54.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:54.954+0000 7f30ffe00640 1 -- 172.21.15.18:0/1995317551 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f30f0096460 con 0x7f3108103080 2024-09-13T16:49:55.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:54 smithi144 ceph-mon[35328]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-13T16:49:55.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:54 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/4195229847' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:55.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:54 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3560331404' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T16:49:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:54 smithi094 ceph-mon[35259]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-13T16:49:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:54 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/4195229847' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:55.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:54 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3560331404' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T16:49:55.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.171+0000 7f310ca00640 1 -- 172.21.15.18:0/1995317551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f3108108ec0 con 0x7f3108103080 2024-09-13T16:49:55.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:54 smithi018 ceph-mon[30981]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-13T16:49:55.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:54 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4195229847' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:49:55.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:54 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3560331404' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T16:49:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.770+0000 7f30ffe00640 1 -- 172.21.15.18:0/1995317551 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f30f0099a80 con 0x7f3108103080 2024-09-13T16:49:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 -- 172.21.15.18:0/1995317551 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f30ec0a1110 msgr2=0x7f30ec0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f30ec0a1110 0x7f30ec0a35d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f30f80304b0 tx=0x7f30f8030580 comp rx=0 tx=0).stop 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 -- 172.21.15.18:0/1995317551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103080 msgr2=0x7f3108198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103080 0x7f3108198450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f30f000e9c0 tx=0x7f30f000ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 -- 172.21.15.18:0/1995317551 shutdown_connections 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f30ec0a1110 0x7f30ec0a35d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3108103a40 0x7f310819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103080 0x7f3108198450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 --2- 172.21.15.18:0/1995317551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3108101ea0 0x7f3108197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 -- 172.21.15.18:0/1995317551 >> 172.21.15.18:0/1995317551 conn(0x7f31080fd670 msgr2=0x7f3108106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.774+0000 7f310ca00640 1 -- 172.21.15.18:0/1995317551 shutdown_connections 2024-09-13T16:49:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.775+0000 7f310ca00640 1 -- 172.21.15.18:0/1995317551 wait complete. 2024-09-13T16:49:55.800 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-13T16:49:55.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.965+0000 7fc391400640 1 -- 172.21.15.18:0/1118702219 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c103b50 msgr2=0x7fc38c10a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:55.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.965+0000 7fc391400640 1 --2- 172.21.15.18:0/1118702219 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c103b50 0x7fc38c10a3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc384009be0 tx=0x7fc38402a6d0 comp rx=0 tx=0).stop 2024-09-13T16:49:55.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.965+0000 7fc391400640 1 -- 172.21.15.18:0/1118702219 shutdown_connections 2024-09-13T16:49:55.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.965+0000 7fc391400640 1 --2- 172.21.15.18:0/1118702219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc38c103190 0x7fc38c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:55.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.965+0000 7fc391400640 1 --2- 172.21.15.18:0/1118702219 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c103b50 0x7fc38c10a3e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:55.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.965+0000 7fc391400640 1 --2- 172.21.15.18:0/1118702219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc38c101fa0 0x7fc38c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:55.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.965+0000 7fc391400640 1 -- 172.21.15.18:0/1118702219 >> 172.21.15.18:0/1118702219 conn(0x7fc38c0fd700 msgr2=0x7fc38c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:55.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.965+0000 7fc391400640 1 -- 172.21.15.18:0/1118702219 shutdown_connections 2024-09-13T16:49:55.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.965+0000 7fc391400640 1 -- 172.21.15.18:0/1118702219 wait complete. 2024-09-13T16:49:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc391400640 1 Processor -- start 2024-09-13T16:49:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc391400640 1 -- start start 2024-09-13T16:49:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc391400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc38c101fa0 0x7fc38c197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc391400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc38c103190 0x7fc38c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc391400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c103b50 0x7fc38c19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc391400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c19fae0 con 0x7fc38c103190 2024-09-13T16:49:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc391400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c19fc50 con 0x7fc38c103b50 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc391400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c19fe10 con 0x7fc38c101fa0 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc383e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc38c103190 0x7fc38c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc383e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc38c103190 0x7fc38c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53526/0 (socket says 172.21.15.18:53526) 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc383e00640 1 -- 172.21.15.18:0/3924195064 learned_addr learned my addr 172.21.15.18:0/3924195064 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.966+0000 7fc38a800640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc38c101fa0 0x7fc38c197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc38b200640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c103b50 0x7fc38c19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc383e00640 1 -- 172.21.15.18:0/3924195064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc38c101fa0 msgr2=0x7fc38c197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc383e00640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc38c101fa0 0x7fc38c197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc383e00640 1 -- 172.21.15.18:0/3924195064 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c103b50 msgr2=0x7fc38c19f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc383e00640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c103b50 0x7fc38c19f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc383e00640 1 -- 172.21.15.18:0/3924195064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374009560 con 0x7fc38c103190 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc383e00640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc38c103190 0x7fc38c198530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc37400e9c0 tx=0x7fc37400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc383400640 1 -- 172.21.15.18:0/3924195064 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400cde0 con 0x7fc38c103190 2024-09-13T16:49:55.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc391400640 1 -- 172.21.15.18:0/3924195064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc384009840 con 0x7fc38c103190 2024-09-13T16:49:55.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc383400640 1 -- 172.21.15.18:0/3924195064 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3740035f0 con 0x7fc38c103190 2024-09-13T16:49:55.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.967+0000 7fc383400640 1 -- 172.21.15.18:0/3924195064 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3740044e0 con 0x7fc38c103190 2024-09-13T16:49:55.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.968+0000 7fc391400640 1 -- 172.21.15.18:0/3924195064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c1a0470 con 0x7fc38c103190 2024-09-13T16:49:55.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.969+0000 7fc391400640 1 -- 172.21.15.18:0/3924195064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c109400 con 0x7fc38c103190 2024-09-13T16:49:55.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.971+0000 7fc383400640 1 -- 172.21.15.18:0/3924195064 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc374003760 con 0x7fc38c103190 2024-09-13T16:49:55.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.972+0000 7fc383400640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc3700a1090 0x7fc3700a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:55.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.972+0000 7fc383400640 1 -- 172.21.15.18:0/3924195064 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc374014070 con 0x7fc38c103190 2024-09-13T16:49:55.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.972+0000 7fc38a800640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc3700a1090 0x7fc3700a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:55.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.973+0000 7fc38a800640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc3700a1090 0x7fc3700a3550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc38c102ff0 tx=0x7fc37c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:55.974+0000 7fc383400640 1 -- 172.21.15.18:0/3924195064 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc374096680 con 0x7fc38c103190 2024-09-13T16:49:56.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:55 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3560331404' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T16:49:56.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:55 smithi144 ceph-mon[35328]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:56.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:55 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1995317551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T16:49:56.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:55 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T16:49:56.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:55 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3560331404' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T16:49:56.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:55 smithi094 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:56.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:55 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1995317551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T16:49:56.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:55 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T16:49:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.196+0000 7fc391400640 1 -- 172.21.15.18:0/3924195064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fc38c10d860 con 0x7fc38c103190 2024-09-13T16:49:56.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:55 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3560331404' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T16:49:56.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:55 smithi018 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:56.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:55 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1995317551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T16:49:56.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:55 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T16:49:56.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.775+0000 7fc383400640 1 -- 172.21.15.18:0/3924195064 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc374099ca0 con 0x7fc38c103190 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.778+0000 7fc391400640 1 -- 172.21.15.18:0/3924195064 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc3700a1090 msgr2=0x7fc3700a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.778+0000 7fc391400640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc3700a1090 0x7fc3700a3550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc38c102ff0 tx=0x7fc37c005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.778+0000 7fc391400640 1 -- 172.21.15.18:0/3924195064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc38c103190 msgr2=0x7fc38c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.778+0000 7fc391400640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc38c103190 0x7fc38c198530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc37400e9c0 tx=0x7fc37400ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.778+0000 7fc391400640 1 -- 172.21.15.18:0/3924195064 shutdown_connections 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.778+0000 7fc391400640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc3700a1090 0x7fc3700a3550 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.778+0000 7fc391400640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc38c103190 0x7fc38c198530 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.778+0000 7fc391400640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc38c103b50 0x7fc38c19f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.778+0000 7fc391400640 1 --2- 172.21.15.18:0/3924195064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc38c101fa0 0x7fc38c197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.778+0000 7fc391400640 1 -- 172.21.15.18:0/3924195064 >> 172.21.15.18:0/3924195064 conn(0x7fc38c0fd700 msgr2=0x7fc38c1065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.779+0000 7fc391400640 1 -- 172.21.15.18:0/3924195064 shutdown_connections 2024-09-13T16:49:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.779+0000 7fc391400640 1 -- 172.21.15.18:0/3924195064 wait complete. 2024-09-13T16:49:56.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-13T16:49:56.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.963+0000 7f0c5b200640 1 -- 172.21.15.18:0/821399943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c5c103a40 msgr2=0x7f0c5c10a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:56.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.963+0000 7f0c5b200640 1 --2- 172.21.15.18:0/821399943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c5c103a40 0x7f0c5c10a360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009ca0 tx=0x7f0c5402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:49:56.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.964+0000 7f0c5b200640 1 -- 172.21.15.18:0/821399943 shutdown_connections 2024-09-13T16:49:56.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.964+0000 7f0c5b200640 1 --2- 172.21.15.18:0/821399943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c5c103a40 0x7f0c5c10a360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:56.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.964+0000 7f0c5b200640 1 --2- 172.21.15.18:0/821399943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c103080 0x7f0c5c103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:56.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.964+0000 7f0c5b200640 1 --2- 172.21.15.18:0/821399943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5c101ea0 0x7f0c5c1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:56.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.964+0000 7f0c5b200640 1 -- 172.21.15.18:0/821399943 >> 172.21.15.18:0/821399943 conn(0x7f0c5c0fd670 msgr2=0x7f0c5c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:56.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.964+0000 7f0c5b200640 1 -- 172.21.15.18:0/821399943 shutdown_connections 2024-09-13T16:49:56.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.964+0000 7f0c5b200640 1 -- 172.21.15.18:0/821399943 wait complete. 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.964+0000 7f0c5b200640 1 Processor -- start 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c5b200640 1 -- start start 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c5b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c5c101ea0 0x7f0c5c197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c5b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c103080 0x7f0c5c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c5b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5c103a40 0x7f0c5c19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c5b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c19f980 con 0x7f0c5c103a40 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c5b200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c19faf0 con 0x7f0c5c103080 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c5b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c19fcb0 con 0x7f0c5c101ea0 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c59e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c5c101ea0 0x7f0c5c197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c59e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c5c101ea0 0x7f0c5c197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:48640/0 (socket says 172.21.15.18:48640) 2024-09-13T16:49:56.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c59e00640 1 -- 172.21.15.18:0/2153974249 learned_addr learned my addr 172.21.15.18:0/2153974249 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c5a800640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5c103a40 0x7f0c5c19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.965+0000 7f0c53e00640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c103080 0x7f0c5c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c59e00640 1 -- 172.21.15.18:0/2153974249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c103080 msgr2=0x7f0c5c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c59e00640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c103080 0x7f0c5c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c59e00640 1 -- 172.21.15.18:0/2153974249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5c103a40 msgr2=0x7f0c5c19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c59e00640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5c103a40 0x7f0c5c19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c59e00640 1 -- 172.21.15.18:0/2153974249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c009490 con 0x7f0c5c101ea0 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c59e00640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c5c101ea0 0x7f0c5c197e90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00e9c0 tx=0x7f0c4c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c52a00640 1 -- 172.21.15.18:0/2153974249 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00cde0 con 0x7f0c5c101ea0 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c52a00640 1 -- 172.21.15.18:0/2153974249 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c4c0108f0 con 0x7f0c5c101ea0 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c5b200640 1 -- 172.21.15.18:0/2153974249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c54009900 con 0x7f0c5c101ea0 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c52a00640 1 -- 172.21.15.18:0/2153974249 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0188c0 con 0x7f0c5c101ea0 2024-09-13T16:49:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.966+0000 7f0c5b200640 1 -- 172.21.15.18:0/2153974249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c1a0280 con 0x7f0c5c101ea0 2024-09-13T16:49:56.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.967+0000 7f0c5b200640 1 -- 172.21.15.18:0/2153974249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c109360 con 0x7f0c5c101ea0 2024-09-13T16:49:56.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.969+0000 7f0c52a00640 1 -- 172.21.15.18:0/2153974249 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0c4c010a60 con 0x7f0c5c101ea0 2024-09-13T16:49:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.971+0000 7f0c52a00640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c400a1110 0x7f0c400a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.971+0000 7f0c52a00640 1 -- 172.21.15.18:0/2153974249 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0c4c014070 con 0x7f0c5c101ea0 2024-09-13T16:49:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.971+0000 7f0c53e00640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c400a1110 0x7f0c400a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.971+0000 7f0c53e00640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c400a1110 0x7f0c400a35d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c1993a0 tx=0x7f0c44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:56.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:56.972+0000 7f0c52a00640 1 -- 172.21.15.18:0/2153974249 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0c4c096b90 con 0x7f0c5c101ea0 2024-09-13T16:49:57.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:56 smithi144 ceph-mon[35328]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-13T16:49:57.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:56 smithi144 ceph-mon[35328]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T16:49:57.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:56 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T16:49:57.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:56 smithi144 ceph-mon[35328]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T16:49:57.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:56 smithi144 ceph-mon[35328]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:57.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:56 smithi144 ceph-mon[35328]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-09-13T16:49:57.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:56 smithi144 ceph-mon[35328]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-09-13T16:49:57.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:56 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3924195064' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T16:49:57.079 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:56 smithi094 ceph-mon[35259]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-13T16:49:57.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:56 smithi094 ceph-mon[35259]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T16:49:57.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:56 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T16:49:57.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:56 smithi094 ceph-mon[35259]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T16:49:57.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:56 smithi094 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:57.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:56 smithi094 ceph-mon[35259]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-09-13T16:49:57.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:56 smithi094 ceph-mon[35259]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-09-13T16:49:57.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:56 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3924195064' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T16:49:57.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.193+0000 7f0c5b200640 1 -- 172.21.15.18:0/2153974249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f0c5c10d820 con 0x7f0c5c101ea0 2024-09-13T16:49:57.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:56 smithi018 ceph-mon[30981]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-13T16:49:57.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:56 smithi018 ceph-mon[30981]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T16:49:57.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:56 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T16:49:57.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:56 smithi018 ceph-mon[30981]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T16:49:57.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:56 smithi018 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T16:49:57.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:56 smithi018 ceph-mon[30981]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-09-13T16:49:57.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:56 smithi018 ceph-mon[30981]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-09-13T16:49:57.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:56 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3924195064' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T16:49:57.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.789+0000 7f0c52a00640 1 -- 172.21.15.18:0/2153974249 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f0c4c09a1b0 con 0x7f0c5c101ea0 2024-09-13T16:49:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 -- 172.21.15.18:0/2153974249 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c400a1110 msgr2=0x7f0c400a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c400a1110 0x7f0c400a35d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c1993a0 tx=0x7f0c44005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 -- 172.21.15.18:0/2153974249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c5c101ea0 msgr2=0x7f0c5c197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c5c101ea0 0x7f0c5c197e90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00e9c0 tx=0x7f0c4c00ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 -- 172.21.15.18:0/2153974249 shutdown_connections 2024-09-13T16:49:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c400a1110 0x7f0c400a35d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c5c103a40 0x7f0c5c19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:57.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c5c103080 0x7f0c5c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:57.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 --2- 172.21.15.18:0/2153974249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c5c101ea0 0x7f0c5c197e90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:57.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 -- 172.21.15.18:0/2153974249 >> 172.21.15.18:0/2153974249 conn(0x7f0c5c0fd670 msgr2=0x7f0c5c106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:57.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 -- 172.21.15.18:0/2153974249 shutdown_connections 2024-09-13T16:49:57.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.792+0000 7f0c5b200640 1 -- 172.21.15.18:0/2153974249 wait complete. 2024-09-13T16:49:57.812 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-13T16:49:57.812 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-09-13T16:49:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.971+0000 7f5bc6800640 1 -- 172.21.15.18:0/505632748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5bc0101ea0 msgr2=0x7f5bc01022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.971+0000 7f5bc6800640 1 --2- 172.21.15.18:0/505632748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5bc0101ea0 0x7f5bc01022a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009900 tx=0x7f5bb402a400 comp rx=0 tx=0).stop 2024-09-13T16:49:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.971+0000 7f5bc6800640 1 -- 172.21.15.18:0/505632748 shutdown_connections 2024-09-13T16:49:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.971+0000 7f5bc6800640 1 --2- 172.21.15.18:0/505632748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0103080 0x7f5bc0103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.971+0000 7f5bc6800640 1 --2- 172.21.15.18:0/505632748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0103a40 0x7f5bc010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.971+0000 7f5bc6800640 1 --2- 172.21.15.18:0/505632748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5bc0101ea0 0x7f5bc01022a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.971+0000 7f5bc6800640 1 -- 172.21.15.18:0/505632748 >> 172.21.15.18:0/505632748 conn(0x7f5bc00fd670 msgr2=0x7f5bc00ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:57.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.972+0000 7f5bc6800640 1 -- 172.21.15.18:0/505632748 shutdown_connections 2024-09-13T16:49:57.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.972+0000 7f5bc6800640 1 -- 172.21.15.18:0/505632748 wait complete. 2024-09-13T16:49:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.972+0000 7f5bc6800640 1 Processor -- start 2024-09-13T16:49:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc6800640 1 -- start start 2024-09-13T16:49:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0101ea0 0x7f5bc0197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc6800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5bc0103080 0x7f5bc0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0103a40 0x7f5bc019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc6800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc019f9c0 con 0x7f5bc0103a40 2024-09-13T16:49:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc6800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc019fb30 con 0x7f5bc0103080 2024-09-13T16:49:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc019fcf0 con 0x7f5bc0101ea0 2024-09-13T16:49:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc4a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5bc0103080 0x7f5bc0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:57.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc4a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5bc0103080 0x7f5bc0198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:43636/0 (socket says 172.21.15.18:43636) 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc4a00640 1 -- 172.21.15.18:0/4099217340 learned_addr learned my addr 172.21.15.18:0/4099217340 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc5e00640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0103a40 0x7f5bc019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc5400640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0101ea0 0x7f5bc0197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc4a00640 1 -- 172.21.15.18:0/4099217340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0101ea0 msgr2=0x7f5bc0197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.973+0000 7f5bc4a00640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0101ea0 0x7f5bc0197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.974+0000 7f5bc4a00640 1 -- 172.21.15.18:0/4099217340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0103a40 msgr2=0x7f5bc019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.974+0000 7f5bc4a00640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0103a40 0x7f5bc019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.974+0000 7f5bc4a00640 1 -- 172.21.15.18:0/4099217340 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac009490 con 0x7f5bc0103080 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.974+0000 7f5bc4a00640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5bc0103080 0x7f5bc0198410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00ea60 tx=0x7f5bac00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.974+0000 7f5bbe000640 1 -- 172.21.15.18:0/4099217340 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac00cde0 con 0x7f5bc0103080 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.974+0000 7f5bbe000640 1 -- 172.21.15.18:0/4099217340 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bac0035f0 con 0x7f5bc0103080 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.974+0000 7f5bc6800640 1 -- 172.21.15.18:0/4099217340 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb4009560 con 0x7f5bc0103080 2024-09-13T16:49:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.974+0000 7f5bbe000640 1 -- 172.21.15.18:0/4099217340 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0044e0 con 0x7f5bc0103080 2024-09-13T16:49:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.974+0000 7f5bc6800640 1 -- 172.21.15.18:0/4099217340 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc01a02c0 con 0x7f5bc0103080 2024-09-13T16:49:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.975+0000 7f5bc6800640 1 -- 172.21.15.18:0/4099217340 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc01022a0 con 0x7f5bc0103080 2024-09-13T16:49:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.977+0000 7f5bbe000640 1 -- 172.21.15.18:0/4099217340 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5bac003a60 con 0x7f5bc0103080 2024-09-13T16:49:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.979+0000 7f5bbe000640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ba80a1090 0x7f5ba80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.979+0000 7f5bbe000640 1 -- 172.21.15.18:0/4099217340 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5bac014070 con 0x7f5bc0103080 2024-09-13T16:49:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.979+0000 7f5bc5400640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ba80a1090 0x7f5ba80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.980+0000 7f5bc5400640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ba80a1090 0x7f5ba80a3550 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4005ab0 tx=0x7f5bb40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:57.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:57.982+0000 7f5bbe000640 1 -- 172.21.15.18:0/4099217340 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5bac0964d0 con 0x7f5bc0103080 2024-09-13T16:49:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:57 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] up:active 2024-09-13T16:49:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:57 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3924195064' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T16:49:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:57 smithi094 ceph-mon[35259]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T16:49:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:57 smithi094 ceph-mon[35259]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T16:49:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:57 smithi094 ceph-mon[35259]: Cluster is now healthy 2024-09-13T16:49:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:57 smithi094 ceph-mon[35259]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-09-13T16:49:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:57 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:creating} 9 up:standby 2024-09-13T16:49:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:57 smithi094 ceph-mon[35259]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-13T16:49:58.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:57 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2153974249' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T16:49:58.163 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:57 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T16:49:58.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.187+0000 7f5bc6800640 1 -- 172.21.15.18:0/4099217340 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bc00608f0 con 0x7f5ba80a1090 2024-09-13T16:49:58.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:57 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] up:active 2024-09-13T16:49:58.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:57 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3924195064' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T16:49:58.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:57 smithi018 ceph-mon[30981]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T16:49:58.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:57 smithi018 ceph-mon[30981]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T16:49:58.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:57 smithi018 ceph-mon[30981]: Cluster is now healthy 2024-09-13T16:49:58.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:57 smithi018 ceph-mon[30981]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-09-13T16:49:58.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:57 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:creating} 9 up:standby 2024-09-13T16:49:58.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:57 smithi018 ceph-mon[30981]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-13T16:49:58.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:57 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2153974249' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T16:49:58.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:57 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T16:49:58.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.214+0000 7f5bbe000640 1 -- 172.21.15.18:0/4099217340 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5bc00608f0 con 0x7f5ba80a1090 2024-09-13T16:49:58.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 -- 172.21.15.18:0/4099217340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ba80a1090 msgr2=0x7f5ba80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:58.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ba80a1090 0x7f5ba80a3550 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4005ab0 tx=0x7f5bb40314a0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 -- 172.21.15.18:0/4099217340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5bc0103080 msgr2=0x7f5bc0198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:58.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5bc0103080 0x7f5bc0198410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00ea60 tx=0x7f5bac00ef20 comp rx=0 tx=0).stop 2024-09-13T16:49:58.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 -- 172.21.15.18:0/4099217340 shutdown_connections 2024-09-13T16:49:58.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5ba80a1090 0x7f5ba80a3550 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0103a40 0x7f5bc019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5bc0103080 0x7f5bc0198410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 --2- 172.21.15.18:0/4099217340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0101ea0 0x7f5bc0197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 -- 172.21.15.18:0/4099217340 >> 172.21.15.18:0/4099217340 conn(0x7f5bc00fd670 msgr2=0x7f5bc0106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:58.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 -- 172.21.15.18:0/4099217340 shutdown_connections 2024-09-13T16:49:58.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.216+0000 7f5bc6800640 1 -- 172.21.15.18:0/4099217340 wait complete. 2024-09-13T16:49:58.235 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-13T16:49:58.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:57 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] up:active 2024-09-13T16:49:58.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:57 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3924195064' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T16:49:58.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:57 smithi144 ceph-mon[35328]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T16:49:58.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:57 smithi144 ceph-mon[35328]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T16:49:58.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:57 smithi144 ceph-mon[35328]: Cluster is now healthy 2024-09-13T16:49:58.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:57 smithi144 ceph-mon[35328]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-09-13T16:49:58.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:57 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:creating} 9 up:standby 2024-09-13T16:49:58.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:57 smithi144 ceph-mon[35328]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-13T16:49:58.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:57 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2153974249' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T16:49:58.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:57 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T16:49:58.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.394+0000 7fdc5a200640 1 -- 172.21.15.18:0/2186469274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc54100f60 msgr2=0x7fdc541013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:58.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.394+0000 7fdc5a200640 1 --2- 172.21.15.18:0/2186469274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc54100f60 0x7fdc541013e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009900 tx=0x7fdc4002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.394+0000 7fdc5a200640 1 -- 172.21.15.18:0/2186469274 shutdown_connections 2024-09-13T16:49:58.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.394+0000 7fdc5a200640 1 --2- 172.21.15.18:0/2186469274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc54100f60 0x7fdc541013e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.394+0000 7fdc5a200640 1 --2- 172.21.15.18:0/2186469274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc54101920 0x7fdc541081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.394+0000 7fdc5a200640 1 --2- 172.21.15.18:0/2186469274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc540ffd70 0x7fdc54100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.394+0000 7fdc5a200640 1 -- 172.21.15.18:0/2186469274 >> 172.21.15.18:0/2186469274 conn(0x7fdc540fb4d0 msgr2=0x7fdc540fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.394+0000 7fdc5a200640 1 -- 172.21.15.18:0/2186469274 shutdown_connections 2024-09-13T16:49:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.394+0000 7fdc5a200640 1 -- 172.21.15.18:0/2186469274 wait complete. 2024-09-13T16:49:58.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.395+0000 7fdc5a200640 1 Processor -- start 2024-09-13T16:49:58.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.395+0000 7fdc5a200640 1 -- start start 2024-09-13T16:49:58.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc5a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc540ffd70 0x7fdc54074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:58.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc5a200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc54100f60 0x7fdc540728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:58.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc5a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc54101920 0x7fdc54072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc5a200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54073540 con 0x7fdc54101920 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc5a200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540736b0 con 0x7fdc54100f60 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc5a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5419fe50 con 0x7fdc540ffd70 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc52a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc54100f60 0x7fdc540728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc52a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc54100f60 0x7fdc540728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:43666/0 (socket says 172.21.15.18:43666) 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc52a00640 1 -- 172.21.15.18:0/4259521838 learned_addr learned my addr 172.21.15.18:0/4259521838 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc540ffd70 0x7fdc54074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc53e00640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc54101920 0x7fdc54072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc52a00640 1 -- 172.21.15.18:0/4259521838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc540ffd70 msgr2=0x7fdc54074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc52a00640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc540ffd70 0x7fdc54074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc52a00640 1 -- 172.21.15.18:0/4259521838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc54101920 msgr2=0x7fdc54072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc52a00640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc54101920 0x7fdc54072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.396+0000 7fdc52a00640 1 -- 172.21.15.18:0/4259521838 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c009840 con 0x7fdc54100f60 2024-09-13T16:49:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.397+0000 7fdc52a00640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc54100f60 0x7fdc540728a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009230 tx=0x7fdc40003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.397+0000 7fdc4be00640 1 -- 172.21.15.18:0/4259521838 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40005d50 con 0x7fdc54100f60 2024-09-13T16:49:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.397+0000 7fdc4be00640 1 -- 172.21.15.18:0/4259521838 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc40031a60 con 0x7fdc54100f60 2024-09-13T16:49:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.397+0000 7fdc4be00640 1 -- 172.21.15.18:0/4259521838 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4003bb70 con 0x7fdc54100f60 2024-09-13T16:49:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.397+0000 7fdc5a200640 1 -- 172.21.15.18:0/4259521838 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc40009560 con 0x7fdc54100f60 2024-09-13T16:49:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.397+0000 7fdc5a200640 1 -- 172.21.15.18:0/4259521838 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc541a0370 con 0x7fdc54100f60 2024-09-13T16:49:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.398+0000 7fdc5a200640 1 -- 172.21.15.18:0/4259521838 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc541071f0 con 0x7fdc54100f60 2024-09-13T16:49:58.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.400+0000 7fdc4be00640 1 -- 172.21.15.18:0/4259521838 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdc4003bcd0 con 0x7fdc54100f60 2024-09-13T16:49:58.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.401+0000 7fdc4be00640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdc380a1090 0x7fdc380a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:58.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.401+0000 7fdc4be00640 1 -- 172.21.15.18:0/4259521838 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fdc400ed350 con 0x7fdc54100f60 2024-09-13T16:49:58.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.401+0000 7fdc53400640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdc380a1090 0x7fdc380a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:58.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.402+0000 7fdc53400640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdc380a1090 0x7fdc380a3550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc54100dc0 tx=0x7fdc44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:58.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.403+0000 7fdc4be00640 1 -- 172.21.15.18:0/4259521838 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdc400b6890 con 0x7fdc54100f60 2024-09-13T16:49:58.460 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:49:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:49:58.193+0000 7f34d7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:49:58.461 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:49:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:49:58.193+0000 7f34d7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:49:58.461 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:49:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:49:58.193+0000 7f34d7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:49:58.461 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:49:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:49:58.193+0000 7f34d7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:49:58.461 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 16:49:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T16:49:58.193+0000 7f34d7e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T16:49:58.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.613+0000 7fdc5a200640 1 -- 172.21.15.18:0/4259521838 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc5402c450 con 0x7fdc380a1090 2024-09-13T16:49:58.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.638+0000 7fdc4be00640 1 -- 172.21.15.18:0/4259521838 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdc5402c450 con 0x7fdc380a1090 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 -- 172.21.15.18:0/4259521838 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdc380a1090 msgr2=0x7fdc380a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdc380a1090 0x7fdc380a3550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc54100dc0 tx=0x7fdc44005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 -- 172.21.15.18:0/4259521838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc54100f60 msgr2=0x7fdc540728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc54100f60 0x7fdc540728a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009230 tx=0x7fdc40003c10 comp rx=0 tx=0).stop 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 -- 172.21.15.18:0/4259521838 shutdown_connections 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdc380a1090 0x7fdc380a3550 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc54101920 0x7fdc54072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc54100f60 0x7fdc540728a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 --2- 172.21.15.18:0/4259521838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc540ffd70 0x7fdc54074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 -- 172.21.15.18:0/4259521838 >> 172.21.15.18:0/4259521838 conn(0x7fdc540fb4d0 msgr2=0x7fdc541043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:58.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.640+0000 7fdc5a200640 1 -- 172.21.15.18:0/4259521838 shutdown_connections 2024-09-13T16:49:58.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.641+0000 7fdc5a200640 1 -- 172.21.15.18:0/4259521838 wait complete. 2024-09-13T16:49:58.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-13T16:49:58.661 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:58 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b[65662]: 2024-09-13T16:49:58.417+0000 7f4883cf7640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T16:49:58.661 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 16:49:58 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b[65662]: 2024-09-13T16:49:58.417+0000 7f4883cf7640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T16:49:58.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.819+0000 7f5750000640 1 -- 172.21.15.18:0/3222337158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5748072f10 msgr2=0x7f5748073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:58.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.819+0000 7f5750000640 1 --2- 172.21.15.18:0/3222337158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5748072f10 0x7f5748073370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5734009900 tx=0x7f573402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.819+0000 7f5750000640 1 -- 172.21.15.18:0/3222337158 shutdown_connections 2024-09-13T16:49:58.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.819+0000 7f5750000640 1 --2- 172.21.15.18:0/3222337158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5748072f10 0x7f5748073370 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.819+0000 7f5750000640 1 --2- 172.21.15.18:0/3222337158 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5748107be0 0x7f574810a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.819+0000 7f5750000640 1 --2- 172.21.15.18:0/3222337158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57480744f0 0x7f5748072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.819+0000 7f5750000640 1 -- 172.21.15.18:0/3222337158 >> 172.21.15.18:0/3222337158 conn(0x7f57480fb4d0 msgr2=0x7f57480fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.820+0000 7f5750000640 1 -- 172.21.15.18:0/3222337158 shutdown_connections 2024-09-13T16:49:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.820+0000 7f5750000640 1 -- 172.21.15.18:0/3222337158 wait complete. 2024-09-13T16:49:58.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.820+0000 7f5750000640 1 Processor -- start 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f5750000640 1 -- start start 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f5750000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5748072f10 0x7f5748197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f5750000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57480744f0 0x7f57481984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f5750000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5748107be0 0x7f574819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f5750000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574819fa90 con 0x7f5748072f10 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f5750000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574819fc00 con 0x7f57480744f0 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f5750000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574819fdc0 con 0x7f5748107be0 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f574d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5748072f10 0x7f5748197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f574cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57480744f0 0x7f57481984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f574d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5748072f10 0x7f5748197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53654/0 (socket says 172.21.15.18:53654) 2024-09-13T16:49:58.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f574d600640 1 -- 172.21.15.18:0/434608678 learned_addr learned my addr 172.21.15.18:0/434608678 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f574cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57480744f0 0x7f57481984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:43686/0 (socket says 172.21.15.18:43686) 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.821+0000 7f574e000640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5748107be0 0x7f574819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f574d600640 1 -- 172.21.15.18:0/434608678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5748107be0 msgr2=0x7f574819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f574d600640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5748107be0 0x7f574819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f574d600640 1 -- 172.21.15.18:0/434608678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57480744f0 msgr2=0x7f57481984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f574d600640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57480744f0 0x7f57481984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f574d600640 1 -- 172.21.15.18:0/434608678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740009840 con 0x7f5748072f10 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f574cc00640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57480744f0 0x7f57481984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f574e000640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5748107be0 0x7f574819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f574d600640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5748072f10 0x7f5748197fa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f573c00e9f0 tx=0x7f573c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f5746000640 1 -- 172.21.15.18:0/434608678 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c009720 con 0x7f5748072f10 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f5746000640 1 -- 172.21.15.18:0/434608678 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f573c00cd80 con 0x7f5748072f10 2024-09-13T16:49:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f5746000640 1 -- 172.21.15.18:0/434608678 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c010430 con 0x7f5748072f10 2024-09-13T16:49:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.822+0000 7f5750000640 1 -- 172.21.15.18:0/434608678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5734009560 con 0x7f5748072f10 2024-09-13T16:49:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.823+0000 7f5750000640 1 -- 172.21.15.18:0/434608678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57481a03a0 con 0x7f5748072f10 2024-09-13T16:49:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.824+0000 7f5750000640 1 -- 172.21.15.18:0/434608678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5748106250 con 0x7f5748072f10 2024-09-13T16:49:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.825+0000 7f5746000640 1 -- 172.21.15.18:0/434608678 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f573c005020 con 0x7f5748072f10 2024-09-13T16:49:58.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.827+0000 7f5746000640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f57300a1090 0x7f57300a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:58.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.828+0000 7f5746000640 1 -- 172.21.15.18:0/434608678 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f573c014070 con 0x7f5748072f10 2024-09-13T16:49:58.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.828+0000 7f574cc00640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f57300a1090 0x7f57300a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:58.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.828+0000 7f574cc00640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f57300a1090 0x7f57300a3550 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f573402a9e0 tx=0x7f57340314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:58.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:58.831+0000 7f5746000640 1 -- 172.21.15.18:0/434608678 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f573c0964a0 con 0x7f5748072f10 2024-09-13T16:49:58.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:58 smithi018 ceph-mon[30981]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-13T16:49:58.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:58 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] up:active 2024-09-13T16:49:58.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:58 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T16:49:58.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:58 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 9 up:standby 2024-09-13T16:49:58.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:58 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:49:59.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.042+0000 7f5750000640 1 -- 172.21.15.18:0/434608678 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f574802c450 con 0x7f57300a1090 2024-09-13T16:49:59.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.047+0000 7f5746000640 1 -- 172.21.15.18:0/434608678 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f574802c450 con 0x7f57300a1090 2024-09-13T16:49:59.050 INFO:teuthology.orchestra.run.smithi018.stdout:/volumes/qa/sv_0/729e6d29-bb5b-42ca-921c-4ad8794ce062 2024-09-13T16:49:59.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.049+0000 7f5750000640 1 -- 172.21.15.18:0/434608678 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f57300a1090 msgr2=0x7f57300a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.049+0000 7f5750000640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f57300a1090 0x7f57300a3550 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f573402a9e0 tx=0x7f57340314a0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.049+0000 7f5750000640 1 -- 172.21.15.18:0/434608678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5748072f10 msgr2=0x7f5748197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.049+0000 7f5750000640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5748072f10 0x7f5748197fa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f573c00e9f0 tx=0x7f573c00edf0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.050+0000 7f5750000640 1 -- 172.21.15.18:0/434608678 shutdown_connections 2024-09-13T16:49:59.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.050+0000 7f5750000640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5748107be0 0x7f574819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.050+0000 7f5750000640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57480744f0 0x7f57481984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.050+0000 7f5750000640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f57300a1090 0x7f57300a3550 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.050+0000 7f5750000640 1 --2- 172.21.15.18:0/434608678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5748072f10 0x7f5748197fa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.050+0000 7f5750000640 1 -- 172.21.15.18:0/434608678 >> 172.21.15.18:0/434608678 conn(0x7f57480fb4d0 msgr2=0x7f57480fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:59.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.050+0000 7f5750000640 1 -- 172.21.15.18:0/434608678 shutdown_connections 2024-09-13T16:49:59.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.050+0000 7f5750000640 1 -- 172.21.15.18:0/434608678 wait complete. 2024-09-13T16:49:59.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-13T16:49:59.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:58 smithi094 ceph-mon[35259]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-13T16:49:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:58 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] up:active 2024-09-13T16:49:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:58 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T16:49:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:58 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 9 up:standby 2024-09-13T16:49:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:58 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:49:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.228+0000 7f944f200640 1 -- 172.21.15.18:0/4212259086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9450103a40 msgr2=0x7f945010a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.228+0000 7f944f200640 1 --2- 172.21.15.18:0/4212259086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9450103a40 0x7f945010a360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9448009ca0 tx=0x7f944802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.229+0000 7f944f200640 1 -- 172.21.15.18:0/4212259086 shutdown_connections 2024-09-13T16:49:59.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.229+0000 7f944f200640 1 --2- 172.21.15.18:0/4212259086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9450103a40 0x7f945010a360 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.229+0000 7f944f200640 1 --2- 172.21.15.18:0/4212259086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9450103080 0x7f9450103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.229+0000 7f944f200640 1 --2- 172.21.15.18:0/4212259086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9450101ea0 0x7f94501022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.229+0000 7f944f200640 1 -- 172.21.15.18:0/4212259086 >> 172.21.15.18:0/4212259086 conn(0x7f94500fd670 msgr2=0x7f94500ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:59.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.229+0000 7f944f200640 1 -- 172.21.15.18:0/4212259086 shutdown_connections 2024-09-13T16:49:59.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.229+0000 7f944f200640 1 -- 172.21.15.18:0/4212259086 wait complete. 2024-09-13T16:49:59.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944f200640 1 Processor -- start 2024-09-13T16:49:59.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944f200640 1 -- start start 2024-09-13T16:49:59.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9450101ea0 0x7f9450197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:59.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9450103080 0x7f94501983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:59.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9450103a40 0x7f945019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:59.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945019f940 con 0x7f9450103080 2024-09-13T16:49:59.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945019fab0 con 0x7f9450101ea0 2024-09-13T16:49:59.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945019fc70 con 0x7f9450103a40 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9450103080 0x7f94501983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944de00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9450101ea0 0x7f9450197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9450103080 0x7f94501983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53658/0 (socket says 172.21.15.18:53658) 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944d400640 1 -- 172.21.15.18:0/3391242211 learned_addr learned my addr 172.21.15.18:0/3391242211 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.230+0000 7f944e800640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9450103a40 0x7f945019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f944de00640 1 -- 172.21.15.18:0/3391242211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9450103a40 msgr2=0x7f945019f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f944de00640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9450103a40 0x7f945019f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f944de00640 1 -- 172.21.15.18:0/3391242211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9450103080 msgr2=0x7f94501983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f944de00640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9450103080 0x7f94501983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f944de00640 1 -- 172.21.15.18:0/3391242211 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9448009900 con 0x7f9450101ea0 2024-09-13T16:49:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f944de00640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9450101ea0 0x7f9450197ea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f944000e9c0 tx=0x7f944000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f9446a00640 1 -- 172.21.15.18:0/3391242211 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944000ccc0 con 0x7f9450101ea0 2024-09-13T16:49:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f9446a00640 1 -- 172.21.15.18:0/3391242211 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94400044e0 con 0x7f9450101ea0 2024-09-13T16:49:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f944f200640 1 -- 172.21.15.18:0/3391242211 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945019ff50 con 0x7f9450101ea0 2024-09-13T16:49:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f9446a00640 1 -- 172.21.15.18:0/3391242211 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440003e70 con 0x7f9450101ea0 2024-09-13T16:49:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.231+0000 7f944f200640 1 -- 172.21.15.18:0/3391242211 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94501a0370 con 0x7f9450101ea0 2024-09-13T16:49:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.232+0000 7f944f200640 1 -- 172.21.15.18:0/3391242211 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94501022a0 con 0x7f9450101ea0 2024-09-13T16:49:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.234+0000 7f9446a00640 1 -- 172.21.15.18:0/3391242211 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9440004000 con 0x7f9450101ea0 2024-09-13T16:49:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.236+0000 7f9446a00640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94340a1090 0x7f94340a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.236+0000 7f9446a00640 1 -- 172.21.15.18:0/3391242211 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9440014070 con 0x7f9450101ea0 2024-09-13T16:49:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.236+0000 7f944d400640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94340a1090 0x7f94340a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.237+0000 7f944d400640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94340a1090 0x7f94340a3550 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9450199360 tx=0x7f943c00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.238+0000 7f9446a00640 1 -- 172.21.15.18:0/3391242211 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9440096630 con 0x7f9450101ea0 2024-09-13T16:49:59.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:58 smithi144 ceph-mon[35328]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-13T16:49:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:58 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] up:active 2024-09-13T16:49:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:58 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T16:49:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:58 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 9 up:standby 2024-09-13T16:49:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:58 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:49:59.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.443+0000 7f944f200640 1 -- 172.21.15.18:0/3391242211 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f94500608f0 con 0x7f94340a1090 2024-09-13T16:49:59.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.469+0000 7f9446a00640 1 -- 172.21.15.18:0/3391242211 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f94500608f0 con 0x7f94340a1090 2024-09-13T16:49:59.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 -- 172.21.15.18:0/3391242211 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94340a1090 msgr2=0x7f94340a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94340a1090 0x7f94340a3550 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9450199360 tx=0x7f943c00b4a0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 -- 172.21.15.18:0/3391242211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9450101ea0 msgr2=0x7f9450197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9450101ea0 0x7f9450197ea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f944000e9c0 tx=0x7f944000ee80 comp rx=0 tx=0).stop 2024-09-13T16:49:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 -- 172.21.15.18:0/3391242211 shutdown_connections 2024-09-13T16:49:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94340a1090 0x7f94340a3550 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9450103080 0x7f94501983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9450103a40 0x7f945019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 --2- 172.21.15.18:0/3391242211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9450101ea0 0x7f9450197ea0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 -- 172.21.15.18:0/3391242211 >> 172.21.15.18:0/3391242211 conn(0x7f94500fd670 msgr2=0x7f9450106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 -- 172.21.15.18:0/3391242211 shutdown_connections 2024-09-13T16:49:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.472+0000 7f944f200640 1 -- 172.21.15.18:0/3391242211 wait complete. 2024-09-13T16:49:59.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-13T16:49:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.651+0000 7fe61d800640 1 -- 172.21.15.18:0/3192094760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe618072e90 msgr2=0x7fe6180732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.651+0000 7fe61d800640 1 --2- 172.21.15.18:0/3192094760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe618072e90 0x7fe6180732f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe600009900 tx=0x7fe60002a490 comp rx=0 tx=0).stop 2024-09-13T16:49:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.651+0000 7fe61d800640 1 -- 172.21.15.18:0/3192094760 shutdown_connections 2024-09-13T16:49:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.651+0000 7fe61d800640 1 --2- 172.21.15.18:0/3192094760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe618107c20 0x7fe61810a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.651+0000 7fe61d800640 1 --2- 172.21.15.18:0/3192094760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe618072e90 0x7fe6180732f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.651+0000 7fe61d800640 1 --2- 172.21.15.18:0/3192094760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe618074470 0x7fe6180728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.651+0000 7fe61d800640 1 -- 172.21.15.18:0/3192094760 >> 172.21.15.18:0/3192094760 conn(0x7fe6180fb4d0 msgr2=0x7fe6180fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.651+0000 7fe61d800640 1 -- 172.21.15.18:0/3192094760 shutdown_connections 2024-09-13T16:49:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.651+0000 7fe61d800640 1 -- 172.21.15.18:0/3192094760 wait complete. 2024-09-13T16:49:59.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe61d800640 1 Processor -- start 2024-09-13T16:49:59.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe61d800640 1 -- start start 2024-09-13T16:49:59.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe61d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe618072e90 0x7fe618197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe61d800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe618074470 0x7fe6181984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe61d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe618107c20 0x7fe61819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe61d800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61819fa70 con 0x7fe618107c20 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe61d800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61819fbe0 con 0x7fe618074470 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe61d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61819fda0 con 0x7fe618072e90 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe616a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe618072e90 0x7fe618197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe60fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe618074470 0x7fe6181984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe616a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe618072e90 0x7fe618197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:48744/0 (socket says 172.21.15.18:48744) 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.652+0000 7fe616a00640 1 -- 172.21.15.18:0/1255109649 learned_addr learned my addr 172.21.15.18:0/1255109649 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.653+0000 7fe617400640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe618107c20 0x7fe61819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.653+0000 7fe60fe00640 1 -- 172.21.15.18:0/1255109649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe618072e90 msgr2=0x7fe618197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.653+0000 7fe60fe00640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe618072e90 0x7fe618197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.653+0000 7fe60fe00640 1 -- 172.21.15.18:0/1255109649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe618107c20 msgr2=0x7fe61819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.653+0000 7fe60fe00640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe618107c20 0x7fe61819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.653+0000 7fe60fe00640 1 -- 172.21.15.18:0/1255109649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe608009490 con 0x7fe618074470 2024-09-13T16:49:59.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.653+0000 7fe60fe00640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe618074470 0x7fe6181984c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe6000057c0 tx=0x7fe600005620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:59.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.653+0000 7fe60f400640 1 -- 172.21.15.18:0/1255109649 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600004b50 con 0x7fe618074470 2024-09-13T16:49:59.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.653+0000 7fe60f400640 1 -- 172.21.15.18:0/1255109649 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe600004cb0 con 0x7fe618074470 2024-09-13T16:49:59.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.654+0000 7fe60f400640 1 -- 172.21.15.18:0/1255109649 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600031a40 con 0x7fe618074470 2024-09-13T16:49:59.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.654+0000 7fe61d800640 1 -- 172.21.15.18:0/1255109649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe600009560 con 0x7fe618074470 2024-09-13T16:49:59.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.654+0000 7fe61d800640 1 -- 172.21.15.18:0/1255109649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6181a02f0 con 0x7fe618074470 2024-09-13T16:49:59.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.655+0000 7fe61d800640 1 -- 172.21.15.18:0/1255109649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6181069e0 con 0x7fe618074470 2024-09-13T16:49:59.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.657+0000 7fe60f400640 1 -- 172.21.15.18:0/1255109649 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe600031ba0 con 0x7fe618074470 2024-09-13T16:49:59.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.658+0000 7fe60f400640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5fc0a1110 0x7fe5fc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:49:59.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.658+0000 7fe60f400640 1 -- 172.21.15.18:0/1255109649 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe6000edf60 con 0x7fe618074470 2024-09-13T16:49:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.658+0000 7fe616a00640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5fc0a1110 0x7fe5fc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:49:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.659+0000 7fe616a00640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5fc0a1110 0x7fe5fc0a35d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe608009e60 tx=0x7fe608005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:49:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.660+0000 7fe60f400640 1 -- 172.21.15.18:0/1255109649 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe6000b7550 con 0x7fe618074470 2024-09-13T16:49:59.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.874+0000 7fe61d800640 1 -- 172.21.15.18:0/1255109649 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe61802c450 con 0x7fe5fc0a1110 2024-09-13T16:49:59.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.878+0000 7fe60f400640 1 -- 172.21.15.18:0/1255109649 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fe61802c450 con 0x7fe5fc0a1110 2024-09-13T16:49:59.881 INFO:teuthology.orchestra.run.smithi018.stdout:/volumes/qa/sv_1/128af822-984c-4fe6-bcab-bd7a84f5173a 2024-09-13T16:49:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 -- 172.21.15.18:0/1255109649 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5fc0a1110 msgr2=0x7fe5fc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5fc0a1110 0x7fe5fc0a35d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe608009e60 tx=0x7fe608005f90 comp rx=0 tx=0).stop 2024-09-13T16:49:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 -- 172.21.15.18:0/1255109649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe618074470 msgr2=0x7fe6181984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:49:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe618074470 0x7fe6181984c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe6000057c0 tx=0x7fe600005620 comp rx=0 tx=0).stop 2024-09-13T16:49:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 -- 172.21.15.18:0/1255109649 shutdown_connections 2024-09-13T16:49:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe5fc0a1110 0x7fe5fc0a35d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe618107c20 0x7fe61819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe618074470 0x7fe6181984c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 --2- 172.21.15.18:0/1255109649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe618072e90 0x7fe618197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:49:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 -- 172.21.15.18:0/1255109649 >> 172.21.15.18:0/1255109649 conn(0x7fe6180fb4d0 msgr2=0x7fe618103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:49:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 -- 172.21.15.18:0/1255109649 shutdown_connections 2024-09-13T16:49:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:49:59.881+0000 7fe61d800640 1 -- 172.21.15.18:0/1255109649 wait complete. 2024-09-13T16:49:59.899 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:50:00.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.054+0000 7f9091800640 1 -- 172.21.15.18:0/4231022787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f908c103190 msgr2=0x7f908c103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.054+0000 7f9091800640 1 --2- 172.21.15.18:0/4231022787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f908c103190 0x7f908c103610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9078009900 tx=0x7f907802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.054+0000 7f9091800640 1 -- 172.21.15.18:0/4231022787 shutdown_connections 2024-09-13T16:50:00.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.054+0000 7f9091800640 1 --2- 172.21.15.18:0/4231022787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908c103b50 0x7f908c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.054+0000 7f9091800640 1 --2- 172.21.15.18:0/4231022787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f908c103190 0x7f908c103610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.054+0000 7f9091800640 1 --2- 172.21.15.18:0/4231022787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f908c101fa0 0x7f908c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.054+0000 7f9091800640 1 -- 172.21.15.18:0/4231022787 >> 172.21.15.18:0/4231022787 conn(0x7f908c0fd700 msgr2=0x7f908c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:00.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.054+0000 7f9091800640 1 -- 172.21.15.18:0/4231022787 shutdown_connections 2024-09-13T16:50:00.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.054+0000 7f9091800640 1 -- 172.21.15.18:0/4231022787 wait complete. 2024-09-13T16:50:00.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.055+0000 7f9091800640 1 Processor -- start 2024-09-13T16:50:00.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.055+0000 7f9091800640 1 -- start start 2024-09-13T16:50:00.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f9091800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908c101fa0 0x7f908c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f9091800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f908c103190 0x7f908c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f9091800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f908c103b50 0x7f908c19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f9091800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c19fa80 con 0x7f908c101fa0 2024-09-13T16:50:00.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f9091800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c19fbf0 con 0x7f908c103190 2024-09-13T16:50:00.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f9091800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c19fdb0 con 0x7f908c103b50 2024-09-13T16:50:00.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908c101fa0 0x7f908c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908c101fa0 0x7f908c197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53686/0 (socket says 172.21.15.18:53686) 2024-09-13T16:50:00.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908aa00640 1 -- 172.21.15.18:0/2353593304 learned_addr learned my addr 172.21.15.18:0/2353593304 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:00.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908a000640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f908c103190 0x7f908c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908b400640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f908c103b50 0x7f908c19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908aa00640 1 -- 172.21.15.18:0/2353593304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f908c103b50 msgr2=0x7f908c19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908aa00640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f908c103b50 0x7f908c19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908aa00640 1 -- 172.21.15.18:0/2353593304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f908c103190 msgr2=0x7f908c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908aa00640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f908c103190 0x7f908c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908aa00640 1 -- 172.21.15.18:0/2353593304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084009840 con 0x7f908c101fa0 2024-09-13T16:50:00.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.056+0000 7f908b400640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f908c103b50 0x7f908c19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:50:00.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.057+0000 7f908aa00640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908c101fa0 0x7f908c197f90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f907c00e9c0 tx=0x7f907c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:00.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.057+0000 7f9083400640 1 -- 172.21.15.18:0/2353593304 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c0096e0 con 0x7f908c101fa0 2024-09-13T16:50:00.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.057+0000 7f9083400640 1 -- 172.21.15.18:0/2353593304 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f907c0044f0 con 0x7f908c101fa0 2024-09-13T16:50:00.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.057+0000 7f9083400640 1 -- 172.21.15.18:0/2353593304 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c010430 con 0x7f908c101fa0 2024-09-13T16:50:00.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.057+0000 7f9091800640 1 -- 172.21.15.18:0/2353593304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9078009560 con 0x7f908c101fa0 2024-09-13T16:50:00.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.057+0000 7f9091800640 1 -- 172.21.15.18:0/2353593304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908c1a0390 con 0x7f908c101fa0 2024-09-13T16:50:00.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.058+0000 7f9091800640 1 -- 172.21.15.18:0/2353593304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908c1094d0 con 0x7f908c101fa0 2024-09-13T16:50:00.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.060+0000 7f9083400640 1 -- 172.21.15.18:0/2353593304 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f907c0035f0 con 0x7f908c101fa0 2024-09-13T16:50:00.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.062+0000 7f9083400640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90700a1090 0x7f90700a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.062+0000 7f9083400640 1 -- 172.21.15.18:0/2353593304 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f907c014070 con 0x7f908c101fa0 2024-09-13T16:50:00.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.062+0000 7f908a000640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90700a1090 0x7f90700a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.063+0000 7f908a000640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90700a1090 0x7f90700a3550 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f907802a9e0 tx=0x7f90780314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:00.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.066+0000 7f9083400640 1 -- 172.21.15.18:0/2353593304 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f907c0d1070 con 0x7f908c101fa0 2024-09-13T16:50:00.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:59 smithi094 ceph-mon[35259]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:00.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:49:59 smithi094 ceph-mon[35259]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:00.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:59 smithi018 ceph-mon[30981]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:00.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:49:59 smithi018 ceph-mon[30981]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:00.215 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:59 smithi144 ceph-mon[35328]: from='client.24830 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:00.215 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:49:59 smithi144 ceph-mon[35328]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:00.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.294+0000 7f9091800640 1 -- 172.21.15.18:0/2353593304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f908c10d860 con 0x7f908c101fa0 2024-09-13T16:50:00.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.294+0000 7f9083400640 1 -- 172.21.15.18:0/2353593304 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10852 (secure 0 0 0) 0x7f907c099f40 con 0x7f908c101fa0 2024-09-13T16:50:00.297 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:50:00.297 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:49:28.080578+0000","modified":"2024-09-13T16:49:57.790808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24590,"mds_1":24566,"mds_2":24539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24539":{"gid":24539,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:50:00.297 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 24 2024-09-13T16:50:00.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 -- 172.21.15.18:0/2353593304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90700a1090 msgr2=0x7f90700a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90700a1090 0x7f90700a3550 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f907802a9e0 tx=0x7f90780314a0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 -- 172.21.15.18:0/2353593304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908c101fa0 msgr2=0x7f908c197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908c101fa0 0x7f908c197f90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f907c00e9c0 tx=0x7f907c00ee80 comp rx=0 tx=0).stop 2024-09-13T16:50:00.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 -- 172.21.15.18:0/2353593304 shutdown_connections 2024-09-13T16:50:00.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f908c103b50 0x7f908c19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f908c103190 0x7f908c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90700a1090 0x7f90700a3550 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 --2- 172.21.15.18:0/2353593304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908c101fa0 0x7f908c197f90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 -- 172.21.15.18:0/2353593304 >> 172.21.15.18:0/2353593304 conn(0x7f908c0fd700 msgr2=0x7f908c1066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:00.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 -- 172.21.15.18:0/2353593304 shutdown_connections 2024-09-13T16:50:00.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.297+0000 7f9091800640 1 -- 172.21.15.18:0/2353593304 wait complete. 2024-09-13T16:50:00.315 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:50:00.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.470+0000 7f16a4800640 1 -- 172.21.15.18:0/758890814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c100820 msgr2=0x7f169c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.470+0000 7f16a4800640 1 --2- 172.21.15.18:0/758890814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c100820 0x7f169c102c10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1690009860 tx=0x7f169002a340 comp rx=0 tx=0).stop 2024-09-13T16:50:00.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.470+0000 7f16a4800640 1 -- 172.21.15.18:0/758890814 shutdown_connections 2024-09-13T16:50:00.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.470+0000 7f16a4800640 1 --2- 172.21.15.18:0/758890814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f169c105a80 0x7f169c107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.470+0000 7f16a4800640 1 --2- 172.21.15.18:0/758890814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169c103150 0x7f169c105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.470+0000 7f16a4800640 1 --2- 172.21.15.18:0/758890814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c100820 0x7f169c102c10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.470+0000 7f16a4800640 1 -- 172.21.15.18:0/758890814 >> 172.21.15.18:0/758890814 conn(0x7f169c0fa420 msgr2=0x7f169c0fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:00.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.470+0000 7f16a4800640 1 -- 172.21.15.18:0/758890814 shutdown_connections 2024-09-13T16:50:00.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.470+0000 7f16a4800640 1 -- 172.21.15.18:0/758890814 wait complete. 2024-09-13T16:50:00.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a4800640 1 Processor -- start 2024-09-13T16:50:00.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a4800640 1 -- start start 2024-09-13T16:50:00.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a4800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f169c100820 0x7f169c198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a4800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103150 0x7f169c1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a4800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169c105a80 0x7f169c19f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a4800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c19fc70 con 0x7f169c103150 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a4800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c19fde0 con 0x7f169c100820 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a4800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c19ffa0 con 0x7f169c105a80 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103150 0x7f169c1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103150 0x7f169c1986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53700/0 (socket says 172.21.15.18:53700) 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.471+0000 7f16a1400640 1 -- 172.21.15.18:0/3247232338 learned_addr learned my addr 172.21.15.18:0/3247232338 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f16a2800640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169c105a80 0x7f169c19f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f16a1e00640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f169c100820 0x7f169c198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f16a1400640 1 -- 172.21.15.18:0/3247232338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169c105a80 msgr2=0x7f169c19f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f16a1400640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169c105a80 0x7f169c19f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f16a1400640 1 -- 172.21.15.18:0/3247232338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f169c100820 msgr2=0x7f169c198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f16a1400640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f169c100820 0x7f169c198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f16a1400640 1 -- 172.21.15.18:0/3247232338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1690009490 con 0x7f169c103150 2024-09-13T16:50:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f16a1400640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103150 0x7f169c1986c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f168c00e9f0 tx=0x7f168c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f1696a00640 1 -- 172.21.15.18:0/3247232338 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c0096c0 con 0x7f169c103150 2024-09-13T16:50:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f1696a00640 1 -- 172.21.15.18:0/3247232338 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f168c0054e0 con 0x7f169c103150 2024-09-13T16:50:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f16a4800640 1 -- 172.21.15.18:0/3247232338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c1a0280 con 0x7f169c103150 2024-09-13T16:50:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.472+0000 7f1696a00640 1 -- 172.21.15.18:0/3247232338 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c010430 con 0x7f169c103150 2024-09-13T16:50:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.473+0000 7f16a4800640 1 -- 172.21.15.18:0/3247232338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c1a0790 con 0x7f169c103150 2024-09-13T16:50:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.474+0000 7f16a4800640 1 -- 172.21.15.18:0/3247232338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c10b6c0 con 0x7f169c103150 2024-09-13T16:50:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.475+0000 7f1696a00640 1 -- 172.21.15.18:0/3247232338 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f168c005020 con 0x7f169c103150 2024-09-13T16:50:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.477+0000 7f1696a00640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16840a1110 0x7f16840a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.477+0000 7f1696a00640 1 -- 172.21.15.18:0/3247232338 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f168c014070 con 0x7f169c103150 2024-09-13T16:50:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.477+0000 7f16a1e00640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16840a1110 0x7f16840a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.478+0000 7f16a1e00640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16840a1110 0x7f16840a35d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f169002a930 tx=0x7f1690030580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.480+0000 7f1696a00640 1 -- 172.21.15.18:0/3247232338 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f168c096360 con 0x7f169c103150 2024-09-13T16:50:00.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.661+0000 7f16a4800640 1 -- 172.21.15.18:0/3247232338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f169c10b850 con 0x7f169c103150 2024-09-13T16:50:00.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.663+0000 7f1696a00640 1 -- 172.21.15.18:0/3247232338 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23874 (secure 0 0 0) 0x7f168c099980 con 0x7f169c103150 2024-09-13T16:50:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:50:00.666 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:49:32.540261+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 -- 172.21.15.18:0/3247232338 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16840a1110 msgr2=0x7f16840a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16840a1110 0x7f16840a35d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f169002a930 tx=0x7f1690030580 comp rx=0 tx=0).stop 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 -- 172.21.15.18:0/3247232338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103150 msgr2=0x7f169c1986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103150 0x7f169c1986c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f168c00e9f0 tx=0x7f168c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 -- 172.21.15.18:0/3247232338 shutdown_connections 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f16840a1110 0x7f16840a35d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103150 0x7f169c1986c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169c105a80 0x7f169c19f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 --2- 172.21.15.18:0/3247232338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f169c100820 0x7f169c198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 -- 172.21.15.18:0/3247232338 >> 172.21.15.18:0/3247232338 conn(0x7f169c0fa420 msgr2=0x7f169c0ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 -- 172.21.15.18:0/3247232338 shutdown_connections 2024-09-13T16:50:00.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.665+0000 7f16a4800640 1 -- 172.21.15.18:0/3247232338 wait complete. 2024-09-13T16:50:00.684 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T16:50:00.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:50:00.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.846+0000 7fab47000640 1 -- 172.21.15.18:0/3821227858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab40073280 msgr2=0x7fab4010c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.846+0000 7fab47000640 1 --2- 172.21.15.18:0/3821227858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab40073280 0x7fab4010c180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009860 tx=0x7fab2c02a340 comp rx=0 tx=0).stop 2024-09-13T16:50:00.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.846+0000 7fab47000640 1 -- 172.21.15.18:0/3821227858 shutdown_connections 2024-09-13T16:50:00.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.846+0000 7fab47000640 1 --2- 172.21.15.18:0/3821227858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab40103580 0x7fab4010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.846+0000 7fab47000640 1 --2- 172.21.15.18:0/3821227858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab40073280 0x7fab4010c180 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.846+0000 7fab47000640 1 --2- 172.21.15.18:0/3821227858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab40072940 0x7fab40072d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.846+0000 7fab47000640 1 -- 172.21.15.18:0/3821227858 >> 172.21.15.18:0/3821227858 conn(0x7fab400fb310 msgr2=0x7fab400fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:00.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.846+0000 7fab47000640 1 -- 172.21.15.18:0/3821227858 shutdown_connections 2024-09-13T16:50:00.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.846+0000 7fab47000640 1 -- 172.21.15.18:0/3821227858 wait complete. 2024-09-13T16:50:00.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.847+0000 7fab47000640 1 Processor -- start 2024-09-13T16:50:00.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.847+0000 7fab47000640 1 -- start start 2024-09-13T16:50:00.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab47000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab40072940 0x7fab4019c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab47000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab40073280 0x7fab4019c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab47000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab401a1850 0x7fab401a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab47000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab401a4180 con 0x7fab40072940 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab47000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab401a42f0 con 0x7fab401a1850 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab47000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab401a44b0 con 0x7fab40073280 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab45c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab40072940 0x7fab4019c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab45c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab40072940 0x7fab4019c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38358/0 (socket says 172.21.15.18:38358) 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab45c00640 1 -- 172.21.15.18:0/1053656084 learned_addr learned my addr 172.21.15.18:0/1053656084 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab45200640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab40073280 0x7fab4019c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab46600640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab401a1850 0x7fab401a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab45c00640 1 -- 172.21.15.18:0/1053656084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab40073280 msgr2=0x7fab4019c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab45c00640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab40073280 0x7fab4019c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab45c00640 1 -- 172.21.15.18:0/1053656084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab401a1850 msgr2=0x7fab401a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:00.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab45c00640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab401a1850 0x7fab401a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:00.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.848+0000 7fab45c00640 1 -- 172.21.15.18:0/1053656084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34009560 con 0x7fab40072940 2024-09-13T16:50:00.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.849+0000 7fab45c00640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab40072940 0x7fab4019c2b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab3400e9c0 tx=0x7fab3400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:00.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.849+0000 7fab3e000640 1 -- 172.21.15.18:0/1053656084 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400cde0 con 0x7fab40072940 2024-09-13T16:50:00.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.849+0000 7fab47000640 1 -- 172.21.15.18:0/1053656084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c009490 con 0x7fab40072940 2024-09-13T16:50:00.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.849+0000 7fab3e000640 1 -- 172.21.15.18:0/1053656084 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab340035f0 con 0x7fab40072940 2024-09-13T16:50:00.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.849+0000 7fab3e000640 1 -- 172.21.15.18:0/1053656084 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340044e0 con 0x7fab40072940 2024-09-13T16:50:00.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.849+0000 7fab47000640 1 -- 172.21.15.18:0/1053656084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab401a4b30 con 0x7fab40072940 2024-09-13T16:50:00.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.850+0000 7fab47000640 1 -- 172.21.15.18:0/1053656084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab40072d40 con 0x7fab40072940 2024-09-13T16:50:00.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.852+0000 7fab3e000640 1 -- 172.21.15.18:0/1053656084 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fab34003760 con 0x7fab40072940 2024-09-13T16:50:00.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.853+0000 7fab3e000640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab280a1120 0x7fab280a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:00.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.853+0000 7fab3e000640 1 -- 172.21.15.18:0/1053656084 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fab34014070 con 0x7fab40072940 2024-09-13T16:50:00.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.853+0000 7fab45200640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab280a1120 0x7fab280a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:00.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.854+0000 7fab45200640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab280a1120 0x7fab280a35e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009830 tx=0x7fab2c0305a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:00.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:00.857+0000 7fab3e000640 1 -- 172.21.15.18:0/1053656084 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fab34096570 con 0x7fab40072940 2024-09-13T16:50:00.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:00 smithi018 ceph-mon[30981]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:00.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:00 smithi018 ceph-mon[30981]: from='client.24854 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:00.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:00 smithi018 ceph-mon[30981]: pgmap v313: 129 pgs: 129 active+clean; 583 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.9 KiB/s wr, 5 op/s 2024-09-13T16:50:00.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:00 smithi018 ceph-mon[30981]: overall HEALTH_OK 2024-09-13T16:50:00.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:00 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2353593304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:50:00.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:00 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3247232338' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:50:01.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.035+0000 7fab47000640 1 -- 172.21.15.18:0/1053656084 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab40111b80 con 0x7fab280a1120 2024-09-13T16:50:01.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.050+0000 7fab3e000640 1 -- 172.21.15.18:0/1053656084 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422556 (secure 0 0 0) 0x7fab40111b80 con 0x7fab280a1120 2024-09-13T16:50:01.058 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:50:01.061 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T16:50:01.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 -- 172.21.15.18:0/1053656084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab280a1120 msgr2=0x7fab280a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:01.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab280a1120 0x7fab280a35e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009830 tx=0x7fab2c0305a0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 -- 172.21.15.18:0/1053656084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab40072940 msgr2=0x7fab4019c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:01.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab40072940 0x7fab4019c2b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab3400e9c0 tx=0x7fab3400ee80 comp rx=0 tx=0).stop 2024-09-13T16:50:01.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 -- 172.21.15.18:0/1053656084 shutdown_connections 2024-09-13T16:50:01.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab401a1850 0x7fab401a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab40073280 0x7fab4019c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fab280a1120 0x7fab280a35e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 --2- 172.21.15.18:0/1053656084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab40072940 0x7fab4019c2b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 -- 172.21.15.18:0/1053656084 >> 172.21.15.18:0/1053656084 conn(0x7fab400fb310 msgr2=0x7fab4010e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:01.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 -- 172.21.15.18:0/1053656084 shutdown_connections 2024-09-13T16:50:01.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.055+0000 7fab47000640 1 -- 172.21.15.18:0/1053656084 wait complete. 2024-09-13T16:50:01.074 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-13T16:49:59.764917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597013,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":287,"num_write_kb":2978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378560,"kb_used_data":13400,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124563264,"statfs":{"total":1151940427776,"available":1151552782336,"internally_reserved":0,"allocated":13721600,"data_stored":7527397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":373798213},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2193,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":59,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003856"},"pg_stats":[{"pgid":"2.1f","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106337+0000","last_change":"2024-09-13T16:49:27.652760+0000","last_active":"2024-09-13T16:49:32.106337+0000","last_peered":"2024-09-13T16:49:32.106337+0000","last_clean":"2024-09-13T16:49:32.106337+0000","last_became_active":"2024-09-13T16:49:27.647493+0000","last_became_peered":"2024-09-13T16:49:27.647493+0000","last_unstale":"2024-09-13T16:49:32.106337+0000","last_undegraded":"2024-09-13T16:49:32.106337+0000","last_fullsized":"2024-09-13T16:49:32.106337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:54.438761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.118503+0000","last_change":"2024-09-13T16:49:28.116092+0000","last_active":"2024-09-13T16:49:32.118503+0000","last_peered":"2024-09-13T16:49:32.118503+0000","last_clean":"2024-09-13T16:49:32.118503+0000","last_became_active":"2024-09-13T16:49:28.115468+0000","last_became_peered":"2024-09-13T16:49:28.115468+0000","last_unstale":"2024-09-13T16:49:32.118503+0000","last_undegraded":"2024-09-13T16:49:32.118503+0000","last_fullsized":"2024-09-13T16:49:32.118503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:33.214589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.546939+0000","last_change":"2024-09-13T16:49:32.127597+0000","last_active":"2024-09-13T16:49:32.546939+0000","last_peered":"2024-09-13T16:49:32.546939+0000","last_clean":"2024-09-13T16:49:32.546939+0000","last_became_active":"2024-09-13T16:49:32.127122+0000","last_became_peered":"2024-09-13T16:49:32.127122+0000","last_unstale":"2024-09-13T16:49:32.546939+0000","last_undegraded":"2024-09-13T16:49:32.546939+0000","last_fullsized":"2024-09-13T16:49:32.546939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:16.362727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.118653+0000","last_change":"2024-09-13T16:49:27.668009+0000","last_active":"2024-09-13T16:49:32.118653+0000","last_peered":"2024-09-13T16:49:32.118653+0000","last_clean":"2024-09-13T16:49:32.118653+0000","last_became_active":"2024-09-13T16:49:27.667713+0000","last_became_peered":"2024-09-13T16:49:27.667713+0000","last_unstale":"2024-09-13T16:49:32.118653+0000","last_undegraded":"2024-09-13T16:49:32.118653+0000","last_fullsized":"2024-09-13T16:49:32.118653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:51.427966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115284+0000","last_change":"2024-09-13T16:49:28.107799+0000","last_active":"2024-09-13T16:49:32.115284+0000","last_peered":"2024-09-13T16:49:32.115284+0000","last_clean":"2024-09-13T16:49:32.115284+0000","last_became_active":"2024-09-13T16:49:28.107432+0000","last_became_peered":"2024-09-13T16:49:28.107432+0000","last_unstale":"2024-09-13T16:49:32.115284+0000","last_undegraded":"2024-09-13T16:49:32.115284+0000","last_fullsized":"2024-09-13T16:49:32.115284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:31.554614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.132652+0000","last_change":"2024-09-13T16:49:32.132328+0000","last_active":"2024-09-13T16:49:32.132652+0000","last_peered":"2024-09-13T16:49:32.132652+0000","last_clean":"2024-09-13T16:49:32.132652+0000","last_became_active":"2024-09-13T16:49:32.131831+0000","last_became_peered":"2024-09-13T16:49:32.131831+0000","last_unstale":"2024-09-13T16:49:32.132652+0000","last_undegraded":"2024-09-13T16:49:32.132652+0000","last_fullsized":"2024-09-13T16:49:32.132652+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:35.409572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.786952+0000","last_change":"2024-09-13T16:49:27.651527+0000","last_active":"2024-09-13T16:49:56.786952+0000","last_peered":"2024-09-13T16:49:56.786952+0000","last_clean":"2024-09-13T16:49:56.786952+0000","last_became_active":"2024-09-13T16:49:27.650985+0000","last_became_peered":"2024-09-13T16:49:27.650985+0000","last_unstale":"2024-09-13T16:49:56.786952+0000","last_undegraded":"2024-09-13T16:49:56.786952+0000","last_fullsized":"2024-09-13T16:49:56.786952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:31.473563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.109873+0000","last_change":"2024-09-13T16:49:28.101714+0000","last_active":"2024-09-13T16:49:32.109873+0000","last_peered":"2024-09-13T16:49:32.109873+0000","last_clean":"2024-09-13T16:49:32.109873+0000","last_became_active":"2024-09-13T16:49:28.101409+0000","last_became_peered":"2024-09-13T16:49:28.101409+0000","last_unstale":"2024-09-13T16:49:32.109873+0000","last_undegraded":"2024-09-13T16:49:32.109873+0000","last_fullsized":"2024-09-13T16:49:32.109873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:05.786731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.133388+0000","last_change":"2024-09-13T16:49:32.133096+0000","last_active":"2024-09-13T16:49:32.133388+0000","last_peered":"2024-09-13T16:49:32.133388+0000","last_clean":"2024-09-13T16:49:32.133388+0000","last_became_active":"2024-09-13T16:49:32.132704+0000","last_became_peered":"2024-09-13T16:49:32.132704+0000","last_unstale":"2024-09-13T16:49:32.133388+0000","last_undegraded":"2024-09-13T16:49:32.133388+0000","last_fullsized":"2024-09-13T16:49:32.133388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:18.490892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111165+0000","last_change":"2024-09-13T16:49:27.650532+0000","last_active":"2024-09-13T16:49:32.111165+0000","last_peered":"2024-09-13T16:49:32.111165+0000","last_clean":"2024-09-13T16:49:32.111165+0000","last_became_active":"2024-09-13T16:49:27.650095+0000","last_became_peered":"2024-09-13T16:49:27.650095+0000","last_unstale":"2024-09-13T16:49:32.111165+0000","last_undegraded":"2024-09-13T16:49:32.111165+0000","last_fullsized":"2024-09-13T16:49:32.111165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:58.066902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.114979+0000","last_change":"2024-09-13T16:49:28.104676+0000","last_active":"2024-09-13T16:49:32.114979+0000","last_peered":"2024-09-13T16:49:32.114979+0000","last_clean":"2024-09-13T16:49:32.114979+0000","last_became_active":"2024-09-13T16:49:28.104376+0000","last_became_peered":"2024-09-13T16:49:28.104376+0000","last_unstale":"2024-09-13T16:49:32.114979+0000","last_undegraded":"2024-09-13T16:49:32.114979+0000","last_fullsized":"2024-09-13T16:49:32.114979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:29.038008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.127852+0000","last_change":"2024-09-13T16:49:32.127590+0000","last_active":"2024-09-13T16:49:32.127852+0000","last_peered":"2024-09-13T16:49:32.127852+0000","last_clean":"2024-09-13T16:49:32.127852+0000","last_became_active":"2024-09-13T16:49:32.127362+0000","last_became_peered":"2024-09-13T16:49:32.127362+0000","last_unstale":"2024-09-13T16:49:32.127852+0000","last_undegraded":"2024-09-13T16:49:32.127852+0000","last_fullsized":"2024-09-13T16:49:32.127852+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:37.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111416+0000","last_change":"2024-09-13T16:49:28.104850+0000","last_active":"2024-09-13T16:49:32.111416+0000","last_peered":"2024-09-13T16:49:32.111416+0000","last_clean":"2024-09-13T16:49:32.111416+0000","last_became_active":"2024-09-13T16:49:28.104569+0000","last_became_peered":"2024-09-13T16:49:28.104569+0000","last_unstale":"2024-09-13T16:49:32.111416+0000","last_undegraded":"2024-09-13T16:49:32.111416+0000","last_fullsized":"2024-09-13T16:49:32.111416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:26.949030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.785152+0000","last_change":"2024-09-13T16:49:27.649046+0000","last_active":"2024-09-13T16:49:55.785152+0000","last_peered":"2024-09-13T16:49:55.785152+0000","last_clean":"2024-09-13T16:49:55.785152+0000","last_became_active":"2024-09-13T16:49:27.648633+0000","last_became_peered":"2024-09-13T16:49:27.648633+0000","last_unstale":"2024-09-13T16:49:55.785152+0000","last_undegraded":"2024-09-13T16:49:55.785152+0000","last_fullsized":"2024-09-13T16:49:55.785152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:07.191181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.124608+0000","last_change":"2024-09-13T16:49:32.123910+0000","last_active":"2024-09-13T16:49:32.124608+0000","last_peered":"2024-09-13T16:49:32.124608+0000","last_clean":"2024-09-13T16:49:32.124608+0000","last_became_active":"2024-09-13T16:49:32.123515+0000","last_became_peered":"2024-09-13T16:49:32.123515+0000","last_unstale":"2024-09-13T16:49:32.124608+0000","last_undegraded":"2024-09-13T16:49:32.124608+0000","last_fullsized":"2024-09-13T16:49:32.124608+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:13.667573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112413+0000","last_change":"2024-09-13T16:49:28.112299+0000","last_active":"2024-09-13T16:49:32.112413+0000","last_peered":"2024-09-13T16:49:32.112413+0000","last_clean":"2024-09-13T16:49:32.112413+0000","last_became_active":"2024-09-13T16:49:28.111945+0000","last_became_peered":"2024-09-13T16:49:28.111945+0000","last_unstale":"2024-09-13T16:49:32.112413+0000","last_undegraded":"2024-09-13T16:49:32.112413+0000","last_fullsized":"2024-09-13T16:49:32.112413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:42.813731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.546944+0000","last_change":"2024-09-13T16:49:27.654517+0000","last_active":"2024-09-13T16:49:32.546944+0000","last_peered":"2024-09-13T16:49:32.546944+0000","last_clean":"2024-09-13T16:49:32.546944+0000","last_became_active":"2024-09-13T16:49:27.654207+0000","last_became_peered":"2024-09-13T16:49:27.654207+0000","last_unstale":"2024-09-13T16:49:32.546944+0000","last_undegraded":"2024-09-13T16:49:32.546944+0000","last_fullsized":"2024-09-13T16:49:32.546944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:14.562289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.122686+0000","last_change":"2024-09-13T16:49:32.121834+0000","last_active":"2024-09-13T16:49:32.122686+0000","last_peered":"2024-09-13T16:49:32.122686+0000","last_clean":"2024-09-13T16:49:32.122686+0000","last_became_active":"2024-09-13T16:49:32.121409+0000","last_became_peered":"2024-09-13T16:49:32.121409+0000","last_unstale":"2024-09-13T16:49:32.122686+0000","last_undegraded":"2024-09-13T16:49:32.122686+0000","last_fullsized":"2024-09-13T16:49:32.122686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.112143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106761+0000","last_change":"2024-09-13T16:49:28.115111+0000","last_active":"2024-09-13T16:49:32.106761+0000","last_peered":"2024-09-13T16:49:32.106761+0000","last_clean":"2024-09-13T16:49:32.106761+0000","last_became_active":"2024-09-13T16:49:28.114491+0000","last_became_peered":"2024-09-13T16:49:28.114491+0000","last_unstale":"2024-09-13T16:49:32.106761+0000","last_undegraded":"2024-09-13T16:49:32.106761+0000","last_fullsized":"2024-09-13T16:49:32.106761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:59.639110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.787737+0000","last_change":"2024-09-13T16:49:27.661045+0000","last_active":"2024-09-13T16:49:55.787737+0000","last_peered":"2024-09-13T16:49:55.787737+0000","last_clean":"2024-09-13T16:49:55.787737+0000","last_became_active":"2024-09-13T16:49:27.660728+0000","last_became_peered":"2024-09-13T16:49:27.660728+0000","last_unstale":"2024-09-13T16:49:55.787737+0000","last_undegraded":"2024-09-13T16:49:55.787737+0000","last_fullsized":"2024-09-13T16:49:55.787737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:37.292582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.545182+0000","last_change":"2024-09-13T16:49:32.122407+0000","last_active":"2024-09-13T16:49:32.545182+0000","last_peered":"2024-09-13T16:49:32.545182+0000","last_clean":"2024-09-13T16:49:32.545182+0000","last_became_active":"2024-09-13T16:49:32.121540+0000","last_became_peered":"2024-09-13T16:49:32.121540+0000","last_unstale":"2024-09-13T16:49:32.545182+0000","last_undegraded":"2024-09-13T16:49:32.545182+0000","last_fullsized":"2024-09-13T16:49:32.545182+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.577117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.109988+0000","last_change":"2024-09-13T16:49:28.107534+0000","last_active":"2024-09-13T16:49:32.109988+0000","last_peered":"2024-09-13T16:49:32.109988+0000","last_clean":"2024-09-13T16:49:32.109988+0000","last_became_active":"2024-09-13T16:49:28.107167+0000","last_became_peered":"2024-09-13T16:49:28.107167+0000","last_unstale":"2024-09-13T16:49:32.109988+0000","last_undegraded":"2024-09-13T16:49:32.109988+0000","last_fullsized":"2024-09-13T16:49:32.109988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:50.515291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.786009+0000","last_change":"2024-09-13T16:49:27.663125+0000","last_active":"2024-09-13T16:49:55.786009+0000","last_peered":"2024-09-13T16:49:55.786009+0000","last_clean":"2024-09-13T16:49:55.786009+0000","last_became_active":"2024-09-13T16:49:27.662822+0000","last_became_peered":"2024-09-13T16:49:27.662822+0000","last_unstale":"2024-09-13T16:49:55.786009+0000","last_undegraded":"2024-09-13T16:49:55.786009+0000","last_fullsized":"2024-09-13T16:49:55.786009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:42.841929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.122649+0000","last_change":"2024-09-13T16:49:32.121929+0000","last_active":"2024-09-13T16:49:32.122649+0000","last_peered":"2024-09-13T16:49:32.122649+0000","last_clean":"2024-09-13T16:49:32.122649+0000","last_became_active":"2024-09-13T16:49:32.121485+0000","last_became_peered":"2024-09-13T16:49:32.121485+0000","last_unstale":"2024-09-13T16:49:32.122649+0000","last_undegraded":"2024-09-13T16:49:32.122649+0000","last_fullsized":"2024-09-13T16:49:32.122649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:34.224064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.118321+0000","last_change":"2024-09-13T16:49:28.119746+0000","last_active":"2024-09-13T16:49:32.118321+0000","last_peered":"2024-09-13T16:49:32.118321+0000","last_clean":"2024-09-13T16:49:32.118321+0000","last_became_active":"2024-09-13T16:49:28.119463+0000","last_became_peered":"2024-09-13T16:49:28.119463+0000","last_unstale":"2024-09-13T16:49:32.118321+0000","last_undegraded":"2024-09-13T16:49:32.118321+0000","last_fullsized":"2024-09-13T16:49:32.118321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:17.092417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.785411+0000","last_change":"2024-09-13T16:49:27.651799+0000","last_active":"2024-09-13T16:49:55.785411+0000","last_peered":"2024-09-13T16:49:55.785411+0000","last_clean":"2024-09-13T16:49:55.785411+0000","last_became_active":"2024-09-13T16:49:27.651487+0000","last_became_peered":"2024-09-13T16:49:27.651487+0000","last_unstale":"2024-09-13T16:49:55.785411+0000","last_undegraded":"2024-09-13T16:49:55.785411+0000","last_fullsized":"2024-09-13T16:49:55.785411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:45.307448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.547001+0000","last_change":"2024-09-13T16:49:32.119333+0000","last_active":"2024-09-13T16:49:32.547001+0000","last_peered":"2024-09-13T16:49:32.547001+0000","last_clean":"2024-09-13T16:49:32.547001+0000","last_became_active":"2024-09-13T16:49:32.118997+0000","last_became_peered":"2024-09-13T16:49:32.118997+0000","last_unstale":"2024-09-13T16:49:32.547001+0000","last_undegraded":"2024-09-13T16:49:32.547001+0000","last_fullsized":"2024-09-13T16:49:32.547001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:15.731556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.119153+0000","last_change":"2024-09-13T16:49:28.114937+0000","last_active":"2024-09-13T16:49:32.119153+0000","last_peered":"2024-09-13T16:49:32.119153+0000","last_clean":"2024-09-13T16:49:32.119153+0000","last_became_active":"2024-09-13T16:49:28.112566+0000","last_became_peered":"2024-09-13T16:49:28.112566+0000","last_unstale":"2024-09-13T16:49:32.119153+0000","last_undegraded":"2024-09-13T16:49:32.119153+0000","last_fullsized":"2024-09-13T16:49:32.119153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:25.123922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.545235+0000","last_change":"2024-09-13T16:49:27.658786+0000","last_active":"2024-09-13T16:49:32.545235+0000","last_peered":"2024-09-13T16:49:32.545235+0000","last_clean":"2024-09-13T16:49:32.545235+0000","last_became_active":"2024-09-13T16:49:27.658308+0000","last_became_peered":"2024-09-13T16:49:27.658308+0000","last_unstale":"2024-09-13T16:49:32.545235+0000","last_undegraded":"2024-09-13T16:49:32.545235+0000","last_fullsized":"2024-09-13T16:49:32.545235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:29.994600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.075343+0000","last_change":"2024-09-13T16:49:32.130983+0000","last_active":"2024-09-13T16:49:33.075343+0000","last_peered":"2024-09-13T16:49:33.075343+0000","last_clean":"2024-09-13T16:49:33.075343+0000","last_became_active":"2024-09-13T16:49:32.130478+0000","last_became_peered":"2024-09-13T16:49:32.130478+0000","last_unstale":"2024-09-13T16:49:33.075343+0000","last_undegraded":"2024-09-13T16:49:33.075343+0000","last_fullsized":"2024-09-13T16:49:33.075343+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:07.147495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.121482+0000","last_change":"2024-09-13T16:49:28.100340+0000","last_active":"2024-09-13T16:49:32.121482+0000","last_peered":"2024-09-13T16:49:32.121482+0000","last_clean":"2024-09-13T16:49:32.121482+0000","last_became_active":"2024-09-13T16:49:28.099993+0000","last_became_peered":"2024-09-13T16:49:28.099993+0000","last_unstale":"2024-09-13T16:49:32.121482+0000","last_undegraded":"2024-09-13T16:49:32.121482+0000","last_fullsized":"2024-09-13T16:49:32.121482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:55.066929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.786419+0000","last_change":"2024-09-13T16:49:27.665296+0000","last_active":"2024-09-13T16:49:55.786419+0000","last_peered":"2024-09-13T16:49:55.786419+0000","last_clean":"2024-09-13T16:49:55.786419+0000","last_became_active":"2024-09-13T16:49:27.664953+0000","last_became_peered":"2024-09-13T16:49:27.664953+0000","last_unstale":"2024-09-13T16:49:55.786419+0000","last_undegraded":"2024-09-13T16:49:55.786419+0000","last_fullsized":"2024-09-13T16:49:55.786419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:52.001210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.462917+0000","last_change":"2024-09-13T16:49:32.129502+0000","last_active":"2024-09-13T16:49:33.462917+0000","last_peered":"2024-09-13T16:49:33.462917+0000","last_clean":"2024-09-13T16:49:33.462917+0000","last_became_active":"2024-09-13T16:49:32.128588+0000","last_became_peered":"2024-09-13T16:49:32.128588+0000","last_unstale":"2024-09-13T16:49:33.462917+0000","last_undegraded":"2024-09-13T16:49:33.462917+0000","last_fullsized":"2024-09-13T16:49:33.462917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:12.836040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106104+0000","last_change":"2024-09-13T16:49:28.107066+0000","last_active":"2024-09-13T16:49:32.106104+0000","last_peered":"2024-09-13T16:49:32.106104+0000","last_clean":"2024-09-13T16:49:32.106104+0000","last_became_active":"2024-09-13T16:49:28.106774+0000","last_became_peered":"2024-09-13T16:49:28.106774+0000","last_unstale":"2024-09-13T16:49:32.106104+0000","last_undegraded":"2024-09-13T16:49:32.106104+0000","last_fullsized":"2024-09-13T16:49:32.106104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:02.159079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.105443+0000","last_change":"2024-09-13T16:49:27.664742+0000","last_active":"2024-09-13T16:49:32.105443+0000","last_peered":"2024-09-13T16:49:32.105443+0000","last_clean":"2024-09-13T16:49:32.105443+0000","last_became_active":"2024-09-13T16:49:27.664206+0000","last_became_peered":"2024-09-13T16:49:27.664206+0000","last_unstale":"2024-09-13T16:49:32.105443+0000","last_undegraded":"2024-09-13T16:49:32.105443+0000","last_fullsized":"2024-09-13T16:49:32.105443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:29.255592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.075464+0000","last_change":"2024-09-13T16:49:32.123418+0000","last_active":"2024-09-13T16:49:33.075464+0000","last_peered":"2024-09-13T16:49:33.075464+0000","last_clean":"2024-09-13T16:49:33.075464+0000","last_became_active":"2024-09-13T16:49:32.123001+0000","last_became_peered":"2024-09-13T16:49:32.123001+0000","last_unstale":"2024-09-13T16:49:33.075464+0000","last_undegraded":"2024-09-13T16:49:33.075464+0000","last_fullsized":"2024-09-13T16:49:33.075464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:03.057538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106009+0000","last_change":"2024-09-13T16:49:28.102859+0000","last_active":"2024-09-13T16:49:32.106009+0000","last_peered":"2024-09-13T16:49:32.106009+0000","last_clean":"2024-09-13T16:49:32.106009+0000","last_became_active":"2024-09-13T16:49:28.102581+0000","last_became_peered":"2024-09-13T16:49:28.102581+0000","last_unstale":"2024-09-13T16:49:32.106009+0000","last_undegraded":"2024-09-13T16:49:32.106009+0000","last_fullsized":"2024-09-13T16:49:32.106009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:25.716170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.545973+0000","last_change":"2024-09-13T16:49:27.660427+0000","last_active":"2024-09-13T16:49:32.545973+0000","last_peered":"2024-09-13T16:49:32.545973+0000","last_clean":"2024-09-13T16:49:32.545973+0000","last_became_active":"2024-09-13T16:49:27.660124+0000","last_became_peered":"2024-09-13T16:49:27.660124+0000","last_unstale":"2024-09-13T16:49:32.545973+0000","last_undegraded":"2024-09-13T16:49:32.545973+0000","last_fullsized":"2024-09-13T16:49:32.545973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:13.437432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.812559+0000","last_change":"2024-09-13T16:49:32.134481+0000","last_active":"2024-09-13T16:49:32.812559+0000","last_peered":"2024-09-13T16:49:32.812559+0000","last_clean":"2024-09-13T16:49:32.812559+0000","last_became_active":"2024-09-13T16:49:32.132117+0000","last_became_peered":"2024-09-13T16:49:32.132117+0000","last_unstale":"2024-09-13T16:49:32.812559+0000","last_undegraded":"2024-09-13T16:49:32.812559+0000","last_fullsized":"2024-09-13T16:49:32.812559+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:06.386078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.113018+0000","last_change":"2024-09-13T16:49:28.102780+0000","last_active":"2024-09-13T16:49:32.113018+0000","last_peered":"2024-09-13T16:49:32.113018+0000","last_clean":"2024-09-13T16:49:32.113018+0000","last_became_active":"2024-09-13T16:49:28.102484+0000","last_became_peered":"2024-09-13T16:49:28.102484+0000","last_unstale":"2024-09-13T16:49:32.113018+0000","last_undegraded":"2024-09-13T16:49:32.113018+0000","last_fullsized":"2024-09-13T16:49:32.113018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:56.922183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.790957+0000","last_change":"2024-09-13T16:49:27.669744+0000","last_active":"2024-09-13T16:49:56.790957+0000","last_peered":"2024-09-13T16:49:56.790957+0000","last_clean":"2024-09-13T16:49:56.790957+0000","last_became_active":"2024-09-13T16:49:27.667816+0000","last_became_peered":"2024-09-13T16:49:27.667816+0000","last_unstale":"2024-09-13T16:49:56.790957+0000","last_undegraded":"2024-09-13T16:49:56.790957+0000","last_fullsized":"2024-09-13T16:49:56.790957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:36.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.812637+0000","last_change":"2024-09-13T16:49:32.137114+0000","last_active":"2024-09-13T16:49:32.812637+0000","last_peered":"2024-09-13T16:49:32.812637+0000","last_clean":"2024-09-13T16:49:32.812637+0000","last_became_active":"2024-09-13T16:49:32.136077+0000","last_became_peered":"2024-09-13T16:49:32.136077+0000","last_unstale":"2024-09-13T16:49:32.812637+0000","last_undegraded":"2024-09-13T16:49:32.812637+0000","last_fullsized":"2024-09-13T16:49:32.812637+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:59.902852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.119792+0000","last_change":"2024-09-13T16:49:28.098316+0000","last_active":"2024-09-13T16:49:32.119792+0000","last_peered":"2024-09-13T16:49:32.119792+0000","last_clean":"2024-09-13T16:49:32.119792+0000","last_became_active":"2024-09-13T16:49:28.097410+0000","last_became_peered":"2024-09-13T16:49:28.097410+0000","last_unstale":"2024-09-13T16:49:32.119792+0000","last_undegraded":"2024-09-13T16:49:32.119792+0000","last_fullsized":"2024-09-13T16:49:32.119792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:37.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.786927+0000","last_change":"2024-09-13T16:49:27.648000+0000","last_active":"2024-09-13T16:49:56.786927+0000","last_peered":"2024-09-13T16:49:56.786927+0000","last_clean":"2024-09-13T16:49:56.786927+0000","last_became_active":"2024-09-13T16:49:27.647639+0000","last_became_peered":"2024-09-13T16:49:27.647639+0000","last_unstale":"2024-09-13T16:49:56.786927+0000","last_undegraded":"2024-09-13T16:49:56.786927+0000","last_fullsized":"2024-09-13T16:49:56.786927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:28.941060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.929984+0000","last_change":"2024-09-13T16:49:32.132868+0000","last_active":"2024-09-13T16:49:32.929984+0000","last_peered":"2024-09-13T16:49:32.929984+0000","last_clean":"2024-09-13T16:49:32.929984+0000","last_became_active":"2024-09-13T16:49:32.132562+0000","last_became_peered":"2024-09-13T16:49:32.132562+0000","last_unstale":"2024-09-13T16:49:32.929984+0000","last_undegraded":"2024-09-13T16:49:32.929984+0000","last_fullsized":"2024-09-13T16:49:32.929984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:31.365339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112376+0000","last_change":"2024-09-13T16:49:28.107483+0000","last_active":"2024-09-13T16:49:32.112376+0000","last_peered":"2024-09-13T16:49:32.112376+0000","last_clean":"2024-09-13T16:49:32.112376+0000","last_became_active":"2024-09-13T16:49:28.107111+0000","last_became_peered":"2024-09-13T16:49:28.107111+0000","last_unstale":"2024-09-13T16:49:32.112376+0000","last_undegraded":"2024-09-13T16:49:32.112376+0000","last_fullsized":"2024-09-13T16:49:32.112376+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:56.987970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.786994+0000","last_change":"2024-09-13T16:49:27.646872+0000","last_active":"2024-09-13T16:49:55.786994+0000","last_peered":"2024-09-13T16:49:55.786994+0000","last_clean":"2024-09-13T16:49:55.786994+0000","last_became_active":"2024-09-13T16:49:27.646523+0000","last_became_peered":"2024-09-13T16:49:27.646523+0000","last_unstale":"2024-09-13T16:49:55.786994+0000","last_undegraded":"2024-09-13T16:49:55.786994+0000","last_fullsized":"2024-09-13T16:49:55.786994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.384393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":331,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110998+0000","last_change":"2024-09-13T16:48:12.777004+0000","last_active":"2024-09-13T16:49:32.110998+0000","last_peered":"2024-09-13T16:49:32.110998+0000","last_clean":"2024-09-13T16:49:32.110998+0000","last_became_active":"2024-09-13T16:48:12.776499+0000","last_became_peered":"2024-09-13T16:48:12.776499+0000","last_unstale":"2024-09-13T16:49:32.110998+0000","last_undegraded":"2024-09-13T16:49:32.110998+0000","last_fullsized":"2024-09-13T16:49:32.110998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:44:44.393091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:44:44.393091+0000","last_clean_scrub_stamp":"2024-09-13T16:44:44.393091+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:38.427421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.120516+0000","last_change":"2024-09-13T16:49:32.119501+0000","last_active":"2024-09-13T16:49:32.120516+0000","last_peered":"2024-09-13T16:49:32.120516+0000","last_clean":"2024-09-13T16:49:32.120516+0000","last_became_active":"2024-09-13T16:49:32.118856+0000","last_became_peered":"2024-09-13T16:49:32.118856+0000","last_unstale":"2024-09-13T16:49:32.120516+0000","last_undegraded":"2024-09-13T16:49:32.120516+0000","last_fullsized":"2024-09-13T16:49:32.120516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:13.078311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112616+0000","last_change":"2024-09-13T16:49:28.106290+0000","last_active":"2024-09-13T16:49:32.112616+0000","last_peered":"2024-09-13T16:49:32.112616+0000","last_clean":"2024-09-13T16:49:32.112616+0000","last_became_active":"2024-09-13T16:49:28.105608+0000","last_became_peered":"2024-09-13T16:49:28.105608+0000","last_unstale":"2024-09-13T16:49:32.112616+0000","last_undegraded":"2024-09-13T16:49:32.112616+0000","last_fullsized":"2024-09-13T16:49:32.112616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:57.711931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.789234+0000","last_change":"2024-09-13T16:49:27.667242+0000","last_active":"2024-09-13T16:49:56.789234+0000","last_peered":"2024-09-13T16:49:56.789234+0000","last_clean":"2024-09-13T16:49:56.789234+0000","last_became_active":"2024-09-13T16:49:27.666939+0000","last_became_peered":"2024-09-13T16:49:27.666939+0000","last_unstale":"2024-09-13T16:49:56.789234+0000","last_undegraded":"2024-09-13T16:49:56.789234+0000","last_fullsized":"2024-09-13T16:49:56.789234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:10.558691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.129611+0000","last_change":"2024-09-13T16:49:32.128832+0000","last_active":"2024-09-13T16:49:32.129611+0000","last_peered":"2024-09-13T16:49:32.129611+0000","last_clean":"2024-09-13T16:49:32.129611+0000","last_became_active":"2024-09-13T16:49:32.128369+0000","last_became_peered":"2024-09-13T16:49:32.128369+0000","last_unstale":"2024-09-13T16:49:32.129611+0000","last_undegraded":"2024-09-13T16:49:32.129611+0000","last_fullsized":"2024-09-13T16:49:32.129611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:26.756858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112314+0000","last_change":"2024-09-13T16:49:28.115686+0000","last_active":"2024-09-13T16:49:32.112314+0000","last_peered":"2024-09-13T16:49:32.112314+0000","last_clean":"2024-09-13T16:49:32.112314+0000","last_became_active":"2024-09-13T16:49:28.115439+0000","last_became_peered":"2024-09-13T16:49:28.115439+0000","last_unstale":"2024-09-13T16:49:32.112314+0000","last_undegraded":"2024-09-13T16:49:32.112314+0000","last_fullsized":"2024-09-13T16:49:32.112314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:03.134657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.088882+0000","last_change":"2024-09-13T16:49:27.653794+0000","last_active":"2024-09-13T16:49:33.088882+0000","last_peered":"2024-09-13T16:49:33.088882+0000","last_clean":"2024-09-13T16:49:33.088882+0000","last_became_active":"2024-09-13T16:49:27.653483+0000","last_became_peered":"2024-09-13T16:49:27.653483+0000","last_unstale":"2024-09-13T16:49:33.088882+0000","last_undegraded":"2024-09-13T16:49:33.088882+0000","last_fullsized":"2024-09-13T16:49:33.088882+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:49.488599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.602484+0000","last_change":"2024-09-13T16:49:32.124277+0000","last_active":"2024-09-13T16:49:32.602484+0000","last_peered":"2024-09-13T16:49:32.602484+0000","last_clean":"2024-09-13T16:49:32.602484+0000","last_became_active":"2024-09-13T16:49:32.123858+0000","last_became_peered":"2024-09-13T16:49:32.123858+0000","last_unstale":"2024-09-13T16:49:32.602484+0000","last_undegraded":"2024-09-13T16:49:32.602484+0000","last_fullsized":"2024-09-13T16:49:32.602484+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:40.965149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112565+0000","last_change":"2024-09-13T16:49:28.107349+0000","last_active":"2024-09-13T16:49:32.112565+0000","last_peered":"2024-09-13T16:49:32.112565+0000","last_clean":"2024-09-13T16:49:32.112565+0000","last_became_active":"2024-09-13T16:49:28.107048+0000","last_became_peered":"2024-09-13T16:49:28.107048+0000","last_unstale":"2024-09-13T16:49:32.112565+0000","last_undegraded":"2024-09-13T16:49:32.112565+0000","last_fullsized":"2024-09-13T16:49:32.112565+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:00.188460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.122868+0000","last_change":"2024-09-13T16:49:27.662761+0000","last_active":"2024-09-13T16:49:32.122868+0000","last_peered":"2024-09-13T16:49:32.122868+0000","last_clean":"2024-09-13T16:49:32.122868+0000","last_became_active":"2024-09-13T16:49:27.662452+0000","last_became_peered":"2024-09-13T16:49:27.662452+0000","last_unstale":"2024-09-13T16:49:32.122868+0000","last_undegraded":"2024-09-13T16:49:32.122868+0000","last_fullsized":"2024-09-13T16:49:32.122868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:51:10.175720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.929855+0000","last_change":"2024-09-13T16:49:32.118043+0000","last_active":"2024-09-13T16:49:32.929855+0000","last_peered":"2024-09-13T16:49:32.929855+0000","last_clean":"2024-09-13T16:49:32.929855+0000","last_became_active":"2024-09-13T16:49:32.117423+0000","last_became_peered":"2024-09-13T16:49:32.117423+0000","last_unstale":"2024-09-13T16:49:32.929855+0000","last_undegraded":"2024-09-13T16:49:32.929855+0000","last_fullsized":"2024-09-13T16:49:32.929855+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:13.791606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.107358+0000","last_change":"2024-09-13T16:49:28.104554+0000","last_active":"2024-09-13T16:49:32.107358+0000","last_peered":"2024-09-13T16:49:32.107358+0000","last_clean":"2024-09-13T16:49:32.107358+0000","last_became_active":"2024-09-13T16:49:28.104158+0000","last_became_peered":"2024-09-13T16:49:28.104158+0000","last_unstale":"2024-09-13T16:49:32.107358+0000","last_undegraded":"2024-09-13T16:49:32.107358+0000","last_fullsized":"2024-09-13T16:49:32.107358+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:08.723966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.075961+0000","last_change":"2024-09-13T16:49:27.648946+0000","last_active":"2024-09-13T16:49:33.075961+0000","last_peered":"2024-09-13T16:49:33.075961+0000","last_clean":"2024-09-13T16:49:33.075961+0000","last_became_active":"2024-09-13T16:49:27.648583+0000","last_became_peered":"2024-09-13T16:49:27.648583+0000","last_unstale":"2024-09-13T16:49:33.075961+0000","last_undegraded":"2024-09-13T16:49:33.075961+0000","last_fullsized":"2024-09-13T16:49:33.075961+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:00.529291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.929905+0000","last_change":"2024-09-13T16:49:32.123998+0000","last_active":"2024-09-13T16:49:32.929905+0000","last_peered":"2024-09-13T16:49:32.929905+0000","last_clean":"2024-09-13T16:49:32.929905+0000","last_became_active":"2024-09-13T16:49:32.123619+0000","last_became_peered":"2024-09-13T16:49:32.123619+0000","last_unstale":"2024-09-13T16:49:32.929905+0000","last_undegraded":"2024-09-13T16:49:32.929905+0000","last_fullsized":"2024-09-13T16:49:32.929905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:32.271957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.114770+0000","last_change":"2024-09-13T16:49:28.101110+0000","last_active":"2024-09-13T16:49:32.114770+0000","last_peered":"2024-09-13T16:49:32.114770+0000","last_clean":"2024-09-13T16:49:32.114770+0000","last_became_active":"2024-09-13T16:49:28.099342+0000","last_became_peered":"2024-09-13T16:49:28.099342+0000","last_unstale":"2024-09-13T16:49:32.114770+0000","last_undegraded":"2024-09-13T16:49:32.114770+0000","last_fullsized":"2024-09-13T16:49:32.114770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:44.331289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.789440+0000","last_change":"2024-09-13T16:49:27.665186+0000","last_active":"2024-09-13T16:49:56.789440+0000","last_peered":"2024-09-13T16:49:56.789440+0000","last_clean":"2024-09-13T16:49:56.789440+0000","last_became_active":"2024-09-13T16:49:27.664889+0000","last_became_peered":"2024-09-13T16:49:27.664889+0000","last_unstale":"2024-09-13T16:49:56.789440+0000","last_undegraded":"2024-09-13T16:49:56.789440+0000","last_fullsized":"2024-09-13T16:49:56.789440+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:51.762337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.812606+0000","last_change":"2024-09-13T16:49:32.135613+0000","last_active":"2024-09-13T16:49:32.812606+0000","last_peered":"2024-09-13T16:49:32.812606+0000","last_clean":"2024-09-13T16:49:32.812606+0000","last_became_active":"2024-09-13T16:49:32.134372+0000","last_became_peered":"2024-09-13T16:49:32.134372+0000","last_unstale":"2024-09-13T16:49:32.812606+0000","last_undegraded":"2024-09-13T16:49:32.812606+0000","last_fullsized":"2024-09-13T16:49:32.812606+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:47.797113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110807+0000","last_change":"2024-09-13T16:49:28.103828+0000","last_active":"2024-09-13T16:49:32.110807+0000","last_peered":"2024-09-13T16:49:32.110807+0000","last_clean":"2024-09-13T16:49:32.110807+0000","last_became_active":"2024-09-13T16:49:28.103526+0000","last_became_peered":"2024-09-13T16:49:28.103526+0000","last_unstale":"2024-09-13T16:49:32.110807+0000","last_undegraded":"2024-09-13T16:49:32.110807+0000","last_fullsized":"2024-09-13T16:49:32.110807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:21.612371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.114521+0000","last_change":"2024-09-13T16:49:27.643734+0000","last_active":"2024-09-13T16:49:32.114521+0000","last_peered":"2024-09-13T16:49:32.114521+0000","last_clean":"2024-09-13T16:49:32.114521+0000","last_became_active":"2024-09-13T16:49:27.643129+0000","last_became_peered":"2024-09-13T16:49:27.643129+0000","last_unstale":"2024-09-13T16:49:32.114521+0000","last_undegraded":"2024-09-13T16:49:32.114521+0000","last_fullsized":"2024-09-13T16:49:32.114521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:01.756293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.545214+0000","last_change":"2024-09-13T16:49:32.132105+0000","last_active":"2024-09-13T16:49:32.545214+0000","last_peered":"2024-09-13T16:49:32.545214+0000","last_clean":"2024-09-13T16:49:32.545214+0000","last_became_active":"2024-09-13T16:49:32.131379+0000","last_became_peered":"2024-09-13T16:49:32.131379+0000","last_unstale":"2024-09-13T16:49:32.545214+0000","last_undegraded":"2024-09-13T16:49:32.545214+0000","last_fullsized":"2024-09-13T16:49:32.545214+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:09.215195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111818+0000","last_change":"2024-09-13T16:49:28.099072+0000","last_active":"2024-09-13T16:49:32.111818+0000","last_peered":"2024-09-13T16:49:32.111818+0000","last_clean":"2024-09-13T16:49:32.111818+0000","last_became_active":"2024-09-13T16:49:28.098797+0000","last_became_peered":"2024-09-13T16:49:28.098797+0000","last_unstale":"2024-09-13T16:49:32.111818+0000","last_undegraded":"2024-09-13T16:49:32.111818+0000","last_fullsized":"2024-09-13T16:49:32.111818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:36.997019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.787902+0000","last_change":"2024-09-13T16:49:27.653581+0000","last_active":"2024-09-13T16:49:55.787902+0000","last_peered":"2024-09-13T16:49:55.787902+0000","last_clean":"2024-09-13T16:49:55.787902+0000","last_became_active":"2024-09-13T16:49:27.653245+0000","last_became_peered":"2024-09-13T16:49:27.653245+0000","last_unstale":"2024-09-13T16:49:55.787902+0000","last_undegraded":"2024-09-13T16:49:55.787902+0000","last_fullsized":"2024-09-13T16:49:55.787902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:47.639020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.462959+0000","last_change":"2024-09-13T16:49:32.128569+0000","last_active":"2024-09-13T16:49:33.462959+0000","last_peered":"2024-09-13T16:49:33.462959+0000","last_clean":"2024-09-13T16:49:33.462959+0000","last_became_active":"2024-09-13T16:49:32.128180+0000","last_became_peered":"2024-09-13T16:49:32.128180+0000","last_unstale":"2024-09-13T16:49:33.462959+0000","last_undegraded":"2024-09-13T16:49:33.462959+0000","last_fullsized":"2024-09-13T16:49:33.462959+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.887518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.121087+0000","last_change":"2024-09-13T16:49:28.111923+0000","last_active":"2024-09-13T16:49:32.121087+0000","last_peered":"2024-09-13T16:49:32.121087+0000","last_clean":"2024-09-13T16:49:32.121087+0000","last_became_active":"2024-09-13T16:49:28.108483+0000","last_became_peered":"2024-09-13T16:49:28.108483+0000","last_unstale":"2024-09-13T16:49:32.121087+0000","last_undegraded":"2024-09-13T16:49:32.121087+0000","last_fullsized":"2024-09-13T16:49:32.121087+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:11.921967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.789733+0000","last_change":"2024-09-13T16:49:27.653823+0000","last_active":"2024-09-13T16:49:56.789733+0000","last_peered":"2024-09-13T16:49:56.789733+0000","last_clean":"2024-09-13T16:49:56.789733+0000","last_became_active":"2024-09-13T16:49:27.653389+0000","last_became_peered":"2024-09-13T16:49:27.653389+0000","last_unstale":"2024-09-13T16:49:56.789733+0000","last_undegraded":"2024-09-13T16:49:56.789733+0000","last_fullsized":"2024-09-13T16:49:56.789733+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:32.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.929951+0000","last_change":"2024-09-13T16:49:32.128133+0000","last_active":"2024-09-13T16:49:32.929951+0000","last_peered":"2024-09-13T16:49:32.929951+0000","last_clean":"2024-09-13T16:49:32.929951+0000","last_became_active":"2024-09-13T16:49:32.127641+0000","last_became_peered":"2024-09-13T16:49:32.127641+0000","last_unstale":"2024-09-13T16:49:32.929951+0000","last_undegraded":"2024-09-13T16:49:32.929951+0000","last_fullsized":"2024-09-13T16:49:32.929951+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:18.349527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110796+0000","last_change":"2024-09-13T16:49:28.106264+0000","last_active":"2024-09-13T16:49:32.110796+0000","last_peered":"2024-09-13T16:49:32.110796+0000","last_clean":"2024-09-13T16:49:32.110796+0000","last_became_active":"2024-09-13T16:49:28.105901+0000","last_became_peered":"2024-09-13T16:49:28.105901+0000","last_unstale":"2024-09-13T16:49:32.110796+0000","last_undegraded":"2024-09-13T16:49:32.110796+0000","last_fullsized":"2024-09-13T16:49:32.110796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:46.516128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'10","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:47.191184+0000","last_change":"2024-09-13T16:49:27.648481+0000","last_active":"2024-09-13T16:49:47.191184+0000","last_peered":"2024-09-13T16:49:47.191184+0000","last_clean":"2024-09-13T16:49:47.191184+0000","last_became_active":"2024-09-13T16:49:27.648168+0000","last_became_peered":"2024-09-13T16:49:27.648168+0000","last_unstale":"2024-09-13T16:49:47.191184+0000","last_undegraded":"2024-09-13T16:49:47.191184+0000","last_fullsized":"2024-09-13T16:49:47.191184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:33.556456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.544708+0000","last_change":"2024-09-13T16:49:32.122333+0000","last_active":"2024-09-13T16:49:32.544708+0000","last_peered":"2024-09-13T16:49:32.544708+0000","last_clean":"2024-09-13T16:49:32.544708+0000","last_became_active":"2024-09-13T16:49:32.120843+0000","last_became_peered":"2024-09-13T16:49:32.120843+0000","last_unstale":"2024-09-13T16:49:32.544708+0000","last_undegraded":"2024-09-13T16:49:32.544708+0000","last_fullsized":"2024-09-13T16:49:32.544708+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:37.789336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.109972+0000","last_change":"2024-09-13T16:49:28.102549+0000","last_active":"2024-09-13T16:49:32.109972+0000","last_peered":"2024-09-13T16:49:32.109972+0000","last_clean":"2024-09-13T16:49:32.109972+0000","last_became_active":"2024-09-13T16:49:28.102109+0000","last_became_peered":"2024-09-13T16:49:28.102109+0000","last_unstale":"2024-09-13T16:49:32.109972+0000","last_undegraded":"2024-09-13T16:49:32.109972+0000","last_fullsized":"2024-09-13T16:49:32.109972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:04.410795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.784878+0000","last_change":"2024-09-13T16:49:27.663189+0000","last_active":"2024-09-13T16:49:55.784878+0000","last_peered":"2024-09-13T16:49:55.784878+0000","last_clean":"2024-09-13T16:49:55.784878+0000","last_became_active":"2024-09-13T16:49:27.662852+0000","last_became_peered":"2024-09-13T16:49:27.662852+0000","last_unstale":"2024-09-13T16:49:55.784878+0000","last_undegraded":"2024-09-13T16:49:55.784878+0000","last_fullsized":"2024-09-13T16:49:55.784878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:32.862451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.123054+0000","last_change":"2024-09-13T16:49:32.122394+0000","last_active":"2024-09-13T16:49:32.123054+0000","last_peered":"2024-09-13T16:49:32.123054+0000","last_clean":"2024-09-13T16:49:32.123054+0000","last_became_active":"2024-09-13T16:49:32.121710+0000","last_became_peered":"2024-09-13T16:49:32.121710+0000","last_unstale":"2024-09-13T16:49:32.123054+0000","last_undegraded":"2024-09-13T16:49:32.123054+0000","last_fullsized":"2024-09-13T16:49:32.123054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:28.057105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115366+0000","last_change":"2024-09-13T16:49:28.112762+0000","last_active":"2024-09-13T16:49:32.115366+0000","last_peered":"2024-09-13T16:49:32.115366+0000","last_clean":"2024-09-13T16:49:32.115366+0000","last_became_active":"2024-09-13T16:49:28.111865+0000","last_became_peered":"2024-09-13T16:49:28.111865+0000","last_unstale":"2024-09-13T16:49:32.115366+0000","last_undegraded":"2024-09-13T16:49:32.115366+0000","last_fullsized":"2024-09-13T16:49:32.115366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:36.633413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.786381+0000","last_change":"2024-09-13T16:49:27.647952+0000","last_active":"2024-09-13T16:49:55.786381+0000","last_peered":"2024-09-13T16:49:55.786381+0000","last_clean":"2024-09-13T16:49:55.786381+0000","last_became_active":"2024-09-13T16:49:27.647460+0000","last_became_peered":"2024-09-13T16:49:27.647460+0000","last_unstale":"2024-09-13T16:49:55.786381+0000","last_undegraded":"2024-09-13T16:49:55.786381+0000","last_fullsized":"2024-09-13T16:49:55.786381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:12.836511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.544599+0000","last_change":"2024-09-13T16:49:32.127330+0000","last_active":"2024-09-13T16:49:32.544599+0000","last_peered":"2024-09-13T16:49:32.544599+0000","last_clean":"2024-09-13T16:49:32.544599+0000","last_became_active":"2024-09-13T16:49:32.126026+0000","last_became_peered":"2024-09-13T16:49:32.126026+0000","last_unstale":"2024-09-13T16:49:32.544599+0000","last_undegraded":"2024-09-13T16:49:32.544599+0000","last_fullsized":"2024-09-13T16:49:32.544599+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:05.347991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110499+0000","last_change":"2024-09-13T16:49:28.102721+0000","last_active":"2024-09-13T16:49:32.110499+0000","last_peered":"2024-09-13T16:49:32.110499+0000","last_clean":"2024-09-13T16:49:32.110499+0000","last_became_active":"2024-09-13T16:49:28.102431+0000","last_became_peered":"2024-09-13T16:49:28.102431+0000","last_unstale":"2024-09-13T16:49:32.110499+0000","last_undegraded":"2024-09-13T16:49:32.110499+0000","last_fullsized":"2024-09-13T16:49:32.110499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:38.921527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106164+0000","last_change":"2024-09-13T16:49:27.653616+0000","last_active":"2024-09-13T16:49:32.106164+0000","last_peered":"2024-09-13T16:49:32.106164+0000","last_clean":"2024-09-13T16:49:32.106164+0000","last_became_active":"2024-09-13T16:49:27.653312+0000","last_became_peered":"2024-09-13T16:49:27.653312+0000","last_unstale":"2024-09-13T16:49:32.106164+0000","last_undegraded":"2024-09-13T16:49:32.106164+0000","last_fullsized":"2024-09-13T16:49:32.106164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:37.536821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.075503+0000","last_change":"2024-09-13T16:49:32.121500+0000","last_active":"2024-09-13T16:49:33.075503+0000","last_peered":"2024-09-13T16:49:33.075503+0000","last_clean":"2024-09-13T16:49:33.075503+0000","last_became_active":"2024-09-13T16:49:32.120434+0000","last_became_peered":"2024-09-13T16:49:32.120434+0000","last_unstale":"2024-09-13T16:49:33.075503+0000","last_undegraded":"2024-09-13T16:49:33.075503+0000","last_fullsized":"2024-09-13T16:49:33.075503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:14.832079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.602366+0000","last_change":"2024-09-13T16:49:32.129276+0000","last_active":"2024-09-13T16:49:32.602366+0000","last_peered":"2024-09-13T16:49:32.602366+0000","last_clean":"2024-09-13T16:49:32.602366+0000","last_became_active":"2024-09-13T16:49:32.128351+0000","last_became_peered":"2024-09-13T16:49:32.128351+0000","last_unstale":"2024-09-13T16:49:32.602366+0000","last_undegraded":"2024-09-13T16:49:32.602366+0000","last_fullsized":"2024-09-13T16:49:32.602366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:30.287034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.105256+0000","last_change":"2024-09-13T16:49:28.105330+0000","last_active":"2024-09-13T16:49:32.105256+0000","last_peered":"2024-09-13T16:49:32.105256+0000","last_clean":"2024-09-13T16:49:32.105256+0000","last_became_active":"2024-09-13T16:49:28.105048+0000","last_became_peered":"2024-09-13T16:49:28.105048+0000","last_unstale":"2024-09-13T16:49:32.105256+0000","last_undegraded":"2024-09-13T16:49:32.105256+0000","last_fullsized":"2024-09-13T16:49:32.105256+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:50.302087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.088795+0000","last_change":"2024-09-13T16:49:27.645811+0000","last_active":"2024-09-13T16:49:33.088795+0000","last_peered":"2024-09-13T16:49:33.088795+0000","last_clean":"2024-09-13T16:49:33.088795+0000","last_became_active":"2024-09-13T16:49:27.645239+0000","last_became_peered":"2024-09-13T16:49:27.645239+0000","last_unstale":"2024-09-13T16:49:33.088795+0000","last_undegraded":"2024-09-13T16:49:33.088795+0000","last_fullsized":"2024-09-13T16:49:33.088795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:14.960763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.463236+0000","last_change":"2024-09-13T16:49:32.129619+0000","last_active":"2024-09-13T16:49:33.463236+0000","last_peered":"2024-09-13T16:49:33.463236+0000","last_clean":"2024-09-13T16:49:33.463236+0000","last_became_active":"2024-09-13T16:49:32.128897+0000","last_became_peered":"2024-09-13T16:49:32.128897+0000","last_unstale":"2024-09-13T16:49:33.463236+0000","last_undegraded":"2024-09-13T16:49:33.463236+0000","last_fullsized":"2024-09-13T16:49:33.463236+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:47.343520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.116636+0000","last_change":"2024-09-13T16:49:28.100409+0000","last_active":"2024-09-13T16:49:32.116636+0000","last_peered":"2024-09-13T16:49:32.116636+0000","last_clean":"2024-09-13T16:49:32.116636+0000","last_became_active":"2024-09-13T16:49:28.096557+0000","last_became_peered":"2024-09-13T16:49:28.096557+0000","last_unstale":"2024-09-13T16:49:32.116636+0000","last_undegraded":"2024-09-13T16:49:32.116636+0000","last_fullsized":"2024-09-13T16:49:32.116636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:06.959079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.790720+0000","last_change":"2024-09-13T16:49:27.658366+0000","last_active":"2024-09-13T16:49:56.790720+0000","last_peered":"2024-09-13T16:49:56.790720+0000","last_clean":"2024-09-13T16:49:56.790720+0000","last_became_active":"2024-09-13T16:49:27.657907+0000","last_became_peered":"2024-09-13T16:49:27.657907+0000","last_unstale":"2024-09-13T16:49:56.790720+0000","last_undegraded":"2024-09-13T16:49:56.790720+0000","last_fullsized":"2024-09-13T16:49:56.790720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:11.493555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.105873+0000","last_change":"2024-09-13T16:49:27.656786+0000","last_active":"2024-09-13T16:49:32.105873+0000","last_peered":"2024-09-13T16:49:32.105873+0000","last_clean":"2024-09-13T16:49:32.105873+0000","last_became_active":"2024-09-13T16:49:27.656508+0000","last_became_peered":"2024-09-13T16:49:27.656508+0000","last_unstale":"2024-09-13T16:49:32.105873+0000","last_undegraded":"2024-09-13T16:49:32.105873+0000","last_fullsized":"2024-09-13T16:49:32.105873+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:22.867530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.114259+0000","last_change":"2024-09-13T16:49:28.109232+0000","last_active":"2024-09-13T16:49:32.114259+0000","last_peered":"2024-09-13T16:49:32.114259+0000","last_clean":"2024-09-13T16:49:32.114259+0000","last_became_active":"2024-09-13T16:49:28.108905+0000","last_became_peered":"2024-09-13T16:49:28.108905+0000","last_unstale":"2024-09-13T16:49:32.114259+0000","last_undegraded":"2024-09-13T16:49:32.114259+0000","last_fullsized":"2024-09-13T16:49:32.114259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:57.695383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.547250+0000","last_change":"2024-09-13T16:49:32.128808+0000","last_active":"2024-09-13T16:49:32.547250+0000","last_peered":"2024-09-13T16:49:32.547250+0000","last_clean":"2024-09-13T16:49:32.547250+0000","last_became_active":"2024-09-13T16:49:32.128333+0000","last_became_peered":"2024-09-13T16:49:32.128333+0000","last_unstale":"2024-09-13T16:49:32.547250+0000","last_undegraded":"2024-09-13T16:49:32.547250+0000","last_fullsized":"2024-09-13T16:49:32.547250+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:03.484456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:57.800787+0000","last_change":"2024-09-13T16:49:27.648863+0000","last_active":"2024-09-13T16:49:57.800787+0000","last_peered":"2024-09-13T16:49:57.800787+0000","last_clean":"2024-09-13T16:49:57.800787+0000","last_became_active":"2024-09-13T16:49:27.648572+0000","last_became_peered":"2024-09-13T16:49:27.648572+0000","last_unstale":"2024-09-13T16:49:57.800787+0000","last_undegraded":"2024-09-13T16:49:57.800787+0000","last_fullsized":"2024-09-13T16:49:57.800787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112267+0000","last_change":"2024-09-13T16:49:28.114013+0000","last_active":"2024-09-13T16:49:32.112267+0000","last_peered":"2024-09-13T16:49:32.112267+0000","last_clean":"2024-09-13T16:49:32.112267+0000","last_became_active":"2024-09-13T16:49:28.113722+0000","last_became_peered":"2024-09-13T16:49:28.113722+0000","last_unstale":"2024-09-13T16:49:32.112267+0000","last_undegraded":"2024-09-13T16:49:32.112267+0000","last_fullsized":"2024-09-13T16:49:32.112267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:42.560038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.547370+0000","last_change":"2024-09-13T16:49:32.118308+0000","last_active":"2024-09-13T16:49:32.547370+0000","last_peered":"2024-09-13T16:49:32.547370+0000","last_clean":"2024-09-13T16:49:32.547370+0000","last_became_active":"2024-09-13T16:49:32.117963+0000","last_became_peered":"2024-09-13T16:49:32.117963+0000","last_unstale":"2024-09-13T16:49:32.547370+0000","last_undegraded":"2024-09-13T16:49:32.547370+0000","last_fullsized":"2024-09-13T16:49:32.547370+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:26.939494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106638+0000","last_change":"2024-09-13T16:49:28.102325+0000","last_active":"2024-09-13T16:49:32.106638+0000","last_peered":"2024-09-13T16:49:32.106638+0000","last_clean":"2024-09-13T16:49:32.106638+0000","last_became_active":"2024-09-13T16:49:28.102007+0000","last_became_peered":"2024-09-13T16:49:28.102007+0000","last_unstale":"2024-09-13T16:49:32.106638+0000","last_undegraded":"2024-09-13T16:49:32.106638+0000","last_fullsized":"2024-09-13T16:49:32.106638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:10.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.114331+0000","last_change":"2024-09-13T16:49:28.102964+0000","last_active":"2024-09-13T16:49:32.114331+0000","last_peered":"2024-09-13T16:49:32.114331+0000","last_clean":"2024-09-13T16:49:32.114331+0000","last_became_active":"2024-09-13T16:49:28.102678+0000","last_became_peered":"2024-09-13T16:49:28.102678+0000","last_unstale":"2024-09-13T16:49:32.114331+0000","last_undegraded":"2024-09-13T16:49:32.114331+0000","last_fullsized":"2024-09-13T16:49:32.114331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.255219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110863+0000","last_change":"2024-09-13T16:49:28.117353+0000","last_active":"2024-09-13T16:49:32.110863+0000","last_peered":"2024-09-13T16:49:32.110863+0000","last_clean":"2024-09-13T16:49:32.110863+0000","last_became_active":"2024-09-13T16:49:28.117020+0000","last_became_peered":"2024-09-13T16:49:28.117020+0000","last_unstale":"2024-09-13T16:49:32.110863+0000","last_undegraded":"2024-09-13T16:49:32.110863+0000","last_fullsized":"2024-09-13T16:49:32.110863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:46.896795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115486+0000","last_change":"2024-09-13T16:49:28.112090+0000","last_active":"2024-09-13T16:49:32.115486+0000","last_peered":"2024-09-13T16:49:32.115486+0000","last_clean":"2024-09-13T16:49:32.115486+0000","last_became_active":"2024-09-13T16:49:28.111793+0000","last_became_peered":"2024-09-13T16:49:28.111793+0000","last_unstale":"2024-09-13T16:49:32.115486+0000","last_undegraded":"2024-09-13T16:49:32.115486+0000","last_fullsized":"2024-09-13T16:49:32.115486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:45.462344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.121379+0000","last_change":"2024-09-13T16:49:28.105186+0000","last_active":"2024-09-13T16:49:32.121379+0000","last_peered":"2024-09-13T16:49:32.121379+0000","last_clean":"2024-09-13T16:49:32.121379+0000","last_became_active":"2024-09-13T16:49:28.104827+0000","last_became_peered":"2024-09-13T16:49:28.104827+0000","last_unstale":"2024-09-13T16:49:32.121379+0000","last_undegraded":"2024-09-13T16:49:32.121379+0000","last_fullsized":"2024-09-13T16:49:32.121379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:07.872650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.107517+0000","last_change":"2024-09-13T16:49:28.105694+0000","last_active":"2024-09-13T16:49:32.107517+0000","last_peered":"2024-09-13T16:49:32.107517+0000","last_clean":"2024-09-13T16:49:32.107517+0000","last_became_active":"2024-09-13T16:49:28.105319+0000","last_became_peered":"2024-09-13T16:49:28.105319+0000","last_unstale":"2024-09-13T16:49:32.107517+0000","last_undegraded":"2024-09-13T16:49:32.107517+0000","last_fullsized":"2024-09-13T16:49:32.107517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:14.749198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112644+0000","last_change":"2024-09-13T16:49:28.101008+0000","last_active":"2024-09-13T16:49:32.112644+0000","last_peered":"2024-09-13T16:49:32.112644+0000","last_clean":"2024-09-13T16:49:32.112644+0000","last_became_active":"2024-09-13T16:49:28.100075+0000","last_became_peered":"2024-09-13T16:49:28.100075+0000","last_unstale":"2024-09-13T16:49:32.112644+0000","last_undegraded":"2024-09-13T16:49:32.112644+0000","last_fullsized":"2024-09-13T16:49:32.112644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:01.890674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.119062+0000","last_change":"2024-09-13T16:49:28.108283+0000","last_active":"2024-09-13T16:49:32.119062+0000","last_peered":"2024-09-13T16:49:32.119062+0000","last_clean":"2024-09-13T16:49:32.119062+0000","last_became_active":"2024-09-13T16:49:28.107916+0000","last_became_peered":"2024-09-13T16:49:28.107916+0000","last_unstale":"2024-09-13T16:49:32.119062+0000","last_undegraded":"2024-09-13T16:49:32.119062+0000","last_fullsized":"2024-09-13T16:49:32.119062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:03.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112926+0000","last_change":"2024-09-13T16:49:28.106680+0000","last_active":"2024-09-13T16:49:32.112926+0000","last_peered":"2024-09-13T16:49:32.112926+0000","last_clean":"2024-09-13T16:49:32.112926+0000","last_became_active":"2024-09-13T16:49:28.105210+0000","last_became_peered":"2024-09-13T16:49:28.105210+0000","last_unstale":"2024-09-13T16:49:32.112926+0000","last_undegraded":"2024-09-13T16:49:32.112926+0000","last_fullsized":"2024-09-13T16:49:32.112926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:34.220082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111316+0000","last_change":"2024-09-13T16:49:28.104596+0000","last_active":"2024-09-13T16:49:32.111316+0000","last_peered":"2024-09-13T16:49:32.111316+0000","last_clean":"2024-09-13T16:49:32.111316+0000","last_became_active":"2024-09-13T16:49:28.104306+0000","last_became_peered":"2024-09-13T16:49:28.104306+0000","last_unstale":"2024-09-13T16:49:32.111316+0000","last_undegraded":"2024-09-13T16:49:32.111316+0000","last_fullsized":"2024-09-13T16:49:32.111316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:02.248968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111123+0000","last_change":"2024-09-13T16:49:28.105229+0000","last_active":"2024-09-13T16:49:32.111123+0000","last_peered":"2024-09-13T16:49:32.111123+0000","last_clean":"2024-09-13T16:49:32.111123+0000","last_became_active":"2024-09-13T16:49:28.104832+0000","last_became_peered":"2024-09-13T16:49:28.104832+0000","last_unstale":"2024-09-13T16:49:32.111123+0000","last_undegraded":"2024-09-13T16:49:32.111123+0000","last_fullsized":"2024-09-13T16:49:32.111123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:36.637117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.120414+0000","last_change":"2024-09-13T16:49:28.105370+0000","last_active":"2024-09-13T16:49:32.120414+0000","last_peered":"2024-09-13T16:49:32.120414+0000","last_clean":"2024-09-13T16:49:32.120414+0000","last_became_active":"2024-09-13T16:49:28.105024+0000","last_became_peered":"2024-09-13T16:49:28.105024+0000","last_unstale":"2024-09-13T16:49:32.120414+0000","last_undegraded":"2024-09-13T16:49:32.120414+0000","last_fullsized":"2024-09-13T16:49:32.120414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:32.056178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106901+0000","last_change":"2024-09-13T16:49:28.106106+0000","last_active":"2024-09-13T16:49:32.106901+0000","last_peered":"2024-09-13T16:49:32.106901+0000","last_clean":"2024-09-13T16:49:32.106901+0000","last_became_active":"2024-09-13T16:49:28.105034+0000","last_became_peered":"2024-09-13T16:49:28.105034+0000","last_unstale":"2024-09-13T16:49:32.106901+0000","last_undegraded":"2024-09-13T16:49:32.106901+0000","last_fullsized":"2024-09-13T16:49:32.106901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:08.126157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.116294+0000","last_change":"2024-09-13T16:49:28.116862+0000","last_active":"2024-09-13T16:49:32.116294+0000","last_peered":"2024-09-13T16:49:32.116294+0000","last_clean":"2024-09-13T16:49:32.116294+0000","last_became_active":"2024-09-13T16:49:28.116535+0000","last_became_peered":"2024-09-13T16:49:28.116535+0000","last_unstale":"2024-09-13T16:49:32.116294+0000","last_undegraded":"2024-09-13T16:49:32.116294+0000","last_fullsized":"2024-09-13T16:49:32.116294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:07.216968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.105699+0000","last_change":"2024-09-13T16:49:28.096500+0000","last_active":"2024-09-13T16:49:32.105699+0000","last_peered":"2024-09-13T16:49:32.105699+0000","last_clean":"2024-09-13T16:49:32.105699+0000","last_became_active":"2024-09-13T16:49:28.096218+0000","last_became_peered":"2024-09-13T16:49:28.096218+0000","last_unstale":"2024-09-13T16:49:32.105699+0000","last_undegraded":"2024-09-13T16:49:32.105699+0000","last_fullsized":"2024-09-13T16:49:32.105699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:16.274941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.107810+0000","last_change":"2024-09-13T16:49:28.114943+0000","last_active":"2024-09-13T16:49:32.107810+0000","last_peered":"2024-09-13T16:49:32.107810+0000","last_clean":"2024-09-13T16:49:32.107810+0000","last_became_active":"2024-09-13T16:49:28.114477+0000","last_became_peered":"2024-09-13T16:49:28.114477+0000","last_unstale":"2024-09-13T16:49:32.107810+0000","last_undegraded":"2024-09-13T16:49:32.107810+0000","last_fullsized":"2024-09-13T16:49:32.107810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:21.222638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110227+0000","last_change":"2024-09-13T16:49:28.103795+0000","last_active":"2024-09-13T16:49:32.110227+0000","last_peered":"2024-09-13T16:49:32.110227+0000","last_clean":"2024-09-13T16:49:32.110227+0000","last_became_active":"2024-09-13T16:49:28.103531+0000","last_became_peered":"2024-09-13T16:49:28.103531+0000","last_unstale":"2024-09-13T16:49:32.110227+0000","last_undegraded":"2024-09-13T16:49:32.110227+0000","last_fullsized":"2024-09-13T16:49:32.110227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:17.886309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.116453+0000","last_change":"2024-09-13T16:49:28.109002+0000","last_active":"2024-09-13T16:49:32.116453+0000","last_peered":"2024-09-13T16:49:32.116453+0000","last_clean":"2024-09-13T16:49:32.116453+0000","last_became_active":"2024-09-13T16:49:28.108679+0000","last_became_peered":"2024-09-13T16:49:28.108679+0000","last_unstale":"2024-09-13T16:49:32.116453+0000","last_undegraded":"2024-09-13T16:49:32.116453+0000","last_fullsized":"2024-09-13T16:49:32.116453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:08.803763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115898+0000","last_change":"2024-09-13T16:49:28.114265+0000","last_active":"2024-09-13T16:49:32.115898+0000","last_peered":"2024-09-13T16:49:32.115898+0000","last_clean":"2024-09-13T16:49:32.115898+0000","last_became_active":"2024-09-13T16:49:28.111350+0000","last_became_peered":"2024-09-13T16:49:28.111350+0000","last_unstale":"2024-09-13T16:49:32.115898+0000","last_undegraded":"2024-09-13T16:49:32.115898+0000","last_fullsized":"2024-09-13T16:49:32.115898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:11.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.120331+0000","last_change":"2024-09-13T16:49:28.088565+0000","last_active":"2024-09-13T16:49:32.120331+0000","last_peered":"2024-09-13T16:49:32.120331+0000","last_clean":"2024-09-13T16:49:32.120331+0000","last_became_active":"2024-09-13T16:49:28.088070+0000","last_became_peered":"2024-09-13T16:49:28.088070+0000","last_unstale":"2024-09-13T16:49:32.120331+0000","last_undegraded":"2024-09-13T16:49:32.120331+0000","last_fullsized":"2024-09-13T16:49:32.120331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:23.134281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115640+0000","last_change":"2024-09-13T16:49:28.107501+0000","last_active":"2024-09-13T16:49:32.115640+0000","last_peered":"2024-09-13T16:49:32.115640+0000","last_clean":"2024-09-13T16:49:32.115640+0000","last_became_active":"2024-09-13T16:49:28.107222+0000","last_became_peered":"2024-09-13T16:49:28.107222+0000","last_unstale":"2024-09-13T16:49:32.115640+0000","last_undegraded":"2024-09-13T16:49:32.115640+0000","last_fullsized":"2024-09-13T16:49:32.115640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:04:00.465540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112521+0000","last_change":"2024-09-13T16:49:28.108274+0000","last_active":"2024-09-13T16:49:32.112521+0000","last_peered":"2024-09-13T16:49:32.112521+0000","last_clean":"2024-09-13T16:49:32.112521+0000","last_became_active":"2024-09-13T16:49:28.107977+0000","last_became_peered":"2024-09-13T16:49:28.107977+0000","last_unstale":"2024-09-13T16:49:32.112521+0000","last_undegraded":"2024-09-13T16:49:32.112521+0000","last_fullsized":"2024-09-13T16:49:32.112521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:31.398072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106201+0000","last_change":"2024-09-13T16:49:28.098428+0000","last_active":"2024-09-13T16:49:32.106201+0000","last_peered":"2024-09-13T16:49:32.106201+0000","last_clean":"2024-09-13T16:49:32.106201+0000","last_became_active":"2024-09-13T16:49:28.098139+0000","last_became_peered":"2024-09-13T16:49:28.098139+0000","last_unstale":"2024-09-13T16:49:32.106201+0000","last_undegraded":"2024-09-13T16:49:32.106201+0000","last_fullsized":"2024-09-13T16:49:32.106201+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:36.977026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110664+0000","last_change":"2024-09-13T16:49:28.103117+0000","last_active":"2024-09-13T16:49:32.110664+0000","last_peered":"2024-09-13T16:49:32.110664+0000","last_clean":"2024-09-13T16:49:32.110664+0000","last_became_active":"2024-09-13T16:49:28.102850+0000","last_became_peered":"2024-09-13T16:49:28.102850+0000","last_unstale":"2024-09-13T16:49:32.110664+0000","last_undegraded":"2024-09-13T16:49:32.110664+0000","last_fullsized":"2024-09-13T16:49:32.110664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:21.883563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.116551+0000","last_change":"2024-09-13T16:49:28.105876+0000","last_active":"2024-09-13T16:49:32.116551+0000","last_peered":"2024-09-13T16:49:32.116551+0000","last_clean":"2024-09-13T16:49:32.116551+0000","last_became_active":"2024-09-13T16:49:28.104340+0000","last_became_peered":"2024-09-13T16:49:28.104340+0000","last_unstale":"2024-09-13T16:49:32.116551+0000","last_undegraded":"2024-09-13T16:49:32.116551+0000","last_fullsized":"2024-09-13T16:49:32.116551+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:06.385262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110737+0000","last_change":"2024-09-13T16:49:28.104638+0000","last_active":"2024-09-13T16:49:32.110737+0000","last_peered":"2024-09-13T16:49:32.110737+0000","last_clean":"2024-09-13T16:49:32.110737+0000","last_became_active":"2024-09-13T16:49:28.104145+0000","last_became_peered":"2024-09-13T16:49:28.104145+0000","last_unstale":"2024-09-13T16:49:32.110737+0000","last_undegraded":"2024-09-13T16:49:32.110737+0000","last_fullsized":"2024-09-13T16:49:32.110737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:12.502634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.105766+0000","last_change":"2024-09-13T16:49:28.099310+0000","last_active":"2024-09-13T16:49:32.105766+0000","last_peered":"2024-09-13T16:49:32.105766+0000","last_clean":"2024-09-13T16:49:32.105766+0000","last_became_active":"2024-09-13T16:49:28.098804+0000","last_became_peered":"2024-09-13T16:49:28.098804+0000","last_unstale":"2024-09-13T16:49:32.105766+0000","last_undegraded":"2024-09-13T16:49:32.105766+0000","last_fullsized":"2024-09-13T16:49:32.105766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:33.866940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111458+0000","last_change":"2024-09-13T16:49:28.116644+0000","last_active":"2024-09-13T16:49:32.111458+0000","last_peered":"2024-09-13T16:49:32.111458+0000","last_clean":"2024-09-13T16:49:32.111458+0000","last_became_active":"2024-09-13T16:49:28.116350+0000","last_became_peered":"2024-09-13T16:49:28.116350+0000","last_unstale":"2024-09-13T16:49:32.111458+0000","last_undegraded":"2024-09-13T16:49:32.111458+0000","last_fullsized":"2024-09-13T16:49:32.111458+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:07.922567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115549+0000","last_change":"2024-09-13T16:49:28.107528+0000","last_active":"2024-09-13T16:49:32.115549+0000","last_peered":"2024-09-13T16:49:32.115549+0000","last_clean":"2024-09-13T16:49:32.115549+0000","last_became_active":"2024-09-13T16:49:28.107260+0000","last_became_peered":"2024-09-13T16:49:28.107260+0000","last_unstale":"2024-09-13T16:49:32.115549+0000","last_undegraded":"2024-09-13T16:49:32.115549+0000","last_fullsized":"2024-09-13T16:49:32.115549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:23.482772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.117239+0000","last_change":"2024-09-13T16:49:28.105396+0000","last_active":"2024-09-13T16:49:32.117239+0000","last_peered":"2024-09-13T16:49:32.117239+0000","last_clean":"2024-09-13T16:49:32.117239+0000","last_became_active":"2024-09-13T16:49:28.105050+0000","last_became_peered":"2024-09-13T16:49:28.105050+0000","last_unstale":"2024-09-13T16:49:32.117239+0000","last_undegraded":"2024-09-13T16:49:32.117239+0000","last_fullsized":"2024-09-13T16:49:32.117239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:51.533286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.118246+0000","last_change":"2024-09-13T16:49:28.112680+0000","last_active":"2024-09-13T16:49:32.118246+0000","last_peered":"2024-09-13T16:49:32.118246+0000","last_clean":"2024-09-13T16:49:32.118246+0000","last_became_active":"2024-09-13T16:49:28.112389+0000","last_became_peered":"2024-09-13T16:49:28.112389+0000","last_unstale":"2024-09-13T16:49:32.118246+0000","last_undegraded":"2024-09-13T16:49:32.118246+0000","last_fullsized":"2024-09-13T16:49:32.118246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:05.464951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.107731+0000","last_change":"2024-09-13T16:49:28.105746+0000","last_active":"2024-09-13T16:49:32.107731+0000","last_peered":"2024-09-13T16:49:32.107731+0000","last_clean":"2024-09-13T16:49:32.107731+0000","last_became_active":"2024-09-13T16:49:28.105217+0000","last_became_peered":"2024-09-13T16:49:28.105217+0000","last_unstale":"2024-09-13T16:49:32.107731+0000","last_undegraded":"2024-09-13T16:49:32.107731+0000","last_fullsized":"2024-09-13T16:49:32.107731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:13.165993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6645,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":106,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":39383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383699,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":983040,"data_stored":477145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.499},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.62}]},{"osd":7,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.46999999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":9,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.71099999999999997}]},{"osd":10,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69099999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1593344,"data_stored":1070639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.628},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56100000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67100000000000004}]},{"osd":9,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.754},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70099999999999996}]},{"osd":11,"last update":"Fri Sep 13 16:49:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.79700000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808860,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":983040,"data_stored":477145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.94099999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.745}]},{"osd":3,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3799999999999999,"5min":1.55,"15min":1.55},"last":0.625},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77800000000000002,"15min":0.79300000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1679999999999999,"5min":1.458,"15min":1.458},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.84899999999999998,"15min":0.83499999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2190000000000001,"5min":1.635,"15min":1.635},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.90800000000000003,"15min":0.92900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3480000000000001,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.90300000000000002,"15min":0.91100000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1970000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:48:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.081},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.2589999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.97799999999999998,"15min":1.0029999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2889999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.76200000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85299999999999998,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":1.0309999999999999,"15min":1.0549999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5669999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.89000000000000001}]},{"osd":10,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":476970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73699999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.39200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.72999999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.41499999999999998,"15min":0.41799999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.749,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.47199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.79000000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61499999999999999,"15min":0.61299999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.85799999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.84699999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332134,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36756,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708396,"statfs":{"total":95995035648,"available":95957397504,"internally_reserved":0,"allocated":1585152,"data_stored":1068087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.26600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.41899999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58899999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.433},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76500000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.83099999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82999999999999996,"5min":0.88,"15min":0.88},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.75900000000000001}]},{"osd":9,"last update":"Fri Sep 13 16:49:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71499999999999997,"15min":0.71999999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.749}]},{"osd":10,"last update":"Fri Sep 13 16:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.67500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":6,"up_from":46,"seq":197568495659,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":476653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.53400000000000003,"15min":0.55500000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63700000000000001,"15min":0.64500000000000002},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82499999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.65300000000000002},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.93400000000000005}]},{"osd":2,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.71299999999999997,"15min":0.70299999999999996},"min":{"1min":0.53000000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93100000000000005,"5min":1.353,"15min":1.353},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69699999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.66700000000000004,"15min":0.68700000000000006},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78800000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66800000000000004,"15min":0.68400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85299999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.48099999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.748},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.55300000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96499999999999997,"5min":1.03,"15min":1.03},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.83499999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.59299999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.054,"5min":1.097,"15min":1.097},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.63800000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.83299999999999996}]},{"osd":8,"last update":"Fri Sep 13 16:49:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.752,"15min":0.746},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81599999999999995,"15min":0.81000000000000005},"min":{"1min":0.65300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0609999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78200000000000003}]},{"osd":9,"last update":"Fri Sep 13 16:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.83999999999999997,"15min":0.84399999999999997},"min":{"1min":0.54500000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.86299999999999999,"15min":0.874},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.089,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.65100000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.82399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757298,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1601536,"data_stored":1068359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.56100000000000005,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.52100000000000002},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.504,"15min":0.48199999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.36699999999999999,"15min":0.35999999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.378,"15min":0.37},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.25700000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.54900000000000004,"15min":0.52300000000000002},"min":{"1min":0.42499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.44800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56499999999999995,"15min":0.54300000000000004},"min":{"1min":0.46700000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:49:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.625,"15min":0.60999999999999999},"min":{"1min":0.44600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.63500000000000001,"15min":0.61099999999999999},"min":{"1min":0.46999999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.48899999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:49:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.40699999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60599999999999998,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91200000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.437}]},{"osd":8,"last update":"Fri Sep 13 16:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35599999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.72799999999999998,"15min":0.70699999999999996},"min":{"1min":0.56100000000000005,"5min":0.443,"15min":0.443},"max":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.50700000000000001}]},{"osd":10,"last update":"Fri Sep 13 16:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.46500000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920821,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":476585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72499999999999998,"5min":0.879,"15min":0.879},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59199999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.376,"15min":0.36599999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81899999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.628},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66400000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.80300000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:49:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.751,"5min":1.004,"15min":1.004},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80900000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.81799999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:48:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.496,"15min":0.498},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.73399999999999999}]},{"osd":8,"last update":"Fri Sep 13 16:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63,"15min":0.63},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.72299999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.84999999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.76100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":983040,"data_stored":476336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.371},"min":{"1min":0.33100000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.441,"15min":0.42599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72699999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.372}]},{"osd":1,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58599999999999997,"15min":0.55300000000000005},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.60599999999999998,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.61799999999999999,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64600000000000002,"15min":0.61699999999999999},"min":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Sep 13 16:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67500000000000004,"15min":0.63100000000000001},"min":{"1min":0.45900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.90100000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61799999999999999,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.66800000000000004,"15min":0.63900000000000001},"min":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.70799999999999996,"15min":0.67700000000000005},"min":{"1min":0.59499999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:49:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.68799999999999994,"15min":0.66300000000000003},"min":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93600000000000005,"5min":1.087,"15min":1.087},"last":0.629},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82399999999999995,"5min":1.087,"15min":1.087},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:48:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.77800000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.78500000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93300000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0629999999999999,"5min":0.76700000000000002,"15min":0.71699999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":8.7639999999999993,"5min":8.7639999999999993,"15min":8.7639999999999993},"last":0.84399999999999997}]},{"osd":9,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.69699999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.244,"5min":1.327,"15min":1.327},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.66100000000000003}]},{"osd":10,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.79700000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":501079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.436,"5min":0.249,"15min":0.249},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54000000000000004,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:49:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.54500000000000004,"15min":0.52400000000000002},"min":{"1min":0.45700000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75800000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.44,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77000000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.439}]},{"osd":5,"last update":"Fri Sep 13 16:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40100000000000002,"15min":0.39800000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.63600000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.318},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.39000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45500000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.625,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.627,"15min":0.628},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Sep 13 16:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.746,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54400000000000004}]},{"osd":8,"last update":"Fri Sep 13 16:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.747,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.40200000000000002}]},{"osd":9,"last update":"Fri Sep 13 16:49:48 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.57199999999999995,"5min":0.502,"15min":0.502},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.55800000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.53800000000000003}]},{"osd":10,"last update":"Fri Sep 13 16:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":480358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53000000000000003,"15min":0.50600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79500000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.50800000000000001},"min":{"1min":0.36499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.92300000000000004},"min":{"1min":0.42399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.80300000000000005,"5min":10.377000000000001,"15min":10.377000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.48399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.78900000000000003,"15min":0.94499999999999995},"min":{"1min":0.53900000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98899999999999999,"5min":10.347,"15min":10.347},"last":0.62}]},{"osd":4,"last update":"Fri Sep 13 16:49:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.39100000000000001,"15min":0.371},"min":{"1min":0.26500000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66300000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.36599999999999999},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.497}]},{"osd":5,"last update":"Fri Sep 13 16:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.52500000000000002,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84299999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.80300000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83299999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:49:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.48599999999999999,"15min":0.45200000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.46400000000000002,"15min":0.42799999999999999},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.68600000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.47199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81699999999999995}]},{"osd":9,"last update":"Fri Sep 13 16:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.90400000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92000000000000004,"5min":1.115,"15min":1.115},"last":0.74099999999999999}]},{"osd":10,"last update":"Fri Sep 13 16:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":478041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:49:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58099999999999996,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85499999999999998,"5min":1.109,"15min":1.109},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63500000000000001,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91000000000000003,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.49299999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65300000000000002,"15min":0.65000000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95599999999999996,"5min":1.871,"15min":1.871},"last":0.503}]},{"osd":3,"last update":"Fri Sep 13 16:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.36799999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.628}]},{"osd":4,"last update":"Fri Sep 13 16:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.38800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":1.133,"15min":1.133},"last":0.622},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65300000000000002,"15min":0.627},"min":{"1min":0.45200000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94399999999999995,"5min":1.198,"15min":1.198},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.46500000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85199999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95199999999999996,"5min":1.079,"15min":1.079},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:49:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98199999999999998,"5min":1.117,"15min":1.117},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84999999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:48:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.70999999999999996,"15min":0.69699999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1850000000000001,"5min":1.228,"15min":1.228},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.66400000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:49:20 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.745,"15min":0.752},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88500000000000001,"5min":1.044,"15min":1.044},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.66700000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0760000000000001,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.80000000000000004}]},{"osd":9,"last update":"Fri Sep 13 16:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.097,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98999999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.89800000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.86899999999999999}]},{"osd":11,"last update":"Fri Sep 13 16:49:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.94399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":24789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:50:01.084 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T16:50:01.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:00 smithi094 ceph-mon[35259]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:01.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:00 smithi094 ceph-mon[35259]: from='client.24854 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:01.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:00 smithi094 ceph-mon[35259]: pgmap v313: 129 pgs: 129 active+clean; 583 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.9 KiB/s wr, 5 op/s 2024-09-13T16:50:01.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:00 smithi094 ceph-mon[35259]: overall HEALTH_OK 2024-09-13T16:50:01.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:00 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2353593304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:50:01.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:00 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3247232338' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:50:01.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:00 smithi144 ceph-mon[35328]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:01.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:00 smithi144 ceph-mon[35328]: from='client.24854 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:00 smithi144 ceph-mon[35328]: pgmap v313: 129 pgs: 129 active+clean; 583 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.9 KiB/s wr, 5 op/s 2024-09-13T16:50:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:00 smithi144 ceph-mon[35328]: overall HEALTH_OK 2024-09-13T16:50:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:00 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2353593304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:50:01.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:00 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3247232338' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:50:01.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.271+0000 7f50e8a00640 1 -- 172.21.15.18:0/68158999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e4102f40 msgr2=0x7f50e4105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:01.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.271+0000 7f50e8a00640 1 --2- 172.21.15.18:0/68158999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e4102f40 0x7f50e4105330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009900 tx=0x7f50d002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.271+0000 7f50e8a00640 1 -- 172.21.15.18:0/68158999 shutdown_connections 2024-09-13T16:50:01.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.271+0000 7f50e8a00640 1 --2- 172.21.15.18:0/68158999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e4102f40 0x7f50e4105330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.271+0000 7f50e8a00640 1 --2- 172.21.15.18:0/68158999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e4105870 0x7f50e4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.271+0000 7f50e8a00640 1 --2- 172.21.15.18:0/68158999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50e4100610 0x7f50e4102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.271+0000 7f50e8a00640 1 -- 172.21.15.18:0/68158999 >> 172.21.15.18:0/68158999 conn(0x7f50e40fa1f0 msgr2=0x7f50e40fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:01.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.271+0000 7f50e8a00640 1 -- 172.21.15.18:0/68158999 shutdown_connections 2024-09-13T16:50:01.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.271+0000 7f50e8a00640 1 -- 172.21.15.18:0/68158999 wait complete. 2024-09-13T16:50:01.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.272+0000 7f50e8a00640 1 Processor -- start 2024-09-13T16:50:01.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.272+0000 7f50e8a00640 1 -- start start 2024-09-13T16:50:01.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.272+0000 7f50e8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e4100610 0x7f50e4197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:01.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.272+0000 7f50e8a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50e4102f40 0x7f50e4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.272+0000 7f50e8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e4105870 0x7f50e419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.272+0000 7f50e8a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e419f8f0 con 0x7f50e4100610 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.272+0000 7f50e8a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e419fa60 con 0x7f50e4102f40 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.272+0000 7f50e8a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e419fc20 con 0x7f50e4105870 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e4100610 0x7f50e4197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e4100610 0x7f50e4197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38388/0 (socket says 172.21.15.18:38388) 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e3400640 1 -- 172.21.15.18:0/1763967642 learned_addr learned my addr 172.21.15.18:0/1763967642 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e3e00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e4105870 0x7f50e419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e2a00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50e4102f40 0x7f50e4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e3400640 1 -- 172.21.15.18:0/1763967642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e4105870 msgr2=0x7f50e419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:01.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e3400640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e4105870 0x7f50e419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e3400640 1 -- 172.21.15.18:0/1763967642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50e4102f40 msgr2=0x7f50e4198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:01.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e3400640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50e4102f40 0x7f50e4198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e3400640 1 -- 172.21.15.18:0/1763967642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0009560 con 0x7f50e4100610 2024-09-13T16:50:01.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.273+0000 7f50e3400640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e4100610 0x7f50e4197e00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50d400e9f0 tx=0x7f50d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:01.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.274+0000 7f50dbe00640 1 -- 172.21.15.18:0/1763967642 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4009700 con 0x7f50e4100610 2024-09-13T16:50:01.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.274+0000 7f50dbe00640 1 -- 172.21.15.18:0/1763967642 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50d400cd80 con 0x7f50e4100610 2024-09-13T16:50:01.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.274+0000 7f50e8a00640 1 -- 172.21.15.18:0/1763967642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e419ff00 con 0x7f50e4100610 2024-09-13T16:50:01.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.274+0000 7f50dbe00640 1 -- 172.21.15.18:0/1763967642 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4018860 con 0x7f50e4100610 2024-09-13T16:50:01.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.274+0000 7f50e8a00640 1 -- 172.21.15.18:0/1763967642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e41a0320 con 0x7f50e4100610 2024-09-13T16:50:01.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.275+0000 7f50e8a00640 1 -- 172.21.15.18:0/1763967642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e41073e0 con 0x7f50e4100610 2024-09-13T16:50:01.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.277+0000 7f50dbe00640 1 -- 172.21.15.18:0/1763967642 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f50d40189c0 con 0x7f50e4100610 2024-09-13T16:50:01.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.278+0000 7f50dbe00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f50c80a1120 0x7f50c80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:01.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.278+0000 7f50dbe00640 1 -- 172.21.15.18:0/1763967642 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f50d4014070 con 0x7f50e4100610 2024-09-13T16:50:01.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.278+0000 7f50e2a00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f50c80a1120 0x7f50c80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:01.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.279+0000 7f50e2a00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f50c80a1120 0x7f50c80a35e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50d0005ab0 tx=0x7f50d00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:01.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.282+0000 7f50dbe00640 1 -- 172.21.15.18:0/1763967642 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f50d4052e20 con 0x7f50e4100610 2024-09-13T16:50:01.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.461+0000 7f50e8a00640 1 -- 172.21.15.18:0/1763967642 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50e402c4f0 con 0x7f50c80a1120 2024-09-13T16:50:01.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.472+0000 7f50dbe00640 1 -- 172.21.15.18:0/1763967642 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422556 (secure 0 0 0) 0x7f50e402c4f0 con 0x7f50c80a1120 2024-09-13T16:50:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:50:01.482 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T16:50:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.477+0000 7f50e8a00640 1 -- 172.21.15.18:0/1763967642 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f50c80a1120 msgr2=0x7f50c80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.477+0000 7f50e8a00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f50c80a1120 0x7f50c80a35e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50d0005ab0 tx=0x7f50d00314a0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.477+0000 7f50e8a00640 1 -- 172.21.15.18:0/1763967642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e4100610 msgr2=0x7f50e4197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.477+0000 7f50e8a00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e4100610 0x7f50e4197e00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50d400e9f0 tx=0x7f50d400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.478+0000 7f50e8a00640 1 -- 172.21.15.18:0/1763967642 shutdown_connections 2024-09-13T16:50:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.478+0000 7f50e8a00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e4105870 0x7f50e419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.478+0000 7f50e8a00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50e4102f40 0x7f50e4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.478+0000 7f50e8a00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f50c80a1120 0x7f50c80a35e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.478+0000 7f50e8a00640 1 --2- 172.21.15.18:0/1763967642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e4100610 0x7f50e4197e00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:01.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.478+0000 7f50e8a00640 1 -- 172.21.15.18:0/1763967642 >> 172.21.15.18:0/1763967642 conn(0x7f50e40fa1f0 msgr2=0x7f50e4100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:01.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.478+0000 7f50e8a00640 1 -- 172.21.15.18:0/1763967642 shutdown_connections 2024-09-13T16:50:01.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:01.478+0000 7f50e8a00640 1 -- 172.21.15.18:0/1763967642 wait complete. 2024-09-13T16:50:01.496 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-13T16:49:59.764917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597013,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":287,"num_write_kb":2978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378560,"kb_used_data":13400,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124563264,"statfs":{"total":1151940427776,"available":1151552782336,"internally_reserved":0,"allocated":13721600,"data_stored":7527397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":373798213},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2193,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":59,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003856"},"pg_stats":[{"pgid":"2.1f","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106337+0000","last_change":"2024-09-13T16:49:27.652760+0000","last_active":"2024-09-13T16:49:32.106337+0000","last_peered":"2024-09-13T16:49:32.106337+0000","last_clean":"2024-09-13T16:49:32.106337+0000","last_became_active":"2024-09-13T16:49:27.647493+0000","last_became_peered":"2024-09-13T16:49:27.647493+0000","last_unstale":"2024-09-13T16:49:32.106337+0000","last_undegraded":"2024-09-13T16:49:32.106337+0000","last_fullsized":"2024-09-13T16:49:32.106337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:54.438761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.118503+0000","last_change":"2024-09-13T16:49:28.116092+0000","last_active":"2024-09-13T16:49:32.118503+0000","last_peered":"2024-09-13T16:49:32.118503+0000","last_clean":"2024-09-13T16:49:32.118503+0000","last_became_active":"2024-09-13T16:49:28.115468+0000","last_became_peered":"2024-09-13T16:49:28.115468+0000","last_unstale":"2024-09-13T16:49:32.118503+0000","last_undegraded":"2024-09-13T16:49:32.118503+0000","last_fullsized":"2024-09-13T16:49:32.118503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:33.214589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.546939+0000","last_change":"2024-09-13T16:49:32.127597+0000","last_active":"2024-09-13T16:49:32.546939+0000","last_peered":"2024-09-13T16:49:32.546939+0000","last_clean":"2024-09-13T16:49:32.546939+0000","last_became_active":"2024-09-13T16:49:32.127122+0000","last_became_peered":"2024-09-13T16:49:32.127122+0000","last_unstale":"2024-09-13T16:49:32.546939+0000","last_undegraded":"2024-09-13T16:49:32.546939+0000","last_fullsized":"2024-09-13T16:49:32.546939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:16.362727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.118653+0000","last_change":"2024-09-13T16:49:27.668009+0000","last_active":"2024-09-13T16:49:32.118653+0000","last_peered":"2024-09-13T16:49:32.118653+0000","last_clean":"2024-09-13T16:49:32.118653+0000","last_became_active":"2024-09-13T16:49:27.667713+0000","last_became_peered":"2024-09-13T16:49:27.667713+0000","last_unstale":"2024-09-13T16:49:32.118653+0000","last_undegraded":"2024-09-13T16:49:32.118653+0000","last_fullsized":"2024-09-13T16:49:32.118653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:51.427966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115284+0000","last_change":"2024-09-13T16:49:28.107799+0000","last_active":"2024-09-13T16:49:32.115284+0000","last_peered":"2024-09-13T16:49:32.115284+0000","last_clean":"2024-09-13T16:49:32.115284+0000","last_became_active":"2024-09-13T16:49:28.107432+0000","last_became_peered":"2024-09-13T16:49:28.107432+0000","last_unstale":"2024-09-13T16:49:32.115284+0000","last_undegraded":"2024-09-13T16:49:32.115284+0000","last_fullsized":"2024-09-13T16:49:32.115284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:31.554614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.132652+0000","last_change":"2024-09-13T16:49:32.132328+0000","last_active":"2024-09-13T16:49:32.132652+0000","last_peered":"2024-09-13T16:49:32.132652+0000","last_clean":"2024-09-13T16:49:32.132652+0000","last_became_active":"2024-09-13T16:49:32.131831+0000","last_became_peered":"2024-09-13T16:49:32.131831+0000","last_unstale":"2024-09-13T16:49:32.132652+0000","last_undegraded":"2024-09-13T16:49:32.132652+0000","last_fullsized":"2024-09-13T16:49:32.132652+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:35.409572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.786952+0000","last_change":"2024-09-13T16:49:27.651527+0000","last_active":"2024-09-13T16:49:56.786952+0000","last_peered":"2024-09-13T16:49:56.786952+0000","last_clean":"2024-09-13T16:49:56.786952+0000","last_became_active":"2024-09-13T16:49:27.650985+0000","last_became_peered":"2024-09-13T16:49:27.650985+0000","last_unstale":"2024-09-13T16:49:56.786952+0000","last_undegraded":"2024-09-13T16:49:56.786952+0000","last_fullsized":"2024-09-13T16:49:56.786952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:31.473563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.109873+0000","last_change":"2024-09-13T16:49:28.101714+0000","last_active":"2024-09-13T16:49:32.109873+0000","last_peered":"2024-09-13T16:49:32.109873+0000","last_clean":"2024-09-13T16:49:32.109873+0000","last_became_active":"2024-09-13T16:49:28.101409+0000","last_became_peered":"2024-09-13T16:49:28.101409+0000","last_unstale":"2024-09-13T16:49:32.109873+0000","last_undegraded":"2024-09-13T16:49:32.109873+0000","last_fullsized":"2024-09-13T16:49:32.109873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:05.786731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.133388+0000","last_change":"2024-09-13T16:49:32.133096+0000","last_active":"2024-09-13T16:49:32.133388+0000","last_peered":"2024-09-13T16:49:32.133388+0000","last_clean":"2024-09-13T16:49:32.133388+0000","last_became_active":"2024-09-13T16:49:32.132704+0000","last_became_peered":"2024-09-13T16:49:32.132704+0000","last_unstale":"2024-09-13T16:49:32.133388+0000","last_undegraded":"2024-09-13T16:49:32.133388+0000","last_fullsized":"2024-09-13T16:49:32.133388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:18.490892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111165+0000","last_change":"2024-09-13T16:49:27.650532+0000","last_active":"2024-09-13T16:49:32.111165+0000","last_peered":"2024-09-13T16:49:32.111165+0000","last_clean":"2024-09-13T16:49:32.111165+0000","last_became_active":"2024-09-13T16:49:27.650095+0000","last_became_peered":"2024-09-13T16:49:27.650095+0000","last_unstale":"2024-09-13T16:49:32.111165+0000","last_undegraded":"2024-09-13T16:49:32.111165+0000","last_fullsized":"2024-09-13T16:49:32.111165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:58.066902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.114979+0000","last_change":"2024-09-13T16:49:28.104676+0000","last_active":"2024-09-13T16:49:32.114979+0000","last_peered":"2024-09-13T16:49:32.114979+0000","last_clean":"2024-09-13T16:49:32.114979+0000","last_became_active":"2024-09-13T16:49:28.104376+0000","last_became_peered":"2024-09-13T16:49:28.104376+0000","last_unstale":"2024-09-13T16:49:32.114979+0000","last_undegraded":"2024-09-13T16:49:32.114979+0000","last_fullsized":"2024-09-13T16:49:32.114979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:29.038008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.127852+0000","last_change":"2024-09-13T16:49:32.127590+0000","last_active":"2024-09-13T16:49:32.127852+0000","last_peered":"2024-09-13T16:49:32.127852+0000","last_clean":"2024-09-13T16:49:32.127852+0000","last_became_active":"2024-09-13T16:49:32.127362+0000","last_became_peered":"2024-09-13T16:49:32.127362+0000","last_unstale":"2024-09-13T16:49:32.127852+0000","last_undegraded":"2024-09-13T16:49:32.127852+0000","last_fullsized":"2024-09-13T16:49:32.127852+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:37.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111416+0000","last_change":"2024-09-13T16:49:28.104850+0000","last_active":"2024-09-13T16:49:32.111416+0000","last_peered":"2024-09-13T16:49:32.111416+0000","last_clean":"2024-09-13T16:49:32.111416+0000","last_became_active":"2024-09-13T16:49:28.104569+0000","last_became_peered":"2024-09-13T16:49:28.104569+0000","last_unstale":"2024-09-13T16:49:32.111416+0000","last_undegraded":"2024-09-13T16:49:32.111416+0000","last_fullsized":"2024-09-13T16:49:32.111416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:26.949030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.785152+0000","last_change":"2024-09-13T16:49:27.649046+0000","last_active":"2024-09-13T16:49:55.785152+0000","last_peered":"2024-09-13T16:49:55.785152+0000","last_clean":"2024-09-13T16:49:55.785152+0000","last_became_active":"2024-09-13T16:49:27.648633+0000","last_became_peered":"2024-09-13T16:49:27.648633+0000","last_unstale":"2024-09-13T16:49:55.785152+0000","last_undegraded":"2024-09-13T16:49:55.785152+0000","last_fullsized":"2024-09-13T16:49:55.785152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:07.191181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.124608+0000","last_change":"2024-09-13T16:49:32.123910+0000","last_active":"2024-09-13T16:49:32.124608+0000","last_peered":"2024-09-13T16:49:32.124608+0000","last_clean":"2024-09-13T16:49:32.124608+0000","last_became_active":"2024-09-13T16:49:32.123515+0000","last_became_peered":"2024-09-13T16:49:32.123515+0000","last_unstale":"2024-09-13T16:49:32.124608+0000","last_undegraded":"2024-09-13T16:49:32.124608+0000","last_fullsized":"2024-09-13T16:49:32.124608+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:13.667573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112413+0000","last_change":"2024-09-13T16:49:28.112299+0000","last_active":"2024-09-13T16:49:32.112413+0000","last_peered":"2024-09-13T16:49:32.112413+0000","last_clean":"2024-09-13T16:49:32.112413+0000","last_became_active":"2024-09-13T16:49:28.111945+0000","last_became_peered":"2024-09-13T16:49:28.111945+0000","last_unstale":"2024-09-13T16:49:32.112413+0000","last_undegraded":"2024-09-13T16:49:32.112413+0000","last_fullsized":"2024-09-13T16:49:32.112413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:42.813731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.546944+0000","last_change":"2024-09-13T16:49:27.654517+0000","last_active":"2024-09-13T16:49:32.546944+0000","last_peered":"2024-09-13T16:49:32.546944+0000","last_clean":"2024-09-13T16:49:32.546944+0000","last_became_active":"2024-09-13T16:49:27.654207+0000","last_became_peered":"2024-09-13T16:49:27.654207+0000","last_unstale":"2024-09-13T16:49:32.546944+0000","last_undegraded":"2024-09-13T16:49:32.546944+0000","last_fullsized":"2024-09-13T16:49:32.546944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:14.562289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.122686+0000","last_change":"2024-09-13T16:49:32.121834+0000","last_active":"2024-09-13T16:49:32.122686+0000","last_peered":"2024-09-13T16:49:32.122686+0000","last_clean":"2024-09-13T16:49:32.122686+0000","last_became_active":"2024-09-13T16:49:32.121409+0000","last_became_peered":"2024-09-13T16:49:32.121409+0000","last_unstale":"2024-09-13T16:49:32.122686+0000","last_undegraded":"2024-09-13T16:49:32.122686+0000","last_fullsized":"2024-09-13T16:49:32.122686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.112143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106761+0000","last_change":"2024-09-13T16:49:28.115111+0000","last_active":"2024-09-13T16:49:32.106761+0000","last_peered":"2024-09-13T16:49:32.106761+0000","last_clean":"2024-09-13T16:49:32.106761+0000","last_became_active":"2024-09-13T16:49:28.114491+0000","last_became_peered":"2024-09-13T16:49:28.114491+0000","last_unstale":"2024-09-13T16:49:32.106761+0000","last_undegraded":"2024-09-13T16:49:32.106761+0000","last_fullsized":"2024-09-13T16:49:32.106761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:59.639110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.787737+0000","last_change":"2024-09-13T16:49:27.661045+0000","last_active":"2024-09-13T16:49:55.787737+0000","last_peered":"2024-09-13T16:49:55.787737+0000","last_clean":"2024-09-13T16:49:55.787737+0000","last_became_active":"2024-09-13T16:49:27.660728+0000","last_became_peered":"2024-09-13T16:49:27.660728+0000","last_unstale":"2024-09-13T16:49:55.787737+0000","last_undegraded":"2024-09-13T16:49:55.787737+0000","last_fullsized":"2024-09-13T16:49:55.787737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:37.292582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.545182+0000","last_change":"2024-09-13T16:49:32.122407+0000","last_active":"2024-09-13T16:49:32.545182+0000","last_peered":"2024-09-13T16:49:32.545182+0000","last_clean":"2024-09-13T16:49:32.545182+0000","last_became_active":"2024-09-13T16:49:32.121540+0000","last_became_peered":"2024-09-13T16:49:32.121540+0000","last_unstale":"2024-09-13T16:49:32.545182+0000","last_undegraded":"2024-09-13T16:49:32.545182+0000","last_fullsized":"2024-09-13T16:49:32.545182+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.577117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.109988+0000","last_change":"2024-09-13T16:49:28.107534+0000","last_active":"2024-09-13T16:49:32.109988+0000","last_peered":"2024-09-13T16:49:32.109988+0000","last_clean":"2024-09-13T16:49:32.109988+0000","last_became_active":"2024-09-13T16:49:28.107167+0000","last_became_peered":"2024-09-13T16:49:28.107167+0000","last_unstale":"2024-09-13T16:49:32.109988+0000","last_undegraded":"2024-09-13T16:49:32.109988+0000","last_fullsized":"2024-09-13T16:49:32.109988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:50.515291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.786009+0000","last_change":"2024-09-13T16:49:27.663125+0000","last_active":"2024-09-13T16:49:55.786009+0000","last_peered":"2024-09-13T16:49:55.786009+0000","last_clean":"2024-09-13T16:49:55.786009+0000","last_became_active":"2024-09-13T16:49:27.662822+0000","last_became_peered":"2024-09-13T16:49:27.662822+0000","last_unstale":"2024-09-13T16:49:55.786009+0000","last_undegraded":"2024-09-13T16:49:55.786009+0000","last_fullsized":"2024-09-13T16:49:55.786009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:42.841929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.122649+0000","last_change":"2024-09-13T16:49:32.121929+0000","last_active":"2024-09-13T16:49:32.122649+0000","last_peered":"2024-09-13T16:49:32.122649+0000","last_clean":"2024-09-13T16:49:32.122649+0000","last_became_active":"2024-09-13T16:49:32.121485+0000","last_became_peered":"2024-09-13T16:49:32.121485+0000","last_unstale":"2024-09-13T16:49:32.122649+0000","last_undegraded":"2024-09-13T16:49:32.122649+0000","last_fullsized":"2024-09-13T16:49:32.122649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:34.224064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.118321+0000","last_change":"2024-09-13T16:49:28.119746+0000","last_active":"2024-09-13T16:49:32.118321+0000","last_peered":"2024-09-13T16:49:32.118321+0000","last_clean":"2024-09-13T16:49:32.118321+0000","last_became_active":"2024-09-13T16:49:28.119463+0000","last_became_peered":"2024-09-13T16:49:28.119463+0000","last_unstale":"2024-09-13T16:49:32.118321+0000","last_undegraded":"2024-09-13T16:49:32.118321+0000","last_fullsized":"2024-09-13T16:49:32.118321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:17.092417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.785411+0000","last_change":"2024-09-13T16:49:27.651799+0000","last_active":"2024-09-13T16:49:55.785411+0000","last_peered":"2024-09-13T16:49:55.785411+0000","last_clean":"2024-09-13T16:49:55.785411+0000","last_became_active":"2024-09-13T16:49:27.651487+0000","last_became_peered":"2024-09-13T16:49:27.651487+0000","last_unstale":"2024-09-13T16:49:55.785411+0000","last_undegraded":"2024-09-13T16:49:55.785411+0000","last_fullsized":"2024-09-13T16:49:55.785411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:45.307448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.547001+0000","last_change":"2024-09-13T16:49:32.119333+0000","last_active":"2024-09-13T16:49:32.547001+0000","last_peered":"2024-09-13T16:49:32.547001+0000","last_clean":"2024-09-13T16:49:32.547001+0000","last_became_active":"2024-09-13T16:49:32.118997+0000","last_became_peered":"2024-09-13T16:49:32.118997+0000","last_unstale":"2024-09-13T16:49:32.547001+0000","last_undegraded":"2024-09-13T16:49:32.547001+0000","last_fullsized":"2024-09-13T16:49:32.547001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:15.731556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.119153+0000","last_change":"2024-09-13T16:49:28.114937+0000","last_active":"2024-09-13T16:49:32.119153+0000","last_peered":"2024-09-13T16:49:32.119153+0000","last_clean":"2024-09-13T16:49:32.119153+0000","last_became_active":"2024-09-13T16:49:28.112566+0000","last_became_peered":"2024-09-13T16:49:28.112566+0000","last_unstale":"2024-09-13T16:49:32.119153+0000","last_undegraded":"2024-09-13T16:49:32.119153+0000","last_fullsized":"2024-09-13T16:49:32.119153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:25.123922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.545235+0000","last_change":"2024-09-13T16:49:27.658786+0000","last_active":"2024-09-13T16:49:32.545235+0000","last_peered":"2024-09-13T16:49:32.545235+0000","last_clean":"2024-09-13T16:49:32.545235+0000","last_became_active":"2024-09-13T16:49:27.658308+0000","last_became_peered":"2024-09-13T16:49:27.658308+0000","last_unstale":"2024-09-13T16:49:32.545235+0000","last_undegraded":"2024-09-13T16:49:32.545235+0000","last_fullsized":"2024-09-13T16:49:32.545235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:29.994600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.075343+0000","last_change":"2024-09-13T16:49:32.130983+0000","last_active":"2024-09-13T16:49:33.075343+0000","last_peered":"2024-09-13T16:49:33.075343+0000","last_clean":"2024-09-13T16:49:33.075343+0000","last_became_active":"2024-09-13T16:49:32.130478+0000","last_became_peered":"2024-09-13T16:49:32.130478+0000","last_unstale":"2024-09-13T16:49:33.075343+0000","last_undegraded":"2024-09-13T16:49:33.075343+0000","last_fullsized":"2024-09-13T16:49:33.075343+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:07.147495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.121482+0000","last_change":"2024-09-13T16:49:28.100340+0000","last_active":"2024-09-13T16:49:32.121482+0000","last_peered":"2024-09-13T16:49:32.121482+0000","last_clean":"2024-09-13T16:49:32.121482+0000","last_became_active":"2024-09-13T16:49:28.099993+0000","last_became_peered":"2024-09-13T16:49:28.099993+0000","last_unstale":"2024-09-13T16:49:32.121482+0000","last_undegraded":"2024-09-13T16:49:32.121482+0000","last_fullsized":"2024-09-13T16:49:32.121482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:55.066929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.786419+0000","last_change":"2024-09-13T16:49:27.665296+0000","last_active":"2024-09-13T16:49:55.786419+0000","last_peered":"2024-09-13T16:49:55.786419+0000","last_clean":"2024-09-13T16:49:55.786419+0000","last_became_active":"2024-09-13T16:49:27.664953+0000","last_became_peered":"2024-09-13T16:49:27.664953+0000","last_unstale":"2024-09-13T16:49:55.786419+0000","last_undegraded":"2024-09-13T16:49:55.786419+0000","last_fullsized":"2024-09-13T16:49:55.786419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:52.001210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.462917+0000","last_change":"2024-09-13T16:49:32.129502+0000","last_active":"2024-09-13T16:49:33.462917+0000","last_peered":"2024-09-13T16:49:33.462917+0000","last_clean":"2024-09-13T16:49:33.462917+0000","last_became_active":"2024-09-13T16:49:32.128588+0000","last_became_peered":"2024-09-13T16:49:32.128588+0000","last_unstale":"2024-09-13T16:49:33.462917+0000","last_undegraded":"2024-09-13T16:49:33.462917+0000","last_fullsized":"2024-09-13T16:49:33.462917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:12.836040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106104+0000","last_change":"2024-09-13T16:49:28.107066+0000","last_active":"2024-09-13T16:49:32.106104+0000","last_peered":"2024-09-13T16:49:32.106104+0000","last_clean":"2024-09-13T16:49:32.106104+0000","last_became_active":"2024-09-13T16:49:28.106774+0000","last_became_peered":"2024-09-13T16:49:28.106774+0000","last_unstale":"2024-09-13T16:49:32.106104+0000","last_undegraded":"2024-09-13T16:49:32.106104+0000","last_fullsized":"2024-09-13T16:49:32.106104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:02.159079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.105443+0000","last_change":"2024-09-13T16:49:27.664742+0000","last_active":"2024-09-13T16:49:32.105443+0000","last_peered":"2024-09-13T16:49:32.105443+0000","last_clean":"2024-09-13T16:49:32.105443+0000","last_became_active":"2024-09-13T16:49:27.664206+0000","last_became_peered":"2024-09-13T16:49:27.664206+0000","last_unstale":"2024-09-13T16:49:32.105443+0000","last_undegraded":"2024-09-13T16:49:32.105443+0000","last_fullsized":"2024-09-13T16:49:32.105443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:29.255592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.075464+0000","last_change":"2024-09-13T16:49:32.123418+0000","last_active":"2024-09-13T16:49:33.075464+0000","last_peered":"2024-09-13T16:49:33.075464+0000","last_clean":"2024-09-13T16:49:33.075464+0000","last_became_active":"2024-09-13T16:49:32.123001+0000","last_became_peered":"2024-09-13T16:49:32.123001+0000","last_unstale":"2024-09-13T16:49:33.075464+0000","last_undegraded":"2024-09-13T16:49:33.075464+0000","last_fullsized":"2024-09-13T16:49:33.075464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:03.057538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106009+0000","last_change":"2024-09-13T16:49:28.102859+0000","last_active":"2024-09-13T16:49:32.106009+0000","last_peered":"2024-09-13T16:49:32.106009+0000","last_clean":"2024-09-13T16:49:32.106009+0000","last_became_active":"2024-09-13T16:49:28.102581+0000","last_became_peered":"2024-09-13T16:49:28.102581+0000","last_unstale":"2024-09-13T16:49:32.106009+0000","last_undegraded":"2024-09-13T16:49:32.106009+0000","last_fullsized":"2024-09-13T16:49:32.106009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:25.716170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.545973+0000","last_change":"2024-09-13T16:49:27.660427+0000","last_active":"2024-09-13T16:49:32.545973+0000","last_peered":"2024-09-13T16:49:32.545973+0000","last_clean":"2024-09-13T16:49:32.545973+0000","last_became_active":"2024-09-13T16:49:27.660124+0000","last_became_peered":"2024-09-13T16:49:27.660124+0000","last_unstale":"2024-09-13T16:49:32.545973+0000","last_undegraded":"2024-09-13T16:49:32.545973+0000","last_fullsized":"2024-09-13T16:49:32.545973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:13.437432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.812559+0000","last_change":"2024-09-13T16:49:32.134481+0000","last_active":"2024-09-13T16:49:32.812559+0000","last_peered":"2024-09-13T16:49:32.812559+0000","last_clean":"2024-09-13T16:49:32.812559+0000","last_became_active":"2024-09-13T16:49:32.132117+0000","last_became_peered":"2024-09-13T16:49:32.132117+0000","last_unstale":"2024-09-13T16:49:32.812559+0000","last_undegraded":"2024-09-13T16:49:32.812559+0000","last_fullsized":"2024-09-13T16:49:32.812559+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:06.386078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.113018+0000","last_change":"2024-09-13T16:49:28.102780+0000","last_active":"2024-09-13T16:49:32.113018+0000","last_peered":"2024-09-13T16:49:32.113018+0000","last_clean":"2024-09-13T16:49:32.113018+0000","last_became_active":"2024-09-13T16:49:28.102484+0000","last_became_peered":"2024-09-13T16:49:28.102484+0000","last_unstale":"2024-09-13T16:49:32.113018+0000","last_undegraded":"2024-09-13T16:49:32.113018+0000","last_fullsized":"2024-09-13T16:49:32.113018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:56.922183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.790957+0000","last_change":"2024-09-13T16:49:27.669744+0000","last_active":"2024-09-13T16:49:56.790957+0000","last_peered":"2024-09-13T16:49:56.790957+0000","last_clean":"2024-09-13T16:49:56.790957+0000","last_became_active":"2024-09-13T16:49:27.667816+0000","last_became_peered":"2024-09-13T16:49:27.667816+0000","last_unstale":"2024-09-13T16:49:56.790957+0000","last_undegraded":"2024-09-13T16:49:56.790957+0000","last_fullsized":"2024-09-13T16:49:56.790957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:36.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.812637+0000","last_change":"2024-09-13T16:49:32.137114+0000","last_active":"2024-09-13T16:49:32.812637+0000","last_peered":"2024-09-13T16:49:32.812637+0000","last_clean":"2024-09-13T16:49:32.812637+0000","last_became_active":"2024-09-13T16:49:32.136077+0000","last_became_peered":"2024-09-13T16:49:32.136077+0000","last_unstale":"2024-09-13T16:49:32.812637+0000","last_undegraded":"2024-09-13T16:49:32.812637+0000","last_fullsized":"2024-09-13T16:49:32.812637+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:59.902852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.119792+0000","last_change":"2024-09-13T16:49:28.098316+0000","last_active":"2024-09-13T16:49:32.119792+0000","last_peered":"2024-09-13T16:49:32.119792+0000","last_clean":"2024-09-13T16:49:32.119792+0000","last_became_active":"2024-09-13T16:49:28.097410+0000","last_became_peered":"2024-09-13T16:49:28.097410+0000","last_unstale":"2024-09-13T16:49:32.119792+0000","last_undegraded":"2024-09-13T16:49:32.119792+0000","last_fullsized":"2024-09-13T16:49:32.119792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:37.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.786927+0000","last_change":"2024-09-13T16:49:27.648000+0000","last_active":"2024-09-13T16:49:56.786927+0000","last_peered":"2024-09-13T16:49:56.786927+0000","last_clean":"2024-09-13T16:49:56.786927+0000","last_became_active":"2024-09-13T16:49:27.647639+0000","last_became_peered":"2024-09-13T16:49:27.647639+0000","last_unstale":"2024-09-13T16:49:56.786927+0000","last_undegraded":"2024-09-13T16:49:56.786927+0000","last_fullsized":"2024-09-13T16:49:56.786927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:28.941060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.929984+0000","last_change":"2024-09-13T16:49:32.132868+0000","last_active":"2024-09-13T16:49:32.929984+0000","last_peered":"2024-09-13T16:49:32.929984+0000","last_clean":"2024-09-13T16:49:32.929984+0000","last_became_active":"2024-09-13T16:49:32.132562+0000","last_became_peered":"2024-09-13T16:49:32.132562+0000","last_unstale":"2024-09-13T16:49:32.929984+0000","last_undegraded":"2024-09-13T16:49:32.929984+0000","last_fullsized":"2024-09-13T16:49:32.929984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:31.365339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112376+0000","last_change":"2024-09-13T16:49:28.107483+0000","last_active":"2024-09-13T16:49:32.112376+0000","last_peered":"2024-09-13T16:49:32.112376+0000","last_clean":"2024-09-13T16:49:32.112376+0000","last_became_active":"2024-09-13T16:49:28.107111+0000","last_became_peered":"2024-09-13T16:49:28.107111+0000","last_unstale":"2024-09-13T16:49:32.112376+0000","last_undegraded":"2024-09-13T16:49:32.112376+0000","last_fullsized":"2024-09-13T16:49:32.112376+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:56.987970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.786994+0000","last_change":"2024-09-13T16:49:27.646872+0000","last_active":"2024-09-13T16:49:55.786994+0000","last_peered":"2024-09-13T16:49:55.786994+0000","last_clean":"2024-09-13T16:49:55.786994+0000","last_became_active":"2024-09-13T16:49:27.646523+0000","last_became_peered":"2024-09-13T16:49:27.646523+0000","last_unstale":"2024-09-13T16:49:55.786994+0000","last_undegraded":"2024-09-13T16:49:55.786994+0000","last_fullsized":"2024-09-13T16:49:55.786994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.384393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":331,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110998+0000","last_change":"2024-09-13T16:48:12.777004+0000","last_active":"2024-09-13T16:49:32.110998+0000","last_peered":"2024-09-13T16:49:32.110998+0000","last_clean":"2024-09-13T16:49:32.110998+0000","last_became_active":"2024-09-13T16:48:12.776499+0000","last_became_peered":"2024-09-13T16:48:12.776499+0000","last_unstale":"2024-09-13T16:49:32.110998+0000","last_undegraded":"2024-09-13T16:49:32.110998+0000","last_fullsized":"2024-09-13T16:49:32.110998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:44:44.393091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:44:44.393091+0000","last_clean_scrub_stamp":"2024-09-13T16:44:44.393091+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:38.427421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.120516+0000","last_change":"2024-09-13T16:49:32.119501+0000","last_active":"2024-09-13T16:49:32.120516+0000","last_peered":"2024-09-13T16:49:32.120516+0000","last_clean":"2024-09-13T16:49:32.120516+0000","last_became_active":"2024-09-13T16:49:32.118856+0000","last_became_peered":"2024-09-13T16:49:32.118856+0000","last_unstale":"2024-09-13T16:49:32.120516+0000","last_undegraded":"2024-09-13T16:49:32.120516+0000","last_fullsized":"2024-09-13T16:49:32.120516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:13.078311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112616+0000","last_change":"2024-09-13T16:49:28.106290+0000","last_active":"2024-09-13T16:49:32.112616+0000","last_peered":"2024-09-13T16:49:32.112616+0000","last_clean":"2024-09-13T16:49:32.112616+0000","last_became_active":"2024-09-13T16:49:28.105608+0000","last_became_peered":"2024-09-13T16:49:28.105608+0000","last_unstale":"2024-09-13T16:49:32.112616+0000","last_undegraded":"2024-09-13T16:49:32.112616+0000","last_fullsized":"2024-09-13T16:49:32.112616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:57.711931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.789234+0000","last_change":"2024-09-13T16:49:27.667242+0000","last_active":"2024-09-13T16:49:56.789234+0000","last_peered":"2024-09-13T16:49:56.789234+0000","last_clean":"2024-09-13T16:49:56.789234+0000","last_became_active":"2024-09-13T16:49:27.666939+0000","last_became_peered":"2024-09-13T16:49:27.666939+0000","last_unstale":"2024-09-13T16:49:56.789234+0000","last_undegraded":"2024-09-13T16:49:56.789234+0000","last_fullsized":"2024-09-13T16:49:56.789234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:10.558691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.129611+0000","last_change":"2024-09-13T16:49:32.128832+0000","last_active":"2024-09-13T16:49:32.129611+0000","last_peered":"2024-09-13T16:49:32.129611+0000","last_clean":"2024-09-13T16:49:32.129611+0000","last_became_active":"2024-09-13T16:49:32.128369+0000","last_became_peered":"2024-09-13T16:49:32.128369+0000","last_unstale":"2024-09-13T16:49:32.129611+0000","last_undegraded":"2024-09-13T16:49:32.129611+0000","last_fullsized":"2024-09-13T16:49:32.129611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:26.756858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112314+0000","last_change":"2024-09-13T16:49:28.115686+0000","last_active":"2024-09-13T16:49:32.112314+0000","last_peered":"2024-09-13T16:49:32.112314+0000","last_clean":"2024-09-13T16:49:32.112314+0000","last_became_active":"2024-09-13T16:49:28.115439+0000","last_became_peered":"2024-09-13T16:49:28.115439+0000","last_unstale":"2024-09-13T16:49:32.112314+0000","last_undegraded":"2024-09-13T16:49:32.112314+0000","last_fullsized":"2024-09-13T16:49:32.112314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:03.134657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.088882+0000","last_change":"2024-09-13T16:49:27.653794+0000","last_active":"2024-09-13T16:49:33.088882+0000","last_peered":"2024-09-13T16:49:33.088882+0000","last_clean":"2024-09-13T16:49:33.088882+0000","last_became_active":"2024-09-13T16:49:27.653483+0000","last_became_peered":"2024-09-13T16:49:27.653483+0000","last_unstale":"2024-09-13T16:49:33.088882+0000","last_undegraded":"2024-09-13T16:49:33.088882+0000","last_fullsized":"2024-09-13T16:49:33.088882+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:49.488599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.602484+0000","last_change":"2024-09-13T16:49:32.124277+0000","last_active":"2024-09-13T16:49:32.602484+0000","last_peered":"2024-09-13T16:49:32.602484+0000","last_clean":"2024-09-13T16:49:32.602484+0000","last_became_active":"2024-09-13T16:49:32.123858+0000","last_became_peered":"2024-09-13T16:49:32.123858+0000","last_unstale":"2024-09-13T16:49:32.602484+0000","last_undegraded":"2024-09-13T16:49:32.602484+0000","last_fullsized":"2024-09-13T16:49:32.602484+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:40.965149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112565+0000","last_change":"2024-09-13T16:49:28.107349+0000","last_active":"2024-09-13T16:49:32.112565+0000","last_peered":"2024-09-13T16:49:32.112565+0000","last_clean":"2024-09-13T16:49:32.112565+0000","last_became_active":"2024-09-13T16:49:28.107048+0000","last_became_peered":"2024-09-13T16:49:28.107048+0000","last_unstale":"2024-09-13T16:49:32.112565+0000","last_undegraded":"2024-09-13T16:49:32.112565+0000","last_fullsized":"2024-09-13T16:49:32.112565+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:00.188460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.122868+0000","last_change":"2024-09-13T16:49:27.662761+0000","last_active":"2024-09-13T16:49:32.122868+0000","last_peered":"2024-09-13T16:49:32.122868+0000","last_clean":"2024-09-13T16:49:32.122868+0000","last_became_active":"2024-09-13T16:49:27.662452+0000","last_became_peered":"2024-09-13T16:49:27.662452+0000","last_unstale":"2024-09-13T16:49:32.122868+0000","last_undegraded":"2024-09-13T16:49:32.122868+0000","last_fullsized":"2024-09-13T16:49:32.122868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:51:10.175720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.929855+0000","last_change":"2024-09-13T16:49:32.118043+0000","last_active":"2024-09-13T16:49:32.929855+0000","last_peered":"2024-09-13T16:49:32.929855+0000","last_clean":"2024-09-13T16:49:32.929855+0000","last_became_active":"2024-09-13T16:49:32.117423+0000","last_became_peered":"2024-09-13T16:49:32.117423+0000","last_unstale":"2024-09-13T16:49:32.929855+0000","last_undegraded":"2024-09-13T16:49:32.929855+0000","last_fullsized":"2024-09-13T16:49:32.929855+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:13.791606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.107358+0000","last_change":"2024-09-13T16:49:28.104554+0000","last_active":"2024-09-13T16:49:32.107358+0000","last_peered":"2024-09-13T16:49:32.107358+0000","last_clean":"2024-09-13T16:49:32.107358+0000","last_became_active":"2024-09-13T16:49:28.104158+0000","last_became_peered":"2024-09-13T16:49:28.104158+0000","last_unstale":"2024-09-13T16:49:32.107358+0000","last_undegraded":"2024-09-13T16:49:32.107358+0000","last_fullsized":"2024-09-13T16:49:32.107358+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:08.723966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.075961+0000","last_change":"2024-09-13T16:49:27.648946+0000","last_active":"2024-09-13T16:49:33.075961+0000","last_peered":"2024-09-13T16:49:33.075961+0000","last_clean":"2024-09-13T16:49:33.075961+0000","last_became_active":"2024-09-13T16:49:27.648583+0000","last_became_peered":"2024-09-13T16:49:27.648583+0000","last_unstale":"2024-09-13T16:49:33.075961+0000","last_undegraded":"2024-09-13T16:49:33.075961+0000","last_fullsized":"2024-09-13T16:49:33.075961+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:00.529291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.929905+0000","last_change":"2024-09-13T16:49:32.123998+0000","last_active":"2024-09-13T16:49:32.929905+0000","last_peered":"2024-09-13T16:49:32.929905+0000","last_clean":"2024-09-13T16:49:32.929905+0000","last_became_active":"2024-09-13T16:49:32.123619+0000","last_became_peered":"2024-09-13T16:49:32.123619+0000","last_unstale":"2024-09-13T16:49:32.929905+0000","last_undegraded":"2024-09-13T16:49:32.929905+0000","last_fullsized":"2024-09-13T16:49:32.929905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:32.271957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.114770+0000","last_change":"2024-09-13T16:49:28.101110+0000","last_active":"2024-09-13T16:49:32.114770+0000","last_peered":"2024-09-13T16:49:32.114770+0000","last_clean":"2024-09-13T16:49:32.114770+0000","last_became_active":"2024-09-13T16:49:28.099342+0000","last_became_peered":"2024-09-13T16:49:28.099342+0000","last_unstale":"2024-09-13T16:49:32.114770+0000","last_undegraded":"2024-09-13T16:49:32.114770+0000","last_fullsized":"2024-09-13T16:49:32.114770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:44.331289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.789440+0000","last_change":"2024-09-13T16:49:27.665186+0000","last_active":"2024-09-13T16:49:56.789440+0000","last_peered":"2024-09-13T16:49:56.789440+0000","last_clean":"2024-09-13T16:49:56.789440+0000","last_became_active":"2024-09-13T16:49:27.664889+0000","last_became_peered":"2024-09-13T16:49:27.664889+0000","last_unstale":"2024-09-13T16:49:56.789440+0000","last_undegraded":"2024-09-13T16:49:56.789440+0000","last_fullsized":"2024-09-13T16:49:56.789440+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:51.762337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.812606+0000","last_change":"2024-09-13T16:49:32.135613+0000","last_active":"2024-09-13T16:49:32.812606+0000","last_peered":"2024-09-13T16:49:32.812606+0000","last_clean":"2024-09-13T16:49:32.812606+0000","last_became_active":"2024-09-13T16:49:32.134372+0000","last_became_peered":"2024-09-13T16:49:32.134372+0000","last_unstale":"2024-09-13T16:49:32.812606+0000","last_undegraded":"2024-09-13T16:49:32.812606+0000","last_fullsized":"2024-09-13T16:49:32.812606+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:47.797113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110807+0000","last_change":"2024-09-13T16:49:28.103828+0000","last_active":"2024-09-13T16:49:32.110807+0000","last_peered":"2024-09-13T16:49:32.110807+0000","last_clean":"2024-09-13T16:49:32.110807+0000","last_became_active":"2024-09-13T16:49:28.103526+0000","last_became_peered":"2024-09-13T16:49:28.103526+0000","last_unstale":"2024-09-13T16:49:32.110807+0000","last_undegraded":"2024-09-13T16:49:32.110807+0000","last_fullsized":"2024-09-13T16:49:32.110807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:21.612371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.114521+0000","last_change":"2024-09-13T16:49:27.643734+0000","last_active":"2024-09-13T16:49:32.114521+0000","last_peered":"2024-09-13T16:49:32.114521+0000","last_clean":"2024-09-13T16:49:32.114521+0000","last_became_active":"2024-09-13T16:49:27.643129+0000","last_became_peered":"2024-09-13T16:49:27.643129+0000","last_unstale":"2024-09-13T16:49:32.114521+0000","last_undegraded":"2024-09-13T16:49:32.114521+0000","last_fullsized":"2024-09-13T16:49:32.114521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:01.756293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.545214+0000","last_change":"2024-09-13T16:49:32.132105+0000","last_active":"2024-09-13T16:49:32.545214+0000","last_peered":"2024-09-13T16:49:32.545214+0000","last_clean":"2024-09-13T16:49:32.545214+0000","last_became_active":"2024-09-13T16:49:32.131379+0000","last_became_peered":"2024-09-13T16:49:32.131379+0000","last_unstale":"2024-09-13T16:49:32.545214+0000","last_undegraded":"2024-09-13T16:49:32.545214+0000","last_fullsized":"2024-09-13T16:49:32.545214+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:09.215195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111818+0000","last_change":"2024-09-13T16:49:28.099072+0000","last_active":"2024-09-13T16:49:32.111818+0000","last_peered":"2024-09-13T16:49:32.111818+0000","last_clean":"2024-09-13T16:49:32.111818+0000","last_became_active":"2024-09-13T16:49:28.098797+0000","last_became_peered":"2024-09-13T16:49:28.098797+0000","last_unstale":"2024-09-13T16:49:32.111818+0000","last_undegraded":"2024-09-13T16:49:32.111818+0000","last_fullsized":"2024-09-13T16:49:32.111818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:36.997019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.787902+0000","last_change":"2024-09-13T16:49:27.653581+0000","last_active":"2024-09-13T16:49:55.787902+0000","last_peered":"2024-09-13T16:49:55.787902+0000","last_clean":"2024-09-13T16:49:55.787902+0000","last_became_active":"2024-09-13T16:49:27.653245+0000","last_became_peered":"2024-09-13T16:49:27.653245+0000","last_unstale":"2024-09-13T16:49:55.787902+0000","last_undegraded":"2024-09-13T16:49:55.787902+0000","last_fullsized":"2024-09-13T16:49:55.787902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:47.639020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.462959+0000","last_change":"2024-09-13T16:49:32.128569+0000","last_active":"2024-09-13T16:49:33.462959+0000","last_peered":"2024-09-13T16:49:33.462959+0000","last_clean":"2024-09-13T16:49:33.462959+0000","last_became_active":"2024-09-13T16:49:32.128180+0000","last_became_peered":"2024-09-13T16:49:32.128180+0000","last_unstale":"2024-09-13T16:49:33.462959+0000","last_undegraded":"2024-09-13T16:49:33.462959+0000","last_fullsized":"2024-09-13T16:49:33.462959+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.887518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.121087+0000","last_change":"2024-09-13T16:49:28.111923+0000","last_active":"2024-09-13T16:49:32.121087+0000","last_peered":"2024-09-13T16:49:32.121087+0000","last_clean":"2024-09-13T16:49:32.121087+0000","last_became_active":"2024-09-13T16:49:28.108483+0000","last_became_peered":"2024-09-13T16:49:28.108483+0000","last_unstale":"2024-09-13T16:49:32.121087+0000","last_undegraded":"2024-09-13T16:49:32.121087+0000","last_fullsized":"2024-09-13T16:49:32.121087+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:11.921967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.789733+0000","last_change":"2024-09-13T16:49:27.653823+0000","last_active":"2024-09-13T16:49:56.789733+0000","last_peered":"2024-09-13T16:49:56.789733+0000","last_clean":"2024-09-13T16:49:56.789733+0000","last_became_active":"2024-09-13T16:49:27.653389+0000","last_became_peered":"2024-09-13T16:49:27.653389+0000","last_unstale":"2024-09-13T16:49:56.789733+0000","last_undegraded":"2024-09-13T16:49:56.789733+0000","last_fullsized":"2024-09-13T16:49:56.789733+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:32.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.929951+0000","last_change":"2024-09-13T16:49:32.128133+0000","last_active":"2024-09-13T16:49:32.929951+0000","last_peered":"2024-09-13T16:49:32.929951+0000","last_clean":"2024-09-13T16:49:32.929951+0000","last_became_active":"2024-09-13T16:49:32.127641+0000","last_became_peered":"2024-09-13T16:49:32.127641+0000","last_unstale":"2024-09-13T16:49:32.929951+0000","last_undegraded":"2024-09-13T16:49:32.929951+0000","last_fullsized":"2024-09-13T16:49:32.929951+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:18.349527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110796+0000","last_change":"2024-09-13T16:49:28.106264+0000","last_active":"2024-09-13T16:49:32.110796+0000","last_peered":"2024-09-13T16:49:32.110796+0000","last_clean":"2024-09-13T16:49:32.110796+0000","last_became_active":"2024-09-13T16:49:28.105901+0000","last_became_peered":"2024-09-13T16:49:28.105901+0000","last_unstale":"2024-09-13T16:49:32.110796+0000","last_undegraded":"2024-09-13T16:49:32.110796+0000","last_fullsized":"2024-09-13T16:49:32.110796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:46.516128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'10","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:47.191184+0000","last_change":"2024-09-13T16:49:27.648481+0000","last_active":"2024-09-13T16:49:47.191184+0000","last_peered":"2024-09-13T16:49:47.191184+0000","last_clean":"2024-09-13T16:49:47.191184+0000","last_became_active":"2024-09-13T16:49:27.648168+0000","last_became_peered":"2024-09-13T16:49:27.648168+0000","last_unstale":"2024-09-13T16:49:47.191184+0000","last_undegraded":"2024-09-13T16:49:47.191184+0000","last_fullsized":"2024-09-13T16:49:47.191184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:33.556456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.544708+0000","last_change":"2024-09-13T16:49:32.122333+0000","last_active":"2024-09-13T16:49:32.544708+0000","last_peered":"2024-09-13T16:49:32.544708+0000","last_clean":"2024-09-13T16:49:32.544708+0000","last_became_active":"2024-09-13T16:49:32.120843+0000","last_became_peered":"2024-09-13T16:49:32.120843+0000","last_unstale":"2024-09-13T16:49:32.544708+0000","last_undegraded":"2024-09-13T16:49:32.544708+0000","last_fullsized":"2024-09-13T16:49:32.544708+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:37.789336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.109972+0000","last_change":"2024-09-13T16:49:28.102549+0000","last_active":"2024-09-13T16:49:32.109972+0000","last_peered":"2024-09-13T16:49:32.109972+0000","last_clean":"2024-09-13T16:49:32.109972+0000","last_became_active":"2024-09-13T16:49:28.102109+0000","last_became_peered":"2024-09-13T16:49:28.102109+0000","last_unstale":"2024-09-13T16:49:32.109972+0000","last_undegraded":"2024-09-13T16:49:32.109972+0000","last_fullsized":"2024-09-13T16:49:32.109972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:04.410795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.784878+0000","last_change":"2024-09-13T16:49:27.663189+0000","last_active":"2024-09-13T16:49:55.784878+0000","last_peered":"2024-09-13T16:49:55.784878+0000","last_clean":"2024-09-13T16:49:55.784878+0000","last_became_active":"2024-09-13T16:49:27.662852+0000","last_became_peered":"2024-09-13T16:49:27.662852+0000","last_unstale":"2024-09-13T16:49:55.784878+0000","last_undegraded":"2024-09-13T16:49:55.784878+0000","last_fullsized":"2024-09-13T16:49:55.784878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:32.862451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.123054+0000","last_change":"2024-09-13T16:49:32.122394+0000","last_active":"2024-09-13T16:49:32.123054+0000","last_peered":"2024-09-13T16:49:32.123054+0000","last_clean":"2024-09-13T16:49:32.123054+0000","last_became_active":"2024-09-13T16:49:32.121710+0000","last_became_peered":"2024-09-13T16:49:32.121710+0000","last_unstale":"2024-09-13T16:49:32.123054+0000","last_undegraded":"2024-09-13T16:49:32.123054+0000","last_fullsized":"2024-09-13T16:49:32.123054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:28.057105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115366+0000","last_change":"2024-09-13T16:49:28.112762+0000","last_active":"2024-09-13T16:49:32.115366+0000","last_peered":"2024-09-13T16:49:32.115366+0000","last_clean":"2024-09-13T16:49:32.115366+0000","last_became_active":"2024-09-13T16:49:28.111865+0000","last_became_peered":"2024-09-13T16:49:28.111865+0000","last_unstale":"2024-09-13T16:49:32.115366+0000","last_undegraded":"2024-09-13T16:49:32.115366+0000","last_fullsized":"2024-09-13T16:49:32.115366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:36.633413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:55.786381+0000","last_change":"2024-09-13T16:49:27.647952+0000","last_active":"2024-09-13T16:49:55.786381+0000","last_peered":"2024-09-13T16:49:55.786381+0000","last_clean":"2024-09-13T16:49:55.786381+0000","last_became_active":"2024-09-13T16:49:27.647460+0000","last_became_peered":"2024-09-13T16:49:27.647460+0000","last_unstale":"2024-09-13T16:49:55.786381+0000","last_undegraded":"2024-09-13T16:49:55.786381+0000","last_fullsized":"2024-09-13T16:49:55.786381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:12.836511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.544599+0000","last_change":"2024-09-13T16:49:32.127330+0000","last_active":"2024-09-13T16:49:32.544599+0000","last_peered":"2024-09-13T16:49:32.544599+0000","last_clean":"2024-09-13T16:49:32.544599+0000","last_became_active":"2024-09-13T16:49:32.126026+0000","last_became_peered":"2024-09-13T16:49:32.126026+0000","last_unstale":"2024-09-13T16:49:32.544599+0000","last_undegraded":"2024-09-13T16:49:32.544599+0000","last_fullsized":"2024-09-13T16:49:32.544599+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:05.347991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110499+0000","last_change":"2024-09-13T16:49:28.102721+0000","last_active":"2024-09-13T16:49:32.110499+0000","last_peered":"2024-09-13T16:49:32.110499+0000","last_clean":"2024-09-13T16:49:32.110499+0000","last_became_active":"2024-09-13T16:49:28.102431+0000","last_became_peered":"2024-09-13T16:49:28.102431+0000","last_unstale":"2024-09-13T16:49:32.110499+0000","last_undegraded":"2024-09-13T16:49:32.110499+0000","last_fullsized":"2024-09-13T16:49:32.110499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:38.921527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106164+0000","last_change":"2024-09-13T16:49:27.653616+0000","last_active":"2024-09-13T16:49:32.106164+0000","last_peered":"2024-09-13T16:49:32.106164+0000","last_clean":"2024-09-13T16:49:32.106164+0000","last_became_active":"2024-09-13T16:49:27.653312+0000","last_became_peered":"2024-09-13T16:49:27.653312+0000","last_unstale":"2024-09-13T16:49:32.106164+0000","last_undegraded":"2024-09-13T16:49:32.106164+0000","last_fullsized":"2024-09-13T16:49:32.106164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:37.536821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.075503+0000","last_change":"2024-09-13T16:49:32.121500+0000","last_active":"2024-09-13T16:49:33.075503+0000","last_peered":"2024-09-13T16:49:33.075503+0000","last_clean":"2024-09-13T16:49:33.075503+0000","last_became_active":"2024-09-13T16:49:32.120434+0000","last_became_peered":"2024-09-13T16:49:32.120434+0000","last_unstale":"2024-09-13T16:49:33.075503+0000","last_undegraded":"2024-09-13T16:49:33.075503+0000","last_fullsized":"2024-09-13T16:49:33.075503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:14.832079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.602366+0000","last_change":"2024-09-13T16:49:32.129276+0000","last_active":"2024-09-13T16:49:32.602366+0000","last_peered":"2024-09-13T16:49:32.602366+0000","last_clean":"2024-09-13T16:49:32.602366+0000","last_became_active":"2024-09-13T16:49:32.128351+0000","last_became_peered":"2024-09-13T16:49:32.128351+0000","last_unstale":"2024-09-13T16:49:32.602366+0000","last_undegraded":"2024-09-13T16:49:32.602366+0000","last_fullsized":"2024-09-13T16:49:32.602366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:30.287034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.105256+0000","last_change":"2024-09-13T16:49:28.105330+0000","last_active":"2024-09-13T16:49:32.105256+0000","last_peered":"2024-09-13T16:49:32.105256+0000","last_clean":"2024-09-13T16:49:32.105256+0000","last_became_active":"2024-09-13T16:49:28.105048+0000","last_became_peered":"2024-09-13T16:49:28.105048+0000","last_unstale":"2024-09-13T16:49:32.105256+0000","last_undegraded":"2024-09-13T16:49:32.105256+0000","last_fullsized":"2024-09-13T16:49:32.105256+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:50.302087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.088795+0000","last_change":"2024-09-13T16:49:27.645811+0000","last_active":"2024-09-13T16:49:33.088795+0000","last_peered":"2024-09-13T16:49:33.088795+0000","last_clean":"2024-09-13T16:49:33.088795+0000","last_became_active":"2024-09-13T16:49:27.645239+0000","last_became_peered":"2024-09-13T16:49:27.645239+0000","last_unstale":"2024-09-13T16:49:33.088795+0000","last_undegraded":"2024-09-13T16:49:33.088795+0000","last_fullsized":"2024-09-13T16:49:33.088795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:14.960763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:33.463236+0000","last_change":"2024-09-13T16:49:32.129619+0000","last_active":"2024-09-13T16:49:33.463236+0000","last_peered":"2024-09-13T16:49:33.463236+0000","last_clean":"2024-09-13T16:49:33.463236+0000","last_became_active":"2024-09-13T16:49:32.128897+0000","last_became_peered":"2024-09-13T16:49:32.128897+0000","last_unstale":"2024-09-13T16:49:33.463236+0000","last_undegraded":"2024-09-13T16:49:33.463236+0000","last_fullsized":"2024-09-13T16:49:33.463236+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:47.343520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.116636+0000","last_change":"2024-09-13T16:49:28.100409+0000","last_active":"2024-09-13T16:49:32.116636+0000","last_peered":"2024-09-13T16:49:32.116636+0000","last_clean":"2024-09-13T16:49:32.116636+0000","last_became_active":"2024-09-13T16:49:28.096557+0000","last_became_peered":"2024-09-13T16:49:28.096557+0000","last_unstale":"2024-09-13T16:49:32.116636+0000","last_undegraded":"2024-09-13T16:49:32.116636+0000","last_fullsized":"2024-09-13T16:49:32.116636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:06.959079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:56.790720+0000","last_change":"2024-09-13T16:49:27.658366+0000","last_active":"2024-09-13T16:49:56.790720+0000","last_peered":"2024-09-13T16:49:56.790720+0000","last_clean":"2024-09-13T16:49:56.790720+0000","last_became_active":"2024-09-13T16:49:27.657907+0000","last_became_peered":"2024-09-13T16:49:27.657907+0000","last_unstale":"2024-09-13T16:49:56.790720+0000","last_undegraded":"2024-09-13T16:49:56.790720+0000","last_fullsized":"2024-09-13T16:49:56.790720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:11.493555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.105873+0000","last_change":"2024-09-13T16:49:27.656786+0000","last_active":"2024-09-13T16:49:32.105873+0000","last_peered":"2024-09-13T16:49:32.105873+0000","last_clean":"2024-09-13T16:49:32.105873+0000","last_became_active":"2024-09-13T16:49:27.656508+0000","last_became_peered":"2024-09-13T16:49:27.656508+0000","last_unstale":"2024-09-13T16:49:32.105873+0000","last_undegraded":"2024-09-13T16:49:32.105873+0000","last_fullsized":"2024-09-13T16:49:32.105873+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:22.867530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.114259+0000","last_change":"2024-09-13T16:49:28.109232+0000","last_active":"2024-09-13T16:49:32.114259+0000","last_peered":"2024-09-13T16:49:32.114259+0000","last_clean":"2024-09-13T16:49:32.114259+0000","last_became_active":"2024-09-13T16:49:28.108905+0000","last_became_peered":"2024-09-13T16:49:28.108905+0000","last_unstale":"2024-09-13T16:49:32.114259+0000","last_undegraded":"2024-09-13T16:49:32.114259+0000","last_fullsized":"2024-09-13T16:49:32.114259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:57.695383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.547250+0000","last_change":"2024-09-13T16:49:32.128808+0000","last_active":"2024-09-13T16:49:32.547250+0000","last_peered":"2024-09-13T16:49:32.547250+0000","last_clean":"2024-09-13T16:49:32.547250+0000","last_became_active":"2024-09-13T16:49:32.128333+0000","last_became_peered":"2024-09-13T16:49:32.128333+0000","last_unstale":"2024-09-13T16:49:32.547250+0000","last_undegraded":"2024-09-13T16:49:32.547250+0000","last_fullsized":"2024-09-13T16:49:32.547250+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:03.484456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:57.800787+0000","last_change":"2024-09-13T16:49:27.648863+0000","last_active":"2024-09-13T16:49:57.800787+0000","last_peered":"2024-09-13T16:49:57.800787+0000","last_clean":"2024-09-13T16:49:57.800787+0000","last_became_active":"2024-09-13T16:49:27.648572+0000","last_became_peered":"2024-09-13T16:49:27.648572+0000","last_unstale":"2024-09-13T16:49:57.800787+0000","last_undegraded":"2024-09-13T16:49:57.800787+0000","last_fullsized":"2024-09-13T16:49:57.800787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112267+0000","last_change":"2024-09-13T16:49:28.114013+0000","last_active":"2024-09-13T16:49:32.112267+0000","last_peered":"2024-09-13T16:49:32.112267+0000","last_clean":"2024-09-13T16:49:32.112267+0000","last_became_active":"2024-09-13T16:49:28.113722+0000","last_became_peered":"2024-09-13T16:49:28.113722+0000","last_unstale":"2024-09-13T16:49:32.112267+0000","last_undegraded":"2024-09-13T16:49:32.112267+0000","last_fullsized":"2024-09-13T16:49:32.112267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:42.560038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.547370+0000","last_change":"2024-09-13T16:49:32.118308+0000","last_active":"2024-09-13T16:49:32.547370+0000","last_peered":"2024-09-13T16:49:32.547370+0000","last_clean":"2024-09-13T16:49:32.547370+0000","last_became_active":"2024-09-13T16:49:32.117963+0000","last_became_peered":"2024-09-13T16:49:32.117963+0000","last_unstale":"2024-09-13T16:49:32.547370+0000","last_undegraded":"2024-09-13T16:49:32.547370+0000","last_fullsized":"2024-09-13T16:49:32.547370+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:26.939494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106638+0000","last_change":"2024-09-13T16:49:28.102325+0000","last_active":"2024-09-13T16:49:32.106638+0000","last_peered":"2024-09-13T16:49:32.106638+0000","last_clean":"2024-09-13T16:49:32.106638+0000","last_became_active":"2024-09-13T16:49:28.102007+0000","last_became_peered":"2024-09-13T16:49:28.102007+0000","last_unstale":"2024-09-13T16:49:32.106638+0000","last_undegraded":"2024-09-13T16:49:32.106638+0000","last_fullsized":"2024-09-13T16:49:32.106638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:10.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.114331+0000","last_change":"2024-09-13T16:49:28.102964+0000","last_active":"2024-09-13T16:49:32.114331+0000","last_peered":"2024-09-13T16:49:32.114331+0000","last_clean":"2024-09-13T16:49:32.114331+0000","last_became_active":"2024-09-13T16:49:28.102678+0000","last_became_peered":"2024-09-13T16:49:28.102678+0000","last_unstale":"2024-09-13T16:49:32.114331+0000","last_undegraded":"2024-09-13T16:49:32.114331+0000","last_fullsized":"2024-09-13T16:49:32.114331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.255219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110863+0000","last_change":"2024-09-13T16:49:28.117353+0000","last_active":"2024-09-13T16:49:32.110863+0000","last_peered":"2024-09-13T16:49:32.110863+0000","last_clean":"2024-09-13T16:49:32.110863+0000","last_became_active":"2024-09-13T16:49:28.117020+0000","last_became_peered":"2024-09-13T16:49:28.117020+0000","last_unstale":"2024-09-13T16:49:32.110863+0000","last_undegraded":"2024-09-13T16:49:32.110863+0000","last_fullsized":"2024-09-13T16:49:32.110863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:46.896795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115486+0000","last_change":"2024-09-13T16:49:28.112090+0000","last_active":"2024-09-13T16:49:32.115486+0000","last_peered":"2024-09-13T16:49:32.115486+0000","last_clean":"2024-09-13T16:49:32.115486+0000","last_became_active":"2024-09-13T16:49:28.111793+0000","last_became_peered":"2024-09-13T16:49:28.111793+0000","last_unstale":"2024-09-13T16:49:32.115486+0000","last_undegraded":"2024-09-13T16:49:32.115486+0000","last_fullsized":"2024-09-13T16:49:32.115486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:45.462344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.121379+0000","last_change":"2024-09-13T16:49:28.105186+0000","last_active":"2024-09-13T16:49:32.121379+0000","last_peered":"2024-09-13T16:49:32.121379+0000","last_clean":"2024-09-13T16:49:32.121379+0000","last_became_active":"2024-09-13T16:49:28.104827+0000","last_became_peered":"2024-09-13T16:49:28.104827+0000","last_unstale":"2024-09-13T16:49:32.121379+0000","last_undegraded":"2024-09-13T16:49:32.121379+0000","last_fullsized":"2024-09-13T16:49:32.121379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:07.872650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.107517+0000","last_change":"2024-09-13T16:49:28.105694+0000","last_active":"2024-09-13T16:49:32.107517+0000","last_peered":"2024-09-13T16:49:32.107517+0000","last_clean":"2024-09-13T16:49:32.107517+0000","last_became_active":"2024-09-13T16:49:28.105319+0000","last_became_peered":"2024-09-13T16:49:28.105319+0000","last_unstale":"2024-09-13T16:49:32.107517+0000","last_undegraded":"2024-09-13T16:49:32.107517+0000","last_fullsized":"2024-09-13T16:49:32.107517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:14.749198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112644+0000","last_change":"2024-09-13T16:49:28.101008+0000","last_active":"2024-09-13T16:49:32.112644+0000","last_peered":"2024-09-13T16:49:32.112644+0000","last_clean":"2024-09-13T16:49:32.112644+0000","last_became_active":"2024-09-13T16:49:28.100075+0000","last_became_peered":"2024-09-13T16:49:28.100075+0000","last_unstale":"2024-09-13T16:49:32.112644+0000","last_undegraded":"2024-09-13T16:49:32.112644+0000","last_fullsized":"2024-09-13T16:49:32.112644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:01.890674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.119062+0000","last_change":"2024-09-13T16:49:28.108283+0000","last_active":"2024-09-13T16:49:32.119062+0000","last_peered":"2024-09-13T16:49:32.119062+0000","last_clean":"2024-09-13T16:49:32.119062+0000","last_became_active":"2024-09-13T16:49:28.107916+0000","last_became_peered":"2024-09-13T16:49:28.107916+0000","last_unstale":"2024-09-13T16:49:32.119062+0000","last_undegraded":"2024-09-13T16:49:32.119062+0000","last_fullsized":"2024-09-13T16:49:32.119062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:03.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112926+0000","last_change":"2024-09-13T16:49:28.106680+0000","last_active":"2024-09-13T16:49:32.112926+0000","last_peered":"2024-09-13T16:49:32.112926+0000","last_clean":"2024-09-13T16:49:32.112926+0000","last_became_active":"2024-09-13T16:49:28.105210+0000","last_became_peered":"2024-09-13T16:49:28.105210+0000","last_unstale":"2024-09-13T16:49:32.112926+0000","last_undegraded":"2024-09-13T16:49:32.112926+0000","last_fullsized":"2024-09-13T16:49:32.112926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:34.220082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111316+0000","last_change":"2024-09-13T16:49:28.104596+0000","last_active":"2024-09-13T16:49:32.111316+0000","last_peered":"2024-09-13T16:49:32.111316+0000","last_clean":"2024-09-13T16:49:32.111316+0000","last_became_active":"2024-09-13T16:49:28.104306+0000","last_became_peered":"2024-09-13T16:49:28.104306+0000","last_unstale":"2024-09-13T16:49:32.111316+0000","last_undegraded":"2024-09-13T16:49:32.111316+0000","last_fullsized":"2024-09-13T16:49:32.111316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:02.248968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111123+0000","last_change":"2024-09-13T16:49:28.105229+0000","last_active":"2024-09-13T16:49:32.111123+0000","last_peered":"2024-09-13T16:49:32.111123+0000","last_clean":"2024-09-13T16:49:32.111123+0000","last_became_active":"2024-09-13T16:49:28.104832+0000","last_became_peered":"2024-09-13T16:49:28.104832+0000","last_unstale":"2024-09-13T16:49:32.111123+0000","last_undegraded":"2024-09-13T16:49:32.111123+0000","last_fullsized":"2024-09-13T16:49:32.111123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:36.637117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.120414+0000","last_change":"2024-09-13T16:49:28.105370+0000","last_active":"2024-09-13T16:49:32.120414+0000","last_peered":"2024-09-13T16:49:32.120414+0000","last_clean":"2024-09-13T16:49:32.120414+0000","last_became_active":"2024-09-13T16:49:28.105024+0000","last_became_peered":"2024-09-13T16:49:28.105024+0000","last_unstale":"2024-09-13T16:49:32.120414+0000","last_undegraded":"2024-09-13T16:49:32.120414+0000","last_fullsized":"2024-09-13T16:49:32.120414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:32.056178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106901+0000","last_change":"2024-09-13T16:49:28.106106+0000","last_active":"2024-09-13T16:49:32.106901+0000","last_peered":"2024-09-13T16:49:32.106901+0000","last_clean":"2024-09-13T16:49:32.106901+0000","last_became_active":"2024-09-13T16:49:28.105034+0000","last_became_peered":"2024-09-13T16:49:28.105034+0000","last_unstale":"2024-09-13T16:49:32.106901+0000","last_undegraded":"2024-09-13T16:49:32.106901+0000","last_fullsized":"2024-09-13T16:49:32.106901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:08.126157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.116294+0000","last_change":"2024-09-13T16:49:28.116862+0000","last_active":"2024-09-13T16:49:32.116294+0000","last_peered":"2024-09-13T16:49:32.116294+0000","last_clean":"2024-09-13T16:49:32.116294+0000","last_became_active":"2024-09-13T16:49:28.116535+0000","last_became_peered":"2024-09-13T16:49:28.116535+0000","last_unstale":"2024-09-13T16:49:32.116294+0000","last_undegraded":"2024-09-13T16:49:32.116294+0000","last_fullsized":"2024-09-13T16:49:32.116294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:07.216968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.105699+0000","last_change":"2024-09-13T16:49:28.096500+0000","last_active":"2024-09-13T16:49:32.105699+0000","last_peered":"2024-09-13T16:49:32.105699+0000","last_clean":"2024-09-13T16:49:32.105699+0000","last_became_active":"2024-09-13T16:49:28.096218+0000","last_became_peered":"2024-09-13T16:49:28.096218+0000","last_unstale":"2024-09-13T16:49:32.105699+0000","last_undegraded":"2024-09-13T16:49:32.105699+0000","last_fullsized":"2024-09-13T16:49:32.105699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:16.274941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.107810+0000","last_change":"2024-09-13T16:49:28.114943+0000","last_active":"2024-09-13T16:49:32.107810+0000","last_peered":"2024-09-13T16:49:32.107810+0000","last_clean":"2024-09-13T16:49:32.107810+0000","last_became_active":"2024-09-13T16:49:28.114477+0000","last_became_peered":"2024-09-13T16:49:28.114477+0000","last_unstale":"2024-09-13T16:49:32.107810+0000","last_undegraded":"2024-09-13T16:49:32.107810+0000","last_fullsized":"2024-09-13T16:49:32.107810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:21.222638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110227+0000","last_change":"2024-09-13T16:49:28.103795+0000","last_active":"2024-09-13T16:49:32.110227+0000","last_peered":"2024-09-13T16:49:32.110227+0000","last_clean":"2024-09-13T16:49:32.110227+0000","last_became_active":"2024-09-13T16:49:28.103531+0000","last_became_peered":"2024-09-13T16:49:28.103531+0000","last_unstale":"2024-09-13T16:49:32.110227+0000","last_undegraded":"2024-09-13T16:49:32.110227+0000","last_fullsized":"2024-09-13T16:49:32.110227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:17.886309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.116453+0000","last_change":"2024-09-13T16:49:28.109002+0000","last_active":"2024-09-13T16:49:32.116453+0000","last_peered":"2024-09-13T16:49:32.116453+0000","last_clean":"2024-09-13T16:49:32.116453+0000","last_became_active":"2024-09-13T16:49:28.108679+0000","last_became_peered":"2024-09-13T16:49:28.108679+0000","last_unstale":"2024-09-13T16:49:32.116453+0000","last_undegraded":"2024-09-13T16:49:32.116453+0000","last_fullsized":"2024-09-13T16:49:32.116453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:08.803763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115898+0000","last_change":"2024-09-13T16:49:28.114265+0000","last_active":"2024-09-13T16:49:32.115898+0000","last_peered":"2024-09-13T16:49:32.115898+0000","last_clean":"2024-09-13T16:49:32.115898+0000","last_became_active":"2024-09-13T16:49:28.111350+0000","last_became_peered":"2024-09-13T16:49:28.111350+0000","last_unstale":"2024-09-13T16:49:32.115898+0000","last_undegraded":"2024-09-13T16:49:32.115898+0000","last_fullsized":"2024-09-13T16:49:32.115898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:11.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.120331+0000","last_change":"2024-09-13T16:49:28.088565+0000","last_active":"2024-09-13T16:49:32.120331+0000","last_peered":"2024-09-13T16:49:32.120331+0000","last_clean":"2024-09-13T16:49:32.120331+0000","last_became_active":"2024-09-13T16:49:28.088070+0000","last_became_peered":"2024-09-13T16:49:28.088070+0000","last_unstale":"2024-09-13T16:49:32.120331+0000","last_undegraded":"2024-09-13T16:49:32.120331+0000","last_fullsized":"2024-09-13T16:49:32.120331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:23.134281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115640+0000","last_change":"2024-09-13T16:49:28.107501+0000","last_active":"2024-09-13T16:49:32.115640+0000","last_peered":"2024-09-13T16:49:32.115640+0000","last_clean":"2024-09-13T16:49:32.115640+0000","last_became_active":"2024-09-13T16:49:28.107222+0000","last_became_peered":"2024-09-13T16:49:28.107222+0000","last_unstale":"2024-09-13T16:49:32.115640+0000","last_undegraded":"2024-09-13T16:49:32.115640+0000","last_fullsized":"2024-09-13T16:49:32.115640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:04:00.465540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.112521+0000","last_change":"2024-09-13T16:49:28.108274+0000","last_active":"2024-09-13T16:49:32.112521+0000","last_peered":"2024-09-13T16:49:32.112521+0000","last_clean":"2024-09-13T16:49:32.112521+0000","last_became_active":"2024-09-13T16:49:28.107977+0000","last_became_peered":"2024-09-13T16:49:28.107977+0000","last_unstale":"2024-09-13T16:49:32.112521+0000","last_undegraded":"2024-09-13T16:49:32.112521+0000","last_fullsized":"2024-09-13T16:49:32.112521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:31.398072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.106201+0000","last_change":"2024-09-13T16:49:28.098428+0000","last_active":"2024-09-13T16:49:32.106201+0000","last_peered":"2024-09-13T16:49:32.106201+0000","last_clean":"2024-09-13T16:49:32.106201+0000","last_became_active":"2024-09-13T16:49:28.098139+0000","last_became_peered":"2024-09-13T16:49:28.098139+0000","last_unstale":"2024-09-13T16:49:32.106201+0000","last_undegraded":"2024-09-13T16:49:32.106201+0000","last_fullsized":"2024-09-13T16:49:32.106201+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:36.977026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110664+0000","last_change":"2024-09-13T16:49:28.103117+0000","last_active":"2024-09-13T16:49:32.110664+0000","last_peered":"2024-09-13T16:49:32.110664+0000","last_clean":"2024-09-13T16:49:32.110664+0000","last_became_active":"2024-09-13T16:49:28.102850+0000","last_became_peered":"2024-09-13T16:49:28.102850+0000","last_unstale":"2024-09-13T16:49:32.110664+0000","last_undegraded":"2024-09-13T16:49:32.110664+0000","last_fullsized":"2024-09-13T16:49:32.110664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:21.883563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.116551+0000","last_change":"2024-09-13T16:49:28.105876+0000","last_active":"2024-09-13T16:49:32.116551+0000","last_peered":"2024-09-13T16:49:32.116551+0000","last_clean":"2024-09-13T16:49:32.116551+0000","last_became_active":"2024-09-13T16:49:28.104340+0000","last_became_peered":"2024-09-13T16:49:28.104340+0000","last_unstale":"2024-09-13T16:49:32.116551+0000","last_undegraded":"2024-09-13T16:49:32.116551+0000","last_fullsized":"2024-09-13T16:49:32.116551+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:06.385262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.110737+0000","last_change":"2024-09-13T16:49:28.104638+0000","last_active":"2024-09-13T16:49:32.110737+0000","last_peered":"2024-09-13T16:49:32.110737+0000","last_clean":"2024-09-13T16:49:32.110737+0000","last_became_active":"2024-09-13T16:49:28.104145+0000","last_became_peered":"2024-09-13T16:49:28.104145+0000","last_unstale":"2024-09-13T16:49:32.110737+0000","last_undegraded":"2024-09-13T16:49:32.110737+0000","last_fullsized":"2024-09-13T16:49:32.110737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:12.502634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.105766+0000","last_change":"2024-09-13T16:49:28.099310+0000","last_active":"2024-09-13T16:49:32.105766+0000","last_peered":"2024-09-13T16:49:32.105766+0000","last_clean":"2024-09-13T16:49:32.105766+0000","last_became_active":"2024-09-13T16:49:28.098804+0000","last_became_peered":"2024-09-13T16:49:28.098804+0000","last_unstale":"2024-09-13T16:49:32.105766+0000","last_undegraded":"2024-09-13T16:49:32.105766+0000","last_fullsized":"2024-09-13T16:49:32.105766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:33.866940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.111458+0000","last_change":"2024-09-13T16:49:28.116644+0000","last_active":"2024-09-13T16:49:32.111458+0000","last_peered":"2024-09-13T16:49:32.111458+0000","last_clean":"2024-09-13T16:49:32.111458+0000","last_became_active":"2024-09-13T16:49:28.116350+0000","last_became_peered":"2024-09-13T16:49:28.116350+0000","last_unstale":"2024-09-13T16:49:32.111458+0000","last_undegraded":"2024-09-13T16:49:32.111458+0000","last_fullsized":"2024-09-13T16:49:32.111458+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:07.922567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.115549+0000","last_change":"2024-09-13T16:49:28.107528+0000","last_active":"2024-09-13T16:49:32.115549+0000","last_peered":"2024-09-13T16:49:32.115549+0000","last_clean":"2024-09-13T16:49:32.115549+0000","last_became_active":"2024-09-13T16:49:28.107260+0000","last_became_peered":"2024-09-13T16:49:28.107260+0000","last_unstale":"2024-09-13T16:49:32.115549+0000","last_undegraded":"2024-09-13T16:49:32.115549+0000","last_fullsized":"2024-09-13T16:49:32.115549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:23.482772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.117239+0000","last_change":"2024-09-13T16:49:28.105396+0000","last_active":"2024-09-13T16:49:32.117239+0000","last_peered":"2024-09-13T16:49:32.117239+0000","last_clean":"2024-09-13T16:49:32.117239+0000","last_became_active":"2024-09-13T16:49:28.105050+0000","last_became_peered":"2024-09-13T16:49:28.105050+0000","last_unstale":"2024-09-13T16:49:32.117239+0000","last_undegraded":"2024-09-13T16:49:32.117239+0000","last_fullsized":"2024-09-13T16:49:32.117239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:51.533286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.118246+0000","last_change":"2024-09-13T16:49:28.112680+0000","last_active":"2024-09-13T16:49:32.118246+0000","last_peered":"2024-09-13T16:49:32.118246+0000","last_clean":"2024-09-13T16:49:32.118246+0000","last_became_active":"2024-09-13T16:49:28.112389+0000","last_became_peered":"2024-09-13T16:49:28.112389+0000","last_unstale":"2024-09-13T16:49:32.118246+0000","last_undegraded":"2024-09-13T16:49:32.118246+0000","last_fullsized":"2024-09-13T16:49:32.118246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:05.464951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T16:49:32.107731+0000","last_change":"2024-09-13T16:49:28.105746+0000","last_active":"2024-09-13T16:49:32.107731+0000","last_peered":"2024-09-13T16:49:32.107731+0000","last_clean":"2024-09-13T16:49:32.107731+0000","last_became_active":"2024-09-13T16:49:28.105217+0000","last_became_peered":"2024-09-13T16:49:28.105217+0000","last_unstale":"2024-09-13T16:49:32.107731+0000","last_undegraded":"2024-09-13T16:49:32.107731+0000","last_fullsized":"2024-09-13T16:49:32.107731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:13.165993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6645,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":106,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":39383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383699,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":983040,"data_stored":477145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.499},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.62}]},{"osd":7,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.46999999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":9,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.71099999999999997}]},{"osd":10,"last update":"Fri Sep 13 16:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69099999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1593344,"data_stored":1070639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.628},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56100000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67100000000000004}]},{"osd":9,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.754},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70099999999999996}]},{"osd":11,"last update":"Fri Sep 13 16:49:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.79700000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808860,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":983040,"data_stored":477145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.94099999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.745}]},{"osd":3,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3799999999999999,"5min":1.55,"15min":1.55},"last":0.625},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77800000000000002,"15min":0.79300000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1679999999999999,"5min":1.458,"15min":1.458},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.84899999999999998,"15min":0.83499999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2190000000000001,"5min":1.635,"15min":1.635},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.90800000000000003,"15min":0.92900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3480000000000001,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.90300000000000002,"15min":0.91100000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1970000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:48:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.081},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.2589999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.97799999999999998,"15min":1.0029999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2889999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.76200000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85299999999999998,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":1.0309999999999999,"15min":1.0549999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5669999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.89000000000000001}]},{"osd":10,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":476970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73699999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.39200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.72999999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.41499999999999998,"15min":0.41799999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.749,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.47199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.79000000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61499999999999999,"15min":0.61299999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.85799999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.84699999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332134,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36756,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708396,"statfs":{"total":95995035648,"available":95957397504,"internally_reserved":0,"allocated":1585152,"data_stored":1068087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.26600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.41899999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58899999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.433},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76500000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.83099999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82999999999999996,"5min":0.88,"15min":0.88},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.75900000000000001}]},{"osd":9,"last update":"Fri Sep 13 16:49:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71499999999999997,"15min":0.71999999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.749}]},{"osd":10,"last update":"Fri Sep 13 16:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.67500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":6,"up_from":46,"seq":197568495659,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":476653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.53400000000000003,"15min":0.55500000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63700000000000001,"15min":0.64500000000000002},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82499999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.65300000000000002},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.93400000000000005}]},{"osd":2,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.71299999999999997,"15min":0.70299999999999996},"min":{"1min":0.53000000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93100000000000005,"5min":1.353,"15min":1.353},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69699999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.66700000000000004,"15min":0.68700000000000006},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78800000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66800000000000004,"15min":0.68400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85299999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.48099999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.748},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.55300000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96499999999999997,"5min":1.03,"15min":1.03},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.83499999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:49:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.59299999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.054,"5min":1.097,"15min":1.097},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.63800000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.83299999999999996}]},{"osd":8,"last update":"Fri Sep 13 16:49:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.752,"15min":0.746},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81599999999999995,"15min":0.81000000000000005},"min":{"1min":0.65300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0609999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78200000000000003}]},{"osd":9,"last update":"Fri Sep 13 16:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.83999999999999997,"15min":0.84399999999999997},"min":{"1min":0.54500000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.86299999999999999,"15min":0.874},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.089,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.65100000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.82399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757298,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1601536,"data_stored":1068359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.56100000000000005,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.488,"5min":3.488,"15min":3.488},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.52100000000000002},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.504,"15min":0.48199999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.36699999999999999,"15min":0.35999999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.378,"15min":0.37},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.25700000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.54900000000000004,"15min":0.52300000000000002},"min":{"1min":0.42499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.44800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56499999999999995,"15min":0.54300000000000004},"min":{"1min":0.46700000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:49:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.625,"15min":0.60999999999999999},"min":{"1min":0.44600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.63500000000000001,"15min":0.61099999999999999},"min":{"1min":0.46999999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.48899999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:49:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.40699999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60599999999999998,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91200000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.437}]},{"osd":8,"last update":"Fri Sep 13 16:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35599999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.72799999999999998,"15min":0.70699999999999996},"min":{"1min":0.56100000000000005,"5min":0.443,"15min":0.443},"max":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.50700000000000001}]},{"osd":10,"last update":"Fri Sep 13 16:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.46500000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920821,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":476585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72499999999999998,"5min":0.879,"15min":0.879},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59199999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.376,"15min":0.36599999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81899999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.628},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66400000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.80300000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:49:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.751,"5min":1.004,"15min":1.004},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80900000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.81799999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:48:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.496,"15min":0.498},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.73399999999999999}]},{"osd":8,"last update":"Fri Sep 13 16:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63,"15min":0.63},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.72299999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.84999999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.76100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":983040,"data_stored":476336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.371},"min":{"1min":0.33100000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.441,"15min":0.42599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72699999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.372}]},{"osd":1,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58599999999999997,"15min":0.55300000000000005},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.60599999999999998,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.61799999999999999,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64600000000000002,"15min":0.61699999999999999},"min":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Sep 13 16:49:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67500000000000004,"15min":0.63100000000000001},"min":{"1min":0.45900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.90100000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61799999999999999,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.66800000000000004,"15min":0.63900000000000001},"min":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.70799999999999996,"15min":0.67700000000000005},"min":{"1min":0.59499999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:49:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.68799999999999994,"15min":0.66300000000000003},"min":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93600000000000005,"5min":1.087,"15min":1.087},"last":0.629},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82399999999999995,"5min":1.087,"15min":1.087},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:48:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.77800000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.78500000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93300000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0629999999999999,"5min":0.76700000000000002,"15min":0.71699999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":8.7639999999999993,"5min":8.7639999999999993,"15min":8.7639999999999993},"last":0.84399999999999997}]},{"osd":9,"last update":"Fri Sep 13 16:49:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.69699999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.244,"5min":1.327,"15min":1.327},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.66100000000000003}]},{"osd":10,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.79700000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":501079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.436,"5min":0.249,"15min":0.249},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54000000000000004,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:49:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.54500000000000004,"15min":0.52400000000000002},"min":{"1min":0.45700000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75800000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.44,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77000000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.439}]},{"osd":5,"last update":"Fri Sep 13 16:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40100000000000002,"15min":0.39800000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.63600000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.318},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.39000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45500000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:49:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.625,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.627,"15min":0.628},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Sep 13 16:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.746,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54400000000000004}]},{"osd":8,"last update":"Fri Sep 13 16:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.747,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.40200000000000002}]},{"osd":9,"last update":"Fri Sep 13 16:49:48 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.57199999999999995,"5min":0.502,"15min":0.502},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.55800000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.53800000000000003}]},{"osd":10,"last update":"Fri Sep 13 16:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":480358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53000000000000003,"15min":0.50600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79500000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.50800000000000001},"min":{"1min":0.36499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.92300000000000004},"min":{"1min":0.42399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.80300000000000005,"5min":10.377000000000001,"15min":10.377000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.48399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.78900000000000003,"15min":0.94499999999999995},"min":{"1min":0.53900000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98899999999999999,"5min":10.347,"15min":10.347},"last":0.62}]},{"osd":4,"last update":"Fri Sep 13 16:49:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.39100000000000001,"15min":0.371},"min":{"1min":0.26500000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66300000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.36599999999999999},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.497}]},{"osd":5,"last update":"Fri Sep 13 16:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.52500000000000002,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84299999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.80300000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83299999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:49:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.48599999999999999,"15min":0.45200000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.46400000000000002,"15min":0.42799999999999999},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.68600000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.47199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81699999999999995}]},{"osd":9,"last update":"Fri Sep 13 16:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.90400000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92000000000000004,"5min":1.115,"15min":1.115},"last":0.74099999999999999}]},{"osd":10,"last update":"Fri Sep 13 16:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":478041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:49:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58099999999999996,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85499999999999998,"5min":1.109,"15min":1.109},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63500000000000001,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91000000000000003,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Sep 13 16:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.49299999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65300000000000002,"15min":0.65000000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95599999999999996,"5min":1.871,"15min":1.871},"last":0.503}]},{"osd":3,"last update":"Fri Sep 13 16:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.36799999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.628}]},{"osd":4,"last update":"Fri Sep 13 16:49:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.38800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":1.133,"15min":1.133},"last":0.622},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65300000000000002,"15min":0.627},"min":{"1min":0.45200000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94399999999999995,"5min":1.198,"15min":1.198},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Sep 13 16:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.46500000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85199999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95199999999999996,"5min":1.079,"15min":1.079},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:49:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.436,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98199999999999998,"5min":1.117,"15min":1.117},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84999999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:48:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.70999999999999996,"15min":0.69699999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1850000000000001,"5min":1.228,"15min":1.228},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.66400000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:49:20 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.745,"15min":0.752},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88500000000000001,"5min":1.044,"15min":1.044},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.66700000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0760000000000001,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.80000000000000004}]},{"osd":9,"last update":"Fri Sep 13 16:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.097,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98999999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.89800000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.86899999999999999}]},{"osd":11,"last update":"Fri Sep 13 16:49:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.94399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":24789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:50:01.503 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T16:50:01.504 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T16:50:01.505 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T16:50:01.870 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:02.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:01 smithi094 ceph-mon[35259]: from='client.24860 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:02.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:01 smithi094 ceph-mon[35259]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T16:50:02.180 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:01 smithi018 ceph-mon[30981]: from='client.24860 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:02.180 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:01 smithi018 ceph-mon[30981]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T16:50:02.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:01 smithi144 ceph-mon[35328]: from='client.24860 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:50:02.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:01 smithi144 ceph-mon[35328]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T16:50:03.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:02 smithi094 ceph-mon[35259]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:50:03.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:02 smithi094 ceph-mon[35259]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:50:03.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:02 smithi094 ceph-mon[35259]: pgmap v314: 129 pgs: 129 active+clean; 620 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-09-13T16:50:03.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:02 smithi018 ceph-mon[30981]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:50:03.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:02 smithi018 ceph-mon[30981]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:50:03.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:02 smithi018 ceph-mon[30981]: pgmap v314: 129 pgs: 129 active+clean; 620 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-09-13T16:50:03.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:02 smithi144 ceph-mon[35328]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:50:03.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:02 smithi144 ceph-mon[35328]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:50:03.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:02 smithi144 ceph-mon[35328]: pgmap v314: 129 pgs: 129 active+clean; 620 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-09-13T16:50:03.948 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:03 smithi018 ceph-mon[30981]: pgmap v315: 129 pgs: 129 active+clean; 620 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-13T16:50:04.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.067+0000 7f2bd7200640 1 -- 172.21.15.18:0/2331100239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd8103950 msgr2=0x7f2bd810a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:04.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.067+0000 7f2bd7200640 1 --2- 172.21.15.18:0/2331100239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd8103950 0x7f2bd810a270 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009ca0 tx=0x7f2bd002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.067+0000 7f2bd7200640 1 -- 172.21.15.18:0/2331100239 shutdown_connections 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.067+0000 7f2bd7200640 1 --2- 172.21.15.18:0/2331100239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd8103950 0x7f2bd810a270 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.067+0000 7f2bd7200640 1 --2- 172.21.15.18:0/2331100239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd8102f90 0x7f2bd8103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.067+0000 7f2bd7200640 1 --2- 172.21.15.18:0/2331100239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd8101e30 0x7f2bd8102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.067+0000 7f2bd7200640 1 -- 172.21.15.18:0/2331100239 >> 172.21.15.18:0/2331100239 conn(0x7f2bd80fd5e0 msgr2=0x7f2bd80ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.067+0000 7f2bd7200640 1 -- 172.21.15.18:0/2331100239 shutdown_connections 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.067+0000 7f2bd7200640 1 -- 172.21.15.18:0/2331100239 wait complete. 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.068+0000 7f2bd7200640 1 Processor -- start 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.068+0000 7f2bd7200640 1 -- start start 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd7200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd8101e30 0x7f2bd8197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd8102f90 0x7f2bd81982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:04.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd8103950 0x7f2bd819f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd819f8a0 con 0x7f2bd8103950 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd7200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd819fa10 con 0x7f2bd8101e30 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd819fbd0 con 0x7f2bd8102f90 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd8103950 0x7f2bd819f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd8103950 0x7f2bd819f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38410/0 (socket says 172.21.15.18:38410) 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd6800640 1 -- 172.21.15.18:0/1293774594 learned_addr learned my addr 172.21.15.18:0/1293774594 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd5e00640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd8101e30 0x7f2bd8197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bcd400640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd8102f90 0x7f2bd81982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd5e00640 1 -- 172.21.15.18:0/1293774594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd8102f90 msgr2=0x7f2bd81982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd5e00640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd8102f90 0x7f2bd81982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd5e00640 1 -- 172.21.15.18:0/1293774594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd8103950 msgr2=0x7f2bd819f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd5e00640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd8103950 0x7f2bd819f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.069+0000 7f2bd5e00640 1 -- 172.21.15.18:0/1293774594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd0009900 con 0x7f2bd8101e30 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.070+0000 7f2bd5e00640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd8101e30 0x7f2bd8197db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800e9f0 tx=0x7f2bc800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.070+0000 7f2bcf400640 1 -- 172.21.15.18:0/1293774594 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc800ccc0 con 0x7f2bd8101e30 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.070+0000 7f2bcf400640 1 -- 172.21.15.18:0/1293774594 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bc800ce20 con 0x7f2bd8101e30 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.070+0000 7f2bcf400640 1 -- 172.21.15.18:0/1293774594 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80187e0 con 0x7f2bd8101e30 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.070+0000 7f2bd7200640 1 -- 172.21.15.18:0/1293774594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd819feb0 con 0x7f2bd8101e30 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.070+0000 7f2bd7200640 1 -- 172.21.15.18:0/1293774594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd81a0270 con 0x7f2bd8101e30 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.071+0000 7f2bd7200640 1 -- 172.21.15.18:0/1293774594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd8109270 con 0x7f2bd8101e30 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.073+0000 7f2bcf400640 1 -- 172.21.15.18:0/1293774594 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2bc8010430 con 0x7f2bd8101e30 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.074+0000 7f2bcf400640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2bbc0a1100 0x7f2bbc0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.074+0000 7f2bcf400640 1 -- 172.21.15.18:0/1293774594 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2bc8014070 con 0x7f2bd8101e30 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.074+0000 7f2bcd400640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2bbc0a1100 0x7f2bbc0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.075+0000 7f2bcd400640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2bbc0a1100 0x7f2bbc0a35c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8101b60 tx=0x7f2bc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:04.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.076+0000 7f2bcf400640 1 -- 172.21.15.18:0/1293774594 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2bc8096430 con 0x7f2bd8101e30 2024-09-13T16:50:04.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:03 smithi094 ceph-mon[35259]: pgmap v315: 129 pgs: 129 active+clean; 620 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-13T16:50:04.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:03 smithi144 ceph-mon[35328]: pgmap v315: 129 pgs: 129 active+clean; 620 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-13T16:50:04.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.329+0000 7f2bd7200640 1 -- 172.21.15.18:0/1293774594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f2bd810d750 con 0x7f2bd8101e30 2024-09-13T16:50:04.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.336+0000 7f2bcf400640 1 -- 172.21.15.18:0/1293774594 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f2bc8099a50 con 0x7f2bd8101e30 2024-09-13T16:50:04.338 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-13T16:50:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA8beRmvkXRExAAIsFGxJyOQo5a7uwXKOY4XQ== 2024-09-13T16:50:04.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 -- 172.21.15.18:0/1293774594 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2bbc0a1100 msgr2=0x7f2bbc0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2bbc0a1100 0x7f2bbc0a35c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8101b60 tx=0x7f2bc0005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 -- 172.21.15.18:0/1293774594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd8101e30 msgr2=0x7f2bd8197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd8101e30 0x7f2bd8197db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800e9f0 tx=0x7f2bc800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 -- 172.21.15.18:0/1293774594 shutdown_connections 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f2bbc0a1100 0x7f2bbc0a35c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd8103950 0x7f2bd819f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd8102f90 0x7f2bd81982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 --2- 172.21.15.18:0/1293774594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bd8101e30 0x7f2bd8197db0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 -- 172.21.15.18:0/1293774594 >> 172.21.15.18:0/1293774594 conn(0x7f2bd80fd5e0 msgr2=0x7f2bd8106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 -- 172.21.15.18:0/1293774594 shutdown_connections 2024-09-13T16:50:04.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:04.338+0000 7f2bd7200640 1 -- 172.21.15.18:0/1293774594 wait complete. 2024-09-13T16:50:04.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:04 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1293774594' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:50:04.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:04 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:50:04.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:04 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T16:50:05.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:04 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1293774594' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:50:05.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:04 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:50:05.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:04 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T16:50:05.226 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:50:05.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T16:50:05.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T16:50:05.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:04 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1293774594' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:50:05.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:04 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T16:50:05.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:04 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T16:50:05.311 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T16:50:05.311 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T16:50:05.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T16:50:05.672 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:06.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:05 smithi018 ceph-mon[30981]: pgmap v316: 129 pgs: 129 active+clean; 626 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 KiB/s wr, 13 op/s 2024-09-13T16:50:06.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:05 smithi094 ceph-mon[35259]: pgmap v316: 129 pgs: 129 active+clean; 626 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 KiB/s wr, 13 op/s 2024-09-13T16:50:06.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:05 smithi144 ceph-mon[35328]: pgmap v316: 129 pgs: 129 active+clean; 626 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 KiB/s wr, 13 op/s 2024-09-13T16:50:07.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.773+0000 7fa484a00640 1 -- 172.21.15.18:0/1234100048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa48010b720 msgr2=0x7fa4801132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:07.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.773+0000 7fa484a00640 1 --2- 172.21.15.18:0/1234100048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa48010b720 0x7fa4801132a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa478009cd0 tx=0x7fa47802a8f0 comp rx=0 tx=0).stop 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.773+0000 7fa484a00640 1 -- 172.21.15.18:0/1234100048 shutdown_connections 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.773+0000 7fa484a00640 1 --2- 172.21.15.18:0/1234100048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa48010b720 0x7fa4801132a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.773+0000 7fa484a00640 1 --2- 172.21.15.18:0/1234100048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa480106fa0 0x7fa48010aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.773+0000 7fa484a00640 1 --2- 172.21.15.18:0/1234100048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4801065f0 0x7fa4801069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.773+0000 7fa484a00640 1 -- 172.21.15.18:0/1234100048 >> 172.21.15.18:0/1234100048 conn(0x7fa480075d10 msgr2=0x7fa480078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.773+0000 7fa484a00640 1 -- 172.21.15.18:0/1234100048 shutdown_connections 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.774+0000 7fa484a00640 1 -- 172.21.15.18:0/1234100048 wait complete. 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.774+0000 7fa484a00640 1 Processor -- start 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.774+0000 7fa484a00640 1 -- start start 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa484a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4801065f0 0x7fa4801a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa484a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa480106fa0 0x7fa4801a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa484a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa48010b720 0x7fa48019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa484a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48019cde0 con 0x7fa480106fa0 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa484a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48019cf50 con 0x7fa4801065f0 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa484a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48019d110 con 0x7fa48010b720 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa47d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa480106fa0 0x7fa4801a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa47de00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4801065f0 0x7fa4801a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa47de00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4801065f0 0x7fa4801a2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:48924/0 (socket says 172.21.15.18:48924) 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa47de00640 1 -- 172.21.15.18:0/3938254705 learned_addr learned my addr 172.21.15.18:0/3938254705 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.775+0000 7fa47e800640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa48010b720 0x7fa48019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa47de00640 1 -- 172.21.15.18:0/3938254705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa48010b720 msgr2=0x7fa48019c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa47de00640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa48010b720 0x7fa48019c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa47de00640 1 -- 172.21.15.18:0/3938254705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa480106fa0 msgr2=0x7fa4801a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa47de00640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa480106fa0 0x7fa4801a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa47de00640 1 -- 172.21.15.18:0/3938254705 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa478009900 con 0x7fa4801065f0 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa47d400640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa480106fa0 0x7fa4801a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa47de00640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4801065f0 0x7fa4801a2640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa47000d770 tx=0x7fa47000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa476a00640 1 -- 172.21.15.18:0/3938254705 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470009c30 con 0x7fa4801065f0 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa484a00640 1 -- 172.21.15.18:0/3938254705 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48019d3f0 con 0x7fa4801065f0 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa476a00640 1 -- 172.21.15.18:0/3938254705 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa47000de80 con 0x7fa4801065f0 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa476a00640 1 -- 172.21.15.18:0/3938254705 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470004de0 con 0x7fa4801065f0 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.776+0000 7fa484a00640 1 -- 172.21.15.18:0/3938254705 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4801a95c0 con 0x7fa4801065f0 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.778+0000 7fa484a00640 1 -- 172.21.15.18:0/3938254705 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa480107ad0 con 0x7fa4801065f0 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.780+0000 7fa476a00640 1 -- 172.21.15.18:0/3938254705 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa470004f40 con 0x7fa4801065f0 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.781+0000 7fa476a00640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4640a1110 0x7fa4640a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.781+0000 7fa476a00640 1 -- 172.21.15.18:0/3938254705 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa4700cc6c0 con 0x7fa4801065f0 2024-09-13T16:50:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.781+0000 7fa47d400640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4640a1110 0x7fa4640a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.782+0000 7fa47d400640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4640a1110 0x7fa4640a35d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa48019df60 tx=0x7fa46c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:07.786+0000 7fa476a00640 1 -- 172.21.15.18:0/3938254705 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa470095b50 con 0x7fa4801065f0 2024-09-13T16:50:07.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:07 smithi018 ceph-mon[30981]: pgmap v317: 129 pgs: 129 active+clean; 626 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-09-13T16:50:08.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.013+0000 7fa484a00640 1 -- 172.21.15.18:0/3938254705 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa4801069d0 con 0x7fa4801065f0 2024-09-13T16:50:08.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.017+0000 7fa476a00640 1 -- 172.21.15.18:0/3938254705 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260281 (secure 0 0 0) 0x7fa470017090 con 0x7fa4801065f0 2024-09-13T16:50:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:50:08.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.021+0000 7fa484a00640 1 -- 172.21.15.18:0/3938254705 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4640a1110 msgr2=0x7fa4640a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.021+0000 7fa484a00640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4640a1110 0x7fa4640a35d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa48019df60 tx=0x7fa46c005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.021+0000 7fa484a00640 1 -- 172.21.15.18:0/3938254705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4801065f0 msgr2=0x7fa4801a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.021+0000 7fa484a00640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4801065f0 0x7fa4801a2640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa47000d770 tx=0x7fa47000dc30 comp rx=0 tx=0).stop 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.022+0000 7fa484a00640 1 -- 172.21.15.18:0/3938254705 shutdown_connections 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.022+0000 7fa484a00640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4640a1110 0x7fa4640a35d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.022+0000 7fa484a00640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa480106fa0 0x7fa4801a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.022+0000 7fa484a00640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa48010b720 0x7fa48019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.022+0000 7fa484a00640 1 --2- 172.21.15.18:0/3938254705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4801065f0 0x7fa4801a2640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.022+0000 7fa484a00640 1 -- 172.21.15.18:0/3938254705 >> 172.21.15.18:0/3938254705 conn(0x7fa480075d10 msgr2=0x7fa480077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.022+0000 7fa484a00640 1 -- 172.21.15.18:0/3938254705 shutdown_connections 2024-09-13T16:50:08.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:08.022+0000 7fa484a00640 1 -- 172.21.15.18:0/3938254705 wait complete. 2024-09-13T16:50:08.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:07 smithi094 ceph-mon[35259]: pgmap v317: 129 pgs: 129 active+clean; 626 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-09-13T16:50:08.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:07 smithi144 ceph-mon[35328]: pgmap v317: 129 pgs: 129 active+clean; 626 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-09-13T16:50:08.880 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":687548857},{"type":"v1","addr":"172.21.15.18:6801","nonce":687548857}]},"active_addr":"172.21.15.18:6801/687548857","active_change":"2024-09-13T16:42:11.669611+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.18:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":1733204451}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":684823669}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":2679332757}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":2278832128}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":632919273}]}]} 2024-09-13T16:50:08.886 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T16:50:08.886 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T16:50:08.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T16:50:09.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:08 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3938254705' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T16:50:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:09.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:08 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3938254705' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T16:50:09.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:08 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3938254705' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T16:50:09.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:09 smithi018 ceph-mon[30981]: pgmap v318: 129 pgs: 129 active+clean; 626 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-13T16:50:10.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:09 smithi094 ceph-mon[35259]: pgmap v318: 129 pgs: 129 active+clean; 626 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-13T16:50:10.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:09 smithi144 ceph-mon[35328]: pgmap v318: 129 pgs: 129 active+clean; 626 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-13T16:50:11.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.381+0000 7f1104800640 1 -- 172.21.15.18:0/3196075901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10fc102200 msgr2=0x7f10fc1025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:11.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.381+0000 7f1104800640 1 --2- 172.21.15.18:0/3196075901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10fc102200 0x7f10fc1025e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009930 tx=0x7f10f002a420 comp rx=0 tx=0).stop 2024-09-13T16:50:11.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.381+0000 7f1104800640 1 -- 172.21.15.18:0/3196075901 shutdown_connections 2024-09-13T16:50:11.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.381+0000 7f1104800640 1 --2- 172.21.15.18:0/3196075901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10fc107330 0x7f10fc10eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:11.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.381+0000 7f1104800640 1 --2- 172.21.15.18:0/3196075901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10fc102bb0 0x7f10fc106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:11.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.381+0000 7f1104800640 1 --2- 172.21.15.18:0/3196075901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10fc102200 0x7f10fc1025e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:11.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.381+0000 7f1104800640 1 -- 172.21.15.18:0/3196075901 >> 172.21.15.18:0/3196075901 conn(0x7f10fc0fdc60 msgr2=0x7f10fc100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:11.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.381+0000 7f1104800640 1 -- 172.21.15.18:0/3196075901 shutdown_connections 2024-09-13T16:50:11.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.381+0000 7f1104800640 1 -- 172.21.15.18:0/3196075901 wait complete. 2024-09-13T16:50:11.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.382+0000 7f1104800640 1 Processor -- start 2024-09-13T16:50:11.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.382+0000 7f1104800640 1 -- start start 2024-09-13T16:50:11.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.382+0000 7f1104800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10fc102200 0x7f10fc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:11.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.382+0000 7f1104800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10fc102bb0 0x7f10fc198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:11.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.382+0000 7f1104800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10fc107330 0x7f10fc19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:11.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.382+0000 7f1104800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc19d440 con 0x7f10fc102200 2024-09-13T16:50:11.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.382+0000 7f1104800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc19d5b0 con 0x7f10fc102bb0 2024-09-13T16:50:11.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.382+0000 7f1104800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc19d720 con 0x7f10fc107330 2024-09-13T16:50:11.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10fc102200 0x7f10fc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10fc102200 0x7f10fc198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34158/0 (socket says 172.21.15.18:34158) 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10fc102bb0 0x7f10fc198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101e00640 1 -- 172.21.15.18:0/1815055259 learned_addr learned my addr 172.21.15.18:0/1815055259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1102800640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10fc107330 0x7f10fc19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101e00640 1 -- 172.21.15.18:0/1815055259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10fc107330 msgr2=0x7f10fc19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101e00640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10fc107330 0x7f10fc19ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101e00640 1 -- 172.21.15.18:0/1815055259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10fc102bb0 msgr2=0x7f10fc198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101e00640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10fc102bb0 0x7f10fc198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101e00640 1 -- 172.21.15.18:0/1815055259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f8009840 con 0x7f10fc102200 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101400640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10fc102bb0 0x7f10fc198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.383+0000 7f1101e00640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10fc102200 0x7f10fc198500 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10f0005ab0 tx=0x7f10f0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.384+0000 7f10f6a00640 1 -- 172.21.15.18:0/1815055259 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0005d50 con 0x7f10fc102200 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.384+0000 7f10f6a00640 1 -- 172.21.15.18:0/1815055259 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10f0003e00 con 0x7f10fc102200 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.384+0000 7f1104800640 1 -- 172.21.15.18:0/1815055259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f0009560 con 0x7f10fc102200 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.384+0000 7f10f6a00640 1 -- 172.21.15.18:0/1815055259 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f003ba50 con 0x7f10fc102200 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.384+0000 7f1104800640 1 -- 172.21.15.18:0/1815055259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc19dcb0 con 0x7f10fc102200 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.385+0000 7f1104800640 1 -- 172.21.15.18:0/1815055259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc1036e0 con 0x7f10fc102200 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.387+0000 7f10f6a00640 1 -- 172.21.15.18:0/1815055259 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f10f003bbb0 con 0x7f10fc102200 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.388+0000 7f10f6a00640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10e40a1110 0x7f10e40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.388+0000 7f10f6a00640 1 -- 172.21.15.18:0/1815055259 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f10f00ed270 con 0x7f10fc102200 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.388+0000 7f1101400640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10e40a1110 0x7f10e40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.389+0000 7f1101400640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10e40a1110 0x7f10e40a35d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f10fc199ab0 tx=0x7f10ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.392+0000 7f10f6a00640 1 -- 172.21.15.18:0/1815055259 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f10f00b6650 con 0x7f10fc102200 2024-09-13T16:50:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.573+0000 7f1104800640 1 -- 172.21.15.18:0/1815055259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10fc1025e0 con 0x7f10fc102200 2024-09-13T16:50:11.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.575+0000 7f10f6a00640 1 -- 172.21.15.18:0/1815055259 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23874 (secure 0 0 0) 0x7f10f003be60 con 0x7f10fc102200 2024-09-13T16:50:11.577 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:50:11.578 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:49:32.540261+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:50:11.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 -- 172.21.15.18:0/1815055259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10e40a1110 msgr2=0x7f10e40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:11.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10e40a1110 0x7f10e40a35d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f10fc199ab0 tx=0x7f10ec005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:11.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 -- 172.21.15.18:0/1815055259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10fc102200 msgr2=0x7f10fc198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:11.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10fc102200 0x7f10fc198500 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10f0005ab0 tx=0x7f10f0003c10 comp rx=0 tx=0).stop 2024-09-13T16:50:11.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 -- 172.21.15.18:0/1815055259 shutdown_connections 2024-09-13T16:50:11.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10fc107330 0x7f10fc19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:11.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10fc102bb0 0x7f10fc198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:11.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f10e40a1110 0x7f10e40a35d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:11.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 --2- 172.21.15.18:0/1815055259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10fc102200 0x7f10fc198500 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:11.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 -- 172.21.15.18:0/1815055259 >> 172.21.15.18:0/1815055259 conn(0x7f10fc0fdc60 msgr2=0x7f10fc0ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:11.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 -- 172.21.15.18:0/1815055259 shutdown_connections 2024-09-13T16:50:11.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:11.578+0000 7f1104800640 1 -- 172.21.15.18:0/1815055259 wait complete. 2024-09-13T16:50:11.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:11 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1815055259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:50:11.943 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:11 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1815055259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:50:12.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:11 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1815055259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:50:12.442 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T16:50:12.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]: dispatch 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-13T16:50:12.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:12 smithi018 ceph-mon[30981]: pgmap v319: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.1 KiB/s wr, 11 op/s 2024-09-13T16:50:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:12.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-13T16:50:12.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-13T16:50:12.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-13T16:50:12.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-13T16:50:12.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-13T16:50:12.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]: dispatch 2024-09-13T16:50:12.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-13T16:50:12.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-13T16:50:12.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-13T16:50:12.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-13T16:50:12.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:12 smithi094 ceph-mon[35259]: pgmap v319: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.1 KiB/s wr, 11 op/s 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]: dispatch 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-13T16:50:13.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:12 smithi144 ceph-mon[35328]: pgmap v319: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.1 KiB/s wr, 11 op/s 2024-09-13T16:50:13.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-13T16:50:13.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-13T16:50:13.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-13T16:50:13.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-13T16:50:13.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-13T16:50:13.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]': finished 2024-09-13T16:50:13.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-13T16:50:13.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-13T16:50:13.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-13T16:50:13.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-13T16:50:13.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:13 smithi094 ceph-mon[35259]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T16:50:13.932 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-13T16:50:13.932 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-13T16:50:13.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-13T16:50:13.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-13T16:50:13.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-13T16:50:13.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]': finished 2024-09-13T16:50:13.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-13T16:50:13.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-13T16:50:13.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-13T16:50:13.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-13T16:50:13.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:13 smithi018 ceph-mon[30981]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]': finished 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-13T16:50:14.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:13 smithi144 ceph-mon[35328]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T16:50:14.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.775+0000 7fb5f0e00640 1 -- 172.21.15.18:0/852407015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5ec107330 msgr2=0x7fb5ec10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:14.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.775+0000 7fb5f0e00640 1 --2- 172.21.15.18:0/852407015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5ec107330 0x7fb5ec10eeb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009cd0 tx=0x7fb5e402a8e0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.775+0000 7fb5f0e00640 1 -- 172.21.15.18:0/852407015 shutdown_connections 2024-09-13T16:50:14.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.775+0000 7fb5f0e00640 1 --2- 172.21.15.18:0/852407015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5ec107330 0x7fb5ec10eeb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.775+0000 7fb5f0e00640 1 --2- 172.21.15.18:0/852407015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5ec102bb0 0x7fb5ec106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.775+0000 7fb5f0e00640 1 --2- 172.21.15.18:0/852407015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5ec102200 0x7fb5ec1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.775+0000 7fb5f0e00640 1 -- 172.21.15.18:0/852407015 >> 172.21.15.18:0/852407015 conn(0x7fb5ec0fdc60 msgr2=0x7fb5ec100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:14.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.775+0000 7fb5f0e00640 1 -- 172.21.15.18:0/852407015 shutdown_connections 2024-09-13T16:50:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.775+0000 7fb5f0e00640 1 -- 172.21.15.18:0/852407015 wait complete. 2024-09-13T16:50:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.776+0000 7fb5f0e00640 1 Processor -- start 2024-09-13T16:50:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.776+0000 7fb5f0e00640 1 -- start start 2024-09-13T16:50:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.776+0000 7fb5f0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5ec102200 0x7fb5ec1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.776+0000 7fb5f0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5ec102bb0 0x7fb5ec1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.776+0000 7fb5f0e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5ec107330 0x7fb5ec19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.776+0000 7fb5f0e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec19d3f0 con 0x7fb5ec102bb0 2024-09-13T16:50:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.776+0000 7fb5f0e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec19d560 con 0x7fb5ec107330 2024-09-13T16:50:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.776+0000 7fb5f0e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec19d6d0 con 0x7fb5ec102200 2024-09-13T16:50:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5ec102200 0x7fb5ec1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:14.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5ec102bb0 0x7fb5ec1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5ec102200 0x7fb5ec1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:39954/0 (socket says 172.21.15.18:39954) 2024-09-13T16:50:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e9e00640 1 -- 172.21.15.18:0/3648941682 learned_addr learned my addr 172.21.15.18:0/3648941682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5ea800640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5ec107330 0x7fb5ec19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e9e00640 1 -- 172.21.15.18:0/3648941682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5ec107330 msgr2=0x7fb5ec19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e9e00640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5ec107330 0x7fb5ec19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e9e00640 1 -- 172.21.15.18:0/3648941682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5ec102bb0 msgr2=0x7fb5ec1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:14.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e9e00640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5ec102bb0 0x7fb5ec1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e9e00640 1 -- 172.21.15.18:0/3648941682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e4009900 con 0x7fb5ec102200 2024-09-13T16:50:14.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5ea800640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5ec107330 0x7fb5ec19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:50:14.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e1400640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5ec102bb0 0x7fb5ec1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:50:14.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.777+0000 7fb5e9e00640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5ec102200 0x7fb5ec1984b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00e9f0 tx=0x7fb5dc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:14.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.778+0000 7fb5e3400640 1 -- 172.21.15.18:0/3648941682 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc009720 con 0x7fb5ec102200 2024-09-13T16:50:14.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.778+0000 7fb5e3400640 1 -- 172.21.15.18:0/3648941682 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5dc00cd80 con 0x7fb5ec102200 2024-09-13T16:50:14.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.778+0000 7fb5e3400640 1 -- 172.21.15.18:0/3648941682 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc010430 con 0x7fb5ec102200 2024-09-13T16:50:14.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.778+0000 7fb5f0e00640 1 -- 172.21.15.18:0/3648941682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec19d9b0 con 0x7fb5ec102200 2024-09-13T16:50:14.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.778+0000 7fb5f0e00640 1 -- 172.21.15.18:0/3648941682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec1a5270 con 0x7fb5ec102200 2024-09-13T16:50:14.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.779+0000 7fb5f0e00640 1 -- 172.21.15.18:0/3648941682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec1036e0 con 0x7fb5ec102200 2024-09-13T16:50:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.781+0000 7fb5e3400640 1 -- 172.21.15.18:0/3648941682 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb5dc005020 con 0x7fb5ec102200 2024-09-13T16:50:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.782+0000 7fb5e3400640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5d00a1110 0x7fb5d00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.782+0000 7fb5e3400640 1 -- 172.21.15.18:0/3648941682 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb5dc014070 con 0x7fb5ec102200 2024-09-13T16:50:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.782+0000 7fb5e1400640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5d00a1110 0x7fb5d00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.783+0000 7fb5e1400640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5d00a1110 0x7fb5d00a35d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec199a60 tx=0x7fb5d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.784+0000 7fb5e3400640 1 -- 172.21.15.18:0/3648941682 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb5dc0968d0 con 0x7fb5ec102200 2024-09-13T16:50:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:14 smithi094 ceph-mon[35259]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T16:50:14.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:14 smithi094 ceph-mon[35259]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-13T16:50:14.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:14 smithi018 ceph-mon[30981]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T16:50:14.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:14 smithi018 ceph-mon[30981]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-13T16:50:14.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.970+0000 7fb5f0e00640 1 -- 172.21.15.18:0/3648941682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5ec1025e0 con 0x7fb5ec102200 2024-09-13T16:50:14.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.972+0000 7fb5e3400640 1 -- 172.21.15.18:0/3648941682 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24402 (secure 0 0 0) 0x7fb5dc099ef0 con 0x7fb5ec102200 2024-09-13T16:50:14.974 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:50:14.974 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":91,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:50:13.636756+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:50:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 -- 172.21.15.18:0/3648941682 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5d00a1110 msgr2=0x7fb5d00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5d00a1110 0x7fb5d00a35d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec199a60 tx=0x7fb5d4005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 -- 172.21.15.18:0/3648941682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5ec102200 msgr2=0x7fb5ec1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5ec102200 0x7fb5ec1984b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00e9f0 tx=0x7fb5dc00edf0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 -- 172.21.15.18:0/3648941682 shutdown_connections 2024-09-13T16:50:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5d00a1110 0x7fb5d00a35d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5ec102bb0 0x7fb5ec1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb5ec107330 0x7fb5ec19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 --2- 172.21.15.18:0/3648941682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5ec102200 0x7fb5ec1984b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:14.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 -- 172.21.15.18:0/3648941682 >> 172.21.15.18:0/3648941682 conn(0x7fb5ec0fdc60 msgr2=0x7fb5ec0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:14.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 -- 172.21.15.18:0/3648941682 shutdown_connections 2024-09-13T16:50:14.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:14.974+0000 7fb5f0e00640 1 -- 172.21.15.18:0/3648941682 wait complete. 2024-09-13T16:50:15.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:14 smithi144 ceph-mon[35328]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T16:50:15.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:14 smithi144 ceph-mon[35328]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-13T16:50:15.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:15 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3648941682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:50:15.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:15 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3648941682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:50:16.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:15 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3648941682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:50:16.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T16:50:16.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T16:50:16.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T16:50:16.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T16:50:16.034 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T16:50:16.034 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T16:50:16.035 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-13T16:50:16.035 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-13T16:50:16.035 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-13T16:50:16.036 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-13T16:50:16.036 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-13T16:50:16.037 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-13T16:50:16.674 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:16 smithi018 ceph-mon[30981]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.2 KiB/s wr, 6 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T16:50:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:16 smithi144 ceph-mon[35328]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.2 KiB/s wr, 6 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T16:50:17.045 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.046 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.049 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.059 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.068 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.068 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:17.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:16 smithi094 ceph-mon[35259]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.2 KiB/s wr, 6 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T16:50:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:17 smithi094 ceph-mon[35259]: pgmap v324: 129 pgs: 2 peering, 127 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 5 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T16:50:18.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:17 smithi018 ceph-mon[30981]: pgmap v324: 129 pgs: 2 peering, 127 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 5 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T16:50:18.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:17 smithi144 ceph-mon[35328]: pgmap v324: 129 pgs: 2 peering, 127 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 5 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T16:50:20.110 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:19 smithi018 ceph-mon[30981]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 3 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T16:50:20.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:19 smithi094 ceph-mon[35259]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 3 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T16:50:20.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:19 smithi144 ceph-mon[35328]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 3 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T16:50:21.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:21 smithi018 ceph-mon[30981]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 336 B/s wr, 5 op/s; 6.5 KiB/s, 1 objects/s recovering 2024-09-13T16:50:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:22.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:21 smithi094 ceph-mon[35259]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 336 B/s wr, 5 op/s; 6.5 KiB/s, 1 objects/s recovering 2024-09-13T16:50:22.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:21 smithi144 ceph-mon[35328]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 336 B/s wr, 5 op/s; 6.5 KiB/s, 1 objects/s recovering 2024-09-13T16:50:24.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:23 smithi094 ceph-mon[35259]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 303 B/s wr, 5 op/s; 5.9 KiB/s, 1 objects/s recovering 2024-09-13T16:50:24.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:23 smithi018 ceph-mon[30981]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 303 B/s wr, 5 op/s; 5.9 KiB/s, 1 objects/s recovering 2024-09-13T16:50:24.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:23 smithi144 ceph-mon[35328]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 303 B/s wr, 5 op/s; 5.9 KiB/s, 1 objects/s recovering 2024-09-13T16:50:26.060 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:25 smithi018 ceph-mon[30981]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 5 op/s; 4.9 KiB/s, 1 objects/s recovering 2024-09-13T16:50:26.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:25 smithi094 ceph-mon[35259]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 5 op/s; 4.9 KiB/s, 1 objects/s recovering 2024-09-13T16:50:26.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:25 smithi144 ceph-mon[35328]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 5 op/s; 4.9 KiB/s, 1 objects/s recovering 2024-09-13T16:50:27.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.726+0000 7fe425a00640 1 -- 172.21.15.18:0/3482205164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe420075300 msgr2=0x7fe420110510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.726+0000 7fe425a00640 1 --2- 172.21.15.18:0/3482205164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe420075300 0x7fe420110510 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe408009900 tx=0x7fe40802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.726+0000 7fe425a00640 1 -- 172.21.15.18:0/3482205164 shutdown_connections 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.726+0000 7fe425a00640 1 --2- 172.21.15.18:0/3482205164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe420075300 0x7fe420110510 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.726+0000 7fe425a00640 1 --2- 172.21.15.18:0/3482205164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe420110a50 0x7fe420112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.726+0000 7fe425a00640 1 --2- 172.21.15.18:0/3482205164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4200749e0 0x7fe420074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.726+0000 7fe425a00640 1 -- 172.21.15.18:0/3482205164 >> 172.21.15.18:0/3482205164 conn(0x7fe4200fda70 msgr2=0x7fe4200ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.726+0000 7fe425a00640 1 -- 172.21.15.18:0/3482205164 shutdown_connections 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.726+0000 7fe425a00640 1 -- 172.21.15.18:0/3482205164 wait complete. 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.727+0000 7fe425a00640 1 Processor -- start 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.727+0000 7fe425a00640 1 -- start start 2024-09-13T16:50:27.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe425a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4200749e0 0x7fe4201a2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe425a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe420075300 0x7fe4201a2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe425a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe420110a50 0x7fe42019c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe425a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42019cb70 con 0x7fe420075300 2024-09-13T16:50:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe425a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42019cce0 con 0x7fe420110a50 2024-09-13T16:50:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe425a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42019cea0 con 0x7fe4200749e0 2024-09-13T16:50:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe417e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe420075300 0x7fe4201a2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe417e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe420075300 0x7fe4201a2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59726/0 (socket says 172.21.15.18:59726) 2024-09-13T16:50:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe417e00640 1 -- 172.21.15.18:0/3921658734 learned_addr learned my addr 172.21.15.18:0/3921658734 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe41fe00640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4200749e0 0x7fe4201a2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.728+0000 7fe425000640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe420110a50 0x7fe42019c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe417e00640 1 -- 172.21.15.18:0/3921658734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4200749e0 msgr2=0x7fe4201a2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe417e00640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4200749e0 0x7fe4201a2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe417e00640 1 -- 172.21.15.18:0/3921658734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe420110a50 msgr2=0x7fe42019c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe417e00640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe420110a50 0x7fe42019c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe417e00640 1 -- 172.21.15.18:0/3921658734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408009560 con 0x7fe420075300 2024-09-13T16:50:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe417e00640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe420075300 0x7fe4201a2960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe408031440 tx=0x7fe408003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe41d600640 1 -- 172.21.15.18:0/3921658734 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408003e00 con 0x7fe420075300 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe41d600640 1 -- 172.21.15.18:0/3921658734 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4080054e0 con 0x7fe420075300 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42019d120 con 0x7fe420075300 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe41d600640 1 -- 172.21.15.18:0/3921658734 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408031910 con 0x7fe420075300 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.729+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42019d3f0 con 0x7fe420075300 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.730+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe420076120 con 0x7fe420075300 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.732+0000 7fe41d600640 1 -- 172.21.15.18:0/3921658734 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe4080046c0 con 0x7fe420075300 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.733+0000 7fe41d600640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4040a1100 0x7fe4040a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.734+0000 7fe41d600640 1 -- 172.21.15.18:0/3921658734 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe4080edac0 con 0x7fe420075300 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.734+0000 7fe41fe00640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4040a1100 0x7fe4040a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.734+0000 7fe41d600640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] conn(0x7fe4040ac190 0x7fe4040ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.734+0000 7fe41d600640 1 -- 172.21.15.18:0/3921658734 --> [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4040aed00 con 0x7fe4040ac190 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.734+0000 7fe41d600640 1 -- 172.21.15.18:0/3921658734 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4080ede30 con 0x7fe420075300 2024-09-13T16:50:27.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.734+0000 7fe41fe00640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4040a1100 0x7fe4040a35c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe410005fd0 tx=0x7fe41000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.734+0000 7fe425000640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] conn(0x7fe4040ac190 0x7fe4040ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.735+0000 7fe425000640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] conn(0x7fe4040ac190 0x7fe4040ae630 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.736+0000 7fe41d600640 1 -- 172.21.15.18:0/3921658734 <== osd.8 v2:172.21.15.144:6816/4258945385 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe4040aed00 con 0x7fe4040ac190 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.752+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 --> [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe420060b30 con 0x7fe4040ac190 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe41d600640 1 -- 172.21.15.18:0/3921658734 <== osd.8 v2:172.21.15.144:6816/4258945385 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe420060b30 con 0x7fe4040ac190 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 >> [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] conn(0x7fe4040ac190 msgr2=0x7fe4040ae630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425a00640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] conn(0x7fe4040ac190 0x7fe4040ae630 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4040a1100 msgr2=0x7fe4040a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425a00640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4040a1100 0x7fe4040a35c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe410005fd0 tx=0x7fe41000b390 comp rx=0 tx=0).stop 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe420075300 msgr2=0x7fe4201a2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425a00640 1 --2- 172.21.15.18:0/3921658734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe420075300 0x7fe4201a2960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe408031440 tx=0x7fe408003c10 comp rx=0 tx=0).stop 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425000640 1 -- 172.21.15.18:0/3921658734 reap_dead start 2024-09-13T16:50:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 shutdown_connections 2024-09-13T16:50:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 >> 172.21.15.18:0/3921658734 conn(0x7fe4200fda70 msgr2=0x7fe4200ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 shutdown_connections 2024-09-13T16:50:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:27.753+0000 7fe425a00640 1 -- 172.21.15.18:0/3921658734 wait complete. 2024-09-13T16:50:28.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:27 smithi094 ceph-mon[35259]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T16:50:28.201 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:27 smithi018 ceph-mon[30981]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T16:50:28.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:27 smithi144 ceph-mon[35328]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T16:50:29.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:28 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:50:29.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:28 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:50:29.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:28 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:50:29.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.314+0000 7fea31a00640 1 -- 172.21.15.18:0/2086443577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2c102010 msgr2=0x7fea2c1023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:29.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.314+0000 7fea31a00640 1 --2- 172.21.15.18:0/2086443577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2c102010 0x7fea2c1023f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009930 tx=0x7fea1c02a440 comp rx=0 tx=0).stop 2024-09-13T16:50:29.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.314+0000 7fea31a00640 1 -- 172.21.15.18:0/2086443577 shutdown_connections 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.314+0000 7fea31a00640 1 --2- 172.21.15.18:0/2086443577 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea2c107140 0x7fea2c10ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.314+0000 7fea31a00640 1 --2- 172.21.15.18:0/2086443577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea2c1029c0 0x7fea2c106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.314+0000 7fea31a00640 1 --2- 172.21.15.18:0/2086443577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2c102010 0x7fea2c1023f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.314+0000 7fea31a00640 1 -- 172.21.15.18:0/2086443577 >> 172.21.15.18:0/2086443577 conn(0x7fea2c0fda70 msgr2=0x7fea2c0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.314+0000 7fea31a00640 1 -- 172.21.15.18:0/2086443577 shutdown_connections 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.315+0000 7fea31a00640 1 -- 172.21.15.18:0/2086443577 wait complete. 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.316+0000 7fea31a00640 1 Processor -- start 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.316+0000 7fea31a00640 1 -- start start 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.316+0000 7fea31a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea2c102010 0x7fea2c1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.316+0000 7fea31a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2c1029c0 0x7fea2c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.316+0000 7fea31a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea2c107140 0x7fea2c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.316+0000 7fea31a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c19d200 con 0x7fea2c1029c0 2024-09-13T16:50:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.316+0000 7fea31a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c19d370 con 0x7fea2c107140 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.316+0000 7fea31a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c19d4e0 con 0x7fea2c102010 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea23400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2c1029c0 0x7fea2c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea2be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea2c102010 0x7fea2c1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea23400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2c1029c0 0x7fea2c198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59744/0 (socket says 172.21.15.18:59744) 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea23400640 1 -- 172.21.15.18:0/1422424694 learned_addr learned my addr 172.21.15.18:0/1422424694 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea31000640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea2c107140 0x7fea2c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea23400640 1 -- 172.21.15.18:0/1422424694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea2c102010 msgr2=0x7fea2c1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea23400640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea2c102010 0x7fea2c1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea23400640 1 -- 172.21.15.18:0/1422424694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea2c107140 msgr2=0x7fea2c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea23400640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea2c107140 0x7fea2c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea23400640 1 -- 172.21.15.18:0/1422424694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c009560 con 0x7fea2c1029c0 2024-09-13T16:50:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.317+0000 7fea2be00640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea2c102010 0x7fea2c1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:50:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.318+0000 7fea23400640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2c1029c0 0x7fea2c198800 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea1400e9f0 tx=0x7fea1400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.318+0000 7fea29600640 1 -- 172.21.15.18:0/1422424694 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14009720 con 0x7fea2c1029c0 2024-09-13T16:50:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.318+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2c19d7c0 con 0x7fea2c1029c0 2024-09-13T16:50:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.318+0000 7fea29600640 1 -- 172.21.15.18:0/1422424694 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea1400cd80 con 0x7fea2c1029c0 2024-09-13T16:50:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.318+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2c1a5080 con 0x7fea2c1029c0 2024-09-13T16:50:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.318+0000 7fea29600640 1 -- 172.21.15.18:0/1422424694 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14018630 con 0x7fea2c1029c0 2024-09-13T16:50:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.319+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea2c1034f0 con 0x7fea2c1029c0 2024-09-13T16:50:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.321+0000 7fea29600640 1 -- 172.21.15.18:0/1422424694 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fea14004e00 con 0x7fea2c1029c0 2024-09-13T16:50:29.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.322+0000 7fea29600640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fea100a1100 0x7fea100a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:29.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.322+0000 7fea29600640 1 -- 172.21.15.18:0/1422424694 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fea14014070 con 0x7fea2c1029c0 2024-09-13T16:50:29.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.322+0000 7fea2be00640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fea100a1100 0x7fea100a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:29.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.323+0000 7fea29600640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] conn(0x7fea100ac190 0x7fea100ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:29.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.323+0000 7fea29600640 1 -- 172.21.15.18:0/1422424694 --> [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea100aed00 con 0x7fea100ac190 2024-09-13T16:50:29.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.323+0000 7fea29600640 1 -- 172.21.15.18:0/1422424694 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea140cdd20 con 0x7fea2c1029c0 2024-09-13T16:50:29.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.323+0000 7fea31000640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] conn(0x7fea100ac190 0x7fea100ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:29.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.323+0000 7fea2be00640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fea100a1100 0x7fea100a35c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fea1c031440 tx=0x7fea1c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:29.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.324+0000 7fea31000640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] conn(0x7fea100ac190 0x7fea100ae630 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:29.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.324+0000 7fea29600640 1 -- 172.21.15.18:0/1422424694 <== osd.10 v2:172.21.15.94:6824/896296327 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fea100aed00 con 0x7fea100ac190 2024-09-13T16:50:29.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.338+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 --> [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea2c060b70 con 0x7fea100ac190 2024-09-13T16:50:29.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.339+0000 7fea29600640 1 -- 172.21.15.18:0/1422424694 <== osd.10 v2:172.21.15.94:6824/896296327 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fea2c060b70 con 0x7fea100ac190 2024-09-13T16:50:29.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.339+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 >> [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] conn(0x7fea100ac190 msgr2=0x7fea100ae630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:29.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.339+0000 7fea31a00640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] conn(0x7fea100ac190 0x7fea100ae630 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:29.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.339+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fea100a1100 msgr2=0x7fea100a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:29.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.339+0000 7fea31a00640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fea100a1100 0x7fea100a35c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fea1c031440 tx=0x7fea1c005a20 comp rx=0 tx=0).stop 2024-09-13T16:50:29.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.339+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2c1029c0 msgr2=0x7fea2c198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:29.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.339+0000 7fea31a00640 1 --2- 172.21.15.18:0/1422424694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2c1029c0 0x7fea2c198800 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea1400e9f0 tx=0x7fea1400edf0 comp rx=0 tx=0).stop 2024-09-13T16:50:29.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.339+0000 7fea31000640 1 -- 172.21.15.18:0/1422424694 reap_dead start 2024-09-13T16:50:29.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.340+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 shutdown_connections 2024-09-13T16:50:29.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.340+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 >> 172.21.15.18:0/1422424694 conn(0x7fea2c0fda70 msgr2=0x7fea2c0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:29.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.340+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 shutdown_connections 2024-09-13T16:50:29.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:28.340+0000 7fea31a00640 1 -- 172.21.15.18:0/1422424694 wait complete. 2024-09-13T16:50:30.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:30 smithi018 ceph-mon[30981]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:50:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:30 smithi094 ceph-mon[35259]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:50:30.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:50:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:30 smithi144 ceph-mon[35328]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:50:31.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:31 smithi018 ceph-mon[30981]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:50:32.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:31 smithi094 ceph-mon[35259]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:50:32.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:31 smithi144 ceph-mon[35328]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:50:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.010+0000 7ff8a7800640 1 -- 172.21.15.18:0/3727700654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8a0073170 msgr2=0x7ff8a0110860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.010+0000 7ff8a7800640 1 --2- 172.21.15.18:0/3727700654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8a0073170 0x7ff8a0110860 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009900 tx=0x7ff88c02a480 comp rx=0 tx=0).stop 2024-09-13T16:50:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.011+0000 7ff8a7800640 1 -- 172.21.15.18:0/3727700654 shutdown_connections 2024-09-13T16:50:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.011+0000 7ff8a7800640 1 --2- 172.21.15.18:0/3727700654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8a0073170 0x7ff8a0110860 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.011+0000 7ff8a7800640 1 --2- 172.21.15.18:0/3727700654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a0110da0 0x7ff8a0113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.011+0000 7ff8a7800640 1 --2- 172.21.15.18:0/3727700654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a0072850 0x7ff8a0072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.011+0000 7ff8a7800640 1 -- 172.21.15.18:0/3727700654 >> 172.21.15.18:0/3727700654 conn(0x7ff8a00fba90 msgr2=0x7ff8a00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.011+0000 7ff8a7800640 1 -- 172.21.15.18:0/3727700654 shutdown_connections 2024-09-13T16:50:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.011+0000 7ff8a7800640 1 -- 172.21.15.18:0/3727700654 wait complete. 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a7800640 1 Processor -- start 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a7800640 1 -- start start 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a7800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8a0072850 0x7ff8a01a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a7800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a0073170 0x7ff8a01a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a7800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a0110da0 0x7ff8a019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a7800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a019ce60 con 0x7ff8a0072850 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a7800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a019cfd0 con 0x7ff8a0110da0 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a7800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a019d190 con 0x7ff8a0073170 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8a0072850 0x7ff8a01a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8a0072850 0x7ff8a01a2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46794/0 (socket says 172.21.15.18:46794) 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a4e00640 1 -- 172.21.15.18:0/3104166376 learned_addr learned my addr 172.21.15.18:0/3104166376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff89fe00640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a0073170 0x7ff8a01a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.012+0000 7ff8a5800640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a0110da0 0x7ff8a019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:32.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.013+0000 7ff89fe00640 1 -- 172.21.15.18:0/3104166376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a0110da0 msgr2=0x7ff8a019c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:32.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.013+0000 7ff89fe00640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a0110da0 0x7ff8a019c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:32.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.013+0000 7ff89fe00640 1 -- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8a0072850 msgr2=0x7ff8a01a2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:32.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.013+0000 7ff89fe00640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8a0072850 0x7ff8a01a2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:32.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.013+0000 7ff89fe00640 1 -- 172.21.15.18:0/3104166376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c009560 con 0x7ff8a0073170 2024-09-13T16:50:32.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.014+0000 7ff89fe00640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a0073170 0x7ff8a01a2bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff88c02aa70 tx=0x7ff88c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:32.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.014+0000 7ff89d600640 1 -- 172.21.15.18:0/3104166376 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c005d50 con 0x7ff8a0073170 2024-09-13T16:50:32.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.014+0000 7ff89d600640 1 -- 172.21.15.18:0/3104166376 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff88c003e00 con 0x7ff8a0073170 2024-09-13T16:50:32.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.014+0000 7ff89d600640 1 -- 172.21.15.18:0/3104166376 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c03ba90 con 0x7ff8a0073170 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.014+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a019d410 con 0x7ff8a0073170 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.014+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a01a9660 con 0x7ff8a0073170 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.015+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8a0116700 con 0x7ff8a0073170 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.019+0000 7ff89d600640 1 -- 172.21.15.18:0/3104166376 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff88c03bbf0 con 0x7ff8a0073170 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.020+0000 7ff89d600640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff8880a1190 0x7ff8880a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.021+0000 7ff89d600640 1 -- 172.21.15.18:0/3104166376 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff88c0ed670 con 0x7ff8a0073170 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.021+0000 7ff89d600640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] conn(0x7ff8880ac220 0x7ff8880ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.021+0000 7ff89d600640 1 -- 172.21.15.18:0/3104166376 --> [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8880aed90 con 0x7ff8880ac220 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.021+0000 7ff89d600640 1 -- 172.21.15.18:0/3104166376 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff88c0eda80 con 0x7ff8a0073170 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.021+0000 7ff8a4e00640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff8880a1190 0x7ff8880a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.022+0000 7ff8a5800640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] conn(0x7ff8880ac220 0x7ff8880ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.022+0000 7ff8a4e00640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff8880a1190 0x7ff8880a3650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff894009c90 tx=0x7ff894005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:32.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.023+0000 7ff8a5800640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] conn(0x7ff8880ac220 0x7ff8880ae6c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:32.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.024+0000 7ff89d600640 1 -- 172.21.15.18:0/3104166376 <== osd.6 v2:172.21.15.18:6818/1300118017 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff8880aed90 con 0x7ff8880ac220 2024-09-13T16:50:32.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.039+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 --> [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff8a0073f90 con 0x7ff8880ac220 2024-09-13T16:50:32.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.039+0000 7ff89d600640 1 -- 172.21.15.18:0/3104166376 <== osd.6 v2:172.21.15.18:6818/1300118017 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff8a0073f90 con 0x7ff8880ac220 2024-09-13T16:50:32.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.039+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] conn(0x7ff8880ac220 msgr2=0x7ff8880ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:32.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.039+0000 7ff8a7800640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] conn(0x7ff8880ac220 0x7ff8880ae6c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.040+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff8880a1190 msgr2=0x7ff8880a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.040+0000 7ff8a7800640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff8880a1190 0x7ff8880a3650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff894009c90 tx=0x7ff894005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.040+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a0073170 msgr2=0x7ff8a01a2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.040+0000 7ff8a7800640 1 --2- 172.21.15.18:0/3104166376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a0073170 0x7ff8a01a2bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff88c02aa70 tx=0x7ff88c003c10 comp rx=0 tx=0).stop 2024-09-13T16:50:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.040+0000 7ff8a5800640 1 -- 172.21.15.18:0/3104166376 reap_dead start 2024-09-13T16:50:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.040+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 shutdown_connections 2024-09-13T16:50:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.040+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 >> 172.21.15.18:0/3104166376 conn(0x7ff8a00fba90 msgr2=0x7ff8a00fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.040+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 shutdown_connections 2024-09-13T16:50:32.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:32.040+0000 7ff8a7800640 1 -- 172.21.15.18:0/3104166376 wait complete. 2024-09-13T16:50:33.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.705+0000 7f6bc5600640 1 -- 172.21.15.18:0/4010207724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bc010c460 msgr2=0x7f6bc010e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:33.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.705+0000 7f6bc5600640 1 --2- 172.21.15.18:0/4010207724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bc010c460 0x7f6bc010e850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009ca0 tx=0x7f6bb802a950 comp rx=0 tx=0).stop 2024-09-13T16:50:33.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.705+0000 7f6bc5600640 1 -- 172.21.15.18:0/4010207724 shutdown_connections 2024-09-13T16:50:33.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.705+0000 7f6bc5600640 1 --2- 172.21.15.18:0/4010207724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bc010c460 0x7f6bc010e850 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:33.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.705+0000 7f6bc5600640 1 --2- 172.21.15.18:0/4010207724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bc00731a0 0x7f6bc010bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:33.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.705+0000 7f6bc5600640 1 --2- 172.21.15.18:0/4010207724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc0072880 0x7f6bc0072c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:33.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.705+0000 7f6bc5600640 1 -- 172.21.15.18:0/4010207724 >> 172.21.15.18:0/4010207724 conn(0x7f6bc00fb900 msgr2=0x7f6bc00fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:33.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.705+0000 7f6bc5600640 1 -- 172.21.15.18:0/4010207724 shutdown_connections 2024-09-13T16:50:33.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.706+0000 7f6bc5600640 1 -- 172.21.15.18:0/4010207724 wait complete. 2024-09-13T16:50:33.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.707+0000 7f6bc5600640 1 Processor -- start 2024-09-13T16:50:33.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.707+0000 7f6bc5600640 1 -- start start 2024-09-13T16:50:33.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bc5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bc0072880 0x7f6bc01982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:33.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bc5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bc00731a0 0x7f6bc0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:33.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bc5600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc010c460 0x7f6bc019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:33.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bc5600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc019d220 con 0x7f6bc00731a0 2024-09-13T16:50:33.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bc5600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc019d390 con 0x7f6bc010c460 2024-09-13T16:50:33.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bc5600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc019d500 con 0x7f6bc0072880 2024-09-13T16:50:33.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bbf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bc00731a0 0x7f6bc0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:33.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bbf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bc00731a0 0x7f6bc0198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46812/0 (socket says 172.21.15.18:46812) 2024-09-13T16:50:33.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bbf400640 1 -- 172.21.15.18:0/729306061 learned_addr learned my addr 172.21.15.18:0/729306061 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:33.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bbfe00640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bc0072880 0x7f6bc01982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:33.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.708+0000 7f6bc4c00640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc010c460 0x7f6bc019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:33.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.709+0000 7f6bbf400640 1 -- 172.21.15.18:0/729306061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bc0072880 msgr2=0x7f6bc01982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:33.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.709+0000 7f6bbf400640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bc0072880 0x7f6bc01982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:33.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.709+0000 7f6bbf400640 1 -- 172.21.15.18:0/729306061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc010c460 msgr2=0x7f6bc019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:33.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.709+0000 7f6bbf400640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc010c460 0x7f6bc019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:33.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.709+0000 7f6bbf400640 1 -- 172.21.15.18:0/729306061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8009900 con 0x7f6bc00731a0 2024-09-13T16:50:33.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.709+0000 7f6bbf400640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bc00731a0 0x7f6bc0198820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00e9f0 tx=0x7f6bac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:33.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.710+0000 7f6bbcc00640 1 -- 172.21.15.18:0/729306061 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac009720 con 0x7f6bc00731a0 2024-09-13T16:50:33.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.710+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc019d7e0 con 0x7f6bc00731a0 2024-09-13T16:50:33.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.710+0000 7f6bbcc00640 1 -- 172.21.15.18:0/729306061 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bac00cd80 con 0x7f6bc00731a0 2024-09-13T16:50:33.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.710+0000 7f6bbcc00640 1 -- 172.21.15.18:0/729306061 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac010430 con 0x7f6bc00731a0 2024-09-13T16:50:33.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.710+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc01a50a0 con 0x7f6bc00731a0 2024-09-13T16:50:33.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.711+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6bc0073f30 con 0x7f6bc00731a0 2024-09-13T16:50:33.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.714+0000 7f6bbcc00640 1 -- 172.21.15.18:0/729306061 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6bac005000 con 0x7f6bc00731a0 2024-09-13T16:50:33.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.715+0000 7f6bbcc00640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6ba40a1180 0x7f6ba40a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:33.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.716+0000 7f6bbcc00640 1 -- 172.21.15.18:0/729306061 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6bac014070 con 0x7f6bc00731a0 2024-09-13T16:50:33.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.716+0000 7f6bbcc00640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] conn(0x7f6ba40ac210 0x7f6ba40ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:33.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.716+0000 7f6bbcc00640 1 -- 172.21.15.18:0/729306061 --> [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ba40aed80 con 0x7f6ba40ac210 2024-09-13T16:50:33.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.716+0000 7f6bbcc00640 1 -- 172.21.15.18:0/729306061 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bac0cd660 con 0x7f6bc00731a0 2024-09-13T16:50:33.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.716+0000 7f6bbfe00640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6ba40a1180 0x7f6ba40a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:33.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.717+0000 7f6bc4c00640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] conn(0x7f6ba40ac210 0x7f6ba40ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:33.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.717+0000 7f6bc4c00640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] conn(0x7f6ba40ac210 0x7f6ba40ae6b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:33.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.717+0000 7f6bbfe00640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6ba40a1180 0x7f6ba40a3640 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009bd0 tx=0x7f6bb0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:33.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.719+0000 7f6bbcc00640 1 -- 172.21.15.18:0/729306061 <== osd.0 v2:172.21.15.18:6802/2385031914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6ba40aed80 con 0x7f6ba40ac210 2024-09-13T16:50:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.734+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 --> [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6bc0060b30 con 0x7f6ba40ac210 2024-09-13T16:50:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.735+0000 7f6bbcc00640 1 -- 172.21.15.18:0/729306061 <== osd.0 v2:172.21.15.18:6802/2385031914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6bc0060b30 con 0x7f6ba40ac210 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.735+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] conn(0x7f6ba40ac210 msgr2=0x7f6ba40ae6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.735+0000 7f6bc5600640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] conn(0x7f6ba40ac210 0x7f6ba40ae6b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.736+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6ba40a1180 msgr2=0x7f6ba40a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.736+0000 7f6bc5600640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6ba40a1180 0x7f6ba40a3640 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009bd0 tx=0x7f6bb0005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.736+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bc00731a0 msgr2=0x7f6bc0198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.736+0000 7f6bc5600640 1 --2- 172.21.15.18:0/729306061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bc00731a0 0x7f6bc0198820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00e9f0 tx=0x7f6bac00edf0 comp rx=0 tx=0).stop 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.736+0000 7f6bc4c00640 1 -- 172.21.15.18:0/729306061 reap_dead start 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.736+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 shutdown_connections 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.736+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 >> 172.21.15.18:0/729306061 conn(0x7f6bc00fb900 msgr2=0x7f6bc00fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.736+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 shutdown_connections 2024-09-13T16:50:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:33.736+0000 7f6bc5600640 1 -- 172.21.15.18:0/729306061 wait complete. 2024-09-13T16:50:34.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:33 smithi018 ceph-mon[30981]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:34.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:33 smithi094 ceph-mon[35259]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:34.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:33 smithi144 ceph-mon[35328]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:35.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.748+0000 7f0e00a00640 1 -- 172.21.15.18:0/3713232596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc102bb0 msgr2=0x7f0dfc106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:35.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.748+0000 7f0e00a00640 1 --2- 172.21.15.18:0/3713232596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc102bb0 0x7f0dfc106c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009900 tx=0x7f0de402a410 comp rx=0 tx=0).stop 2024-09-13T16:50:35.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.748+0000 7f0e00a00640 1 -- 172.21.15.18:0/3713232596 shutdown_connections 2024-09-13T16:50:35.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.748+0000 7f0e00a00640 1 --2- 172.21.15.18:0/3713232596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc107330 0x7f0dfc10eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:35.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.748+0000 7f0e00a00640 1 --2- 172.21.15.18:0/3713232596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc102bb0 0x7f0dfc106c00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:35.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.748+0000 7f0e00a00640 1 --2- 172.21.15.18:0/3713232596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dfc102200 0x7f0dfc1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:35.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.748+0000 7f0e00a00640 1 -- 172.21.15.18:0/3713232596 >> 172.21.15.18:0/3713232596 conn(0x7f0dfc0fdc60 msgr2=0x7f0dfc100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:35.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.748+0000 7f0e00a00640 1 -- 172.21.15.18:0/3713232596 shutdown_connections 2024-09-13T16:50:35.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.748+0000 7f0e00a00640 1 -- 172.21.15.18:0/3713232596 wait complete. 2024-09-13T16:50:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.749+0000 7f0e00a00640 1 Processor -- start 2024-09-13T16:50:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.749+0000 7f0e00a00640 1 -- start start 2024-09-13T16:50:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0e00a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dfc102200 0x7f0dfc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0e00a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc102bb0 0x7f0dfc198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0e00a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc107330 0x7f0dfc19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0e00a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc19d3f0 con 0x7f0dfc107330 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0e00a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc19d560 con 0x7f0dfc102200 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0e00a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc19d6d0 con 0x7f0dfc102bb0 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0dfa800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc107330 0x7f0dfc19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0df3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc102bb0 0x7f0dfc198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0df3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc102bb0 0x7f0dfc198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:47342/0 (socket says 172.21.15.18:47342) 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0df3e00640 1 -- 172.21.15.18:0/1614048316 learned_addr learned my addr 172.21.15.18:0/1614048316 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.750+0000 7f0df9e00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dfc102200 0x7f0dfc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0df3e00640 1 -- 172.21.15.18:0/1614048316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dfc102200 msgr2=0x7f0dfc198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0df3e00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0dfc102200 0x7f0dfc198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0df3e00640 1 -- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc107330 msgr2=0x7f0dfc19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0df3e00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc107330 0x7f0dfc19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0df3e00640 1 -- 172.21.15.18:0/1614048316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de4009560 con 0x7f0dfc102bb0 2024-09-13T16:50:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0dfa800640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc107330 0x7f0dfc19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:50:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0df3e00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc102bb0 0x7f0dfc198a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0de4006010 tx=0x7f0de4005600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0df2a00640 1 -- 172.21.15.18:0/1614048316 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4004b50 con 0x7f0dfc102bb0 2024-09-13T16:50:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc19d950 con 0x7f0dfc102bb0 2024-09-13T16:50:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0df2a00640 1 -- 172.21.15.18:0/1614048316 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0de4004cb0 con 0x7f0dfc102bb0 2024-09-13T16:50:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.751+0000 7f0df2a00640 1 -- 172.21.15.18:0/1614048316 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de403c930 con 0x7f0dfc102bb0 2024-09-13T16:50:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.752+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc19dc70 con 0x7f0dfc102bb0 2024-09-13T16:50:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.752+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0dfc1036e0 con 0x7f0dfc102bb0 2024-09-13T16:50:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.755+0000 7f0df2a00640 1 -- 172.21.15.18:0/1614048316 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0de40035f0 con 0x7f0dfc102bb0 2024-09-13T16:50:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.756+0000 7f0df2a00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0de00a1190 0x7f0de00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.756+0000 7f0df2a00640 1 -- 172.21.15.18:0/1614048316 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0de40edec0 con 0x7f0dfc102bb0 2024-09-13T16:50:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.756+0000 7f0df9e00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0de00a1190 0x7f0de00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.756+0000 7f0df2a00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] conn(0x7f0de00ac220 0x7f0de00ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.756+0000 7f0df2a00640 1 -- 172.21.15.18:0/1614048316 --> [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0de00aed90 con 0x7f0de00ac220 2024-09-13T16:50:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.756+0000 7f0df2a00640 1 -- 172.21.15.18:0/1614048316 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0de40ee230 con 0x7f0dfc102bb0 2024-09-13T16:50:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.757+0000 7f0dfa800640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] conn(0x7f0de00ac220 0x7f0de00ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.757+0000 7f0df9e00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0de00a1190 0x7f0de00a3650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009bd0 tx=0x7f0dec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.757+0000 7f0dfa800640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] conn(0x7f0de00ac220 0x7f0de00ae6c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.758+0000 7f0df2a00640 1 -- 172.21.15.18:0/1614048316 <== osd.3 v2:172.21.15.18:6810/4196858312 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0de00aed90 con 0x7f0de00ac220 2024-09-13T16:50:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.772+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 --> [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0dfc060b30 con 0x7f0de00ac220 2024-09-13T16:50:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0df2a00640 1 -- 172.21.15.18:0/1614048316 <== osd.3 v2:172.21.15.18:6810/4196858312 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0dfc060b30 con 0x7f0de00ac220 2024-09-13T16:50:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] conn(0x7f0de00ac220 msgr2=0x7f0de00ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0e00a00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] conn(0x7f0de00ac220 0x7f0de00ae6c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0de00a1190 msgr2=0x7f0de00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0e00a00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0de00a1190 0x7f0de00a3650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009bd0 tx=0x7f0dec005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc102bb0 msgr2=0x7f0dfc198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0e00a00640 1 --2- 172.21.15.18:0/1614048316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc102bb0 0x7f0dfc198a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0de4006010 tx=0x7f0de4005600 comp rx=0 tx=0).stop 2024-09-13T16:50:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0dfa800640 1 -- 172.21.15.18:0/1614048316 reap_dead start 2024-09-13T16:50:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 shutdown_connections 2024-09-13T16:50:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 >> 172.21.15.18:0/1614048316 conn(0x7f0dfc0fdc60 msgr2=0x7f0dfc0ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 shutdown_connections 2024-09-13T16:50:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:35.773+0000 7f0e00a00640 1 -- 172.21.15.18:0/1614048316 wait complete. 2024-09-13T16:50:36.082 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:35 smithi018 ceph-mon[30981]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:36.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:35 smithi094 ceph-mon[35259]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:36.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.198+0000 7f9fa0a00640 1 -- 172.21.15.18:0/3815289634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f9c10c450 msgr2=0x7f9f9c10e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.198+0000 7f9fa0a00640 1 --2- 172.21.15.18:0/3815289634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f9c10c450 0x7f9f9c10e840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009ca0 tx=0x7f9f9402a950 comp rx=0 tx=0).stop 2024-09-13T16:50:36.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.198+0000 7f9fa0a00640 1 -- 172.21.15.18:0/3815289634 shutdown_connections 2024-09-13T16:50:36.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.198+0000 7f9fa0a00640 1 --2- 172.21.15.18:0/3815289634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f9c10c450 0x7f9f9c10e840 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.198+0000 7f9fa0a00640 1 --2- 172.21.15.18:0/3815289634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f9c0731a0 0x7f9f9c10bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.198+0000 7f9fa0a00640 1 --2- 172.21.15.18:0/3815289634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f9c072880 0x7f9f9c072c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.198+0000 7f9fa0a00640 1 -- 172.21.15.18:0/3815289634 >> 172.21.15.18:0/3815289634 conn(0x7f9f9c0fb870 msgr2=0x7f9f9c0fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:36.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.198+0000 7f9fa0a00640 1 -- 172.21.15.18:0/3815289634 shutdown_connections 2024-09-13T16:50:36.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.199+0000 7f9fa0a00640 1 -- 172.21.15.18:0/3815289634 wait complete. 2024-09-13T16:50:36.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.199+0000 7f9fa0a00640 1 Processor -- start 2024-09-13T16:50:36.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9fa0a00640 1 -- start start 2024-09-13T16:50:36.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9fa0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f9c072880 0x7f9f9c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:36.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9fa0a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f9c0731a0 0x7f9f9c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:36.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9fa0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f9c10c450 0x7f9f9c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:36.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9fa0a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c19d210 con 0x7f9f9c072880 2024-09-13T16:50:36.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9fa0a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c19d380 con 0x7f9f9c0731a0 2024-09-13T16:50:36.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9fa0a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c19d4f0 con 0x7f9f9c10c450 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9f9a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f9c072880 0x7f9f9c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9f9a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f9c072880 0x7f9f9c198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46868/0 (socket says 172.21.15.18:46868) 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9f9a800640 1 -- 172.21.15.18:0/2311240540 learned_addr learned my addr 172.21.15.18:0/2311240540 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.200+0000 7f9f99e00640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f9c0731a0 0x7f9f9c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.201+0000 7f9f9b200640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f9c10c450 0x7f9f9c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.201+0000 7f9f99e00640 1 -- 172.21.15.18:0/2311240540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f9c10c450 msgr2=0x7f9f9c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.201+0000 7f9f99e00640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f9c10c450 0x7f9f9c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.201+0000 7f9f99e00640 1 -- 172.21.15.18:0/2311240540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f9c072880 msgr2=0x7f9f9c198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.201+0000 7f9f99e00640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f9c072880 0x7f9f9c198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.201+0000 7f9f99e00640 1 -- 172.21.15.18:0/2311240540 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94009900 con 0x7f9f9c0731a0 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.201+0000 7f9f9a800640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f9c072880 0x7f9f9c198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.201+0000 7f9f99e00640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f9c0731a0 0x7f9f9c198860 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800e9f0 tx=0x7f9f8800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:36.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.201+0000 7f9f93400640 1 -- 172.21.15.18:0/2311240540 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800ccc0 con 0x7f9f9c0731a0 2024-09-13T16:50:36.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.202+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c19d7d0 con 0x7f9f9c0731a0 2024-09-13T16:50:36.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.202+0000 7f9f93400640 1 -- 172.21.15.18:0/2311240540 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f8800ce20 con 0x7f9f9c0731a0 2024-09-13T16:50:36.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.202+0000 7f9f93400640 1 -- 172.21.15.18:0/2311240540 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f880187c0 con 0x7f9f9c0731a0 2024-09-13T16:50:36.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.202+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c1a5090 con 0x7f9f9c0731a0 2024-09-13T16:50:36.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.203+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f9c073f30 con 0x7f9f9c0731a0 2024-09-13T16:50:36.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.205+0000 7f9f93400640 1 -- 172.21.15.18:0/2311240540 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9f88010430 con 0x7f9f9c0731a0 2024-09-13T16:50:36.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.207+0000 7f9f93400640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f800a1100 0x7f9f800a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:36.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.207+0000 7f9f93400640 1 -- 172.21.15.18:0/2311240540 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9f88014070 con 0x7f9f9c0731a0 2024-09-13T16:50:36.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.207+0000 7f9f9a800640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f800a1100 0x7f9f800a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:36.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.207+0000 7f9f93400640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] conn(0x7f9f800ac190 0x7f9f800ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:36.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.207+0000 7f9f93400640 1 -- 172.21.15.18:0/2311240540 --> [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f800aed00 con 0x7f9f800ac190 2024-09-13T16:50:36.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.207+0000 7f9f93400640 1 -- 172.21.15.18:0/2311240540 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f880cda20 con 0x7f9f9c0731a0 2024-09-13T16:50:36.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.208+0000 7f9f9b200640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] conn(0x7f9f800ac190 0x7f9f800ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:36.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.208+0000 7f9f9a800640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f800a1100 0x7f9f800a35c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c011500 tx=0x7f9f8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:36.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.208+0000 7f9f9b200640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] conn(0x7f9f800ac190 0x7f9f800ae630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:36.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.209+0000 7f9f93400640 1 -- 172.21.15.18:0/2311240540 <== osd.5 v2:172.21.15.144:6808/890873206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9f800aed00 con 0x7f9f800ac190 2024-09-13T16:50:36.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.223+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 --> [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f9c060b30 con 0x7f9f800ac190 2024-09-13T16:50:36.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9f93400640 1 -- 172.21.15.18:0/2311240540 <== osd.5 v2:172.21.15.144:6808/890873206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9f9c060b30 con 0x7f9f800ac190 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 >> [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] conn(0x7f9f800ac190 msgr2=0x7f9f800ae630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9fa0a00640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] conn(0x7f9f800ac190 0x7f9f800ae630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f800a1100 msgr2=0x7f9f800a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9fa0a00640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f800a1100 0x7f9f800a35c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c011500 tx=0x7f9f8c005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f9c0731a0 msgr2=0x7f9f9c198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9fa0a00640 1 --2- 172.21.15.18:0/2311240540 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f9c0731a0 0x7f9f9c198860 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800e9f0 tx=0x7f9f8800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9f9b200640 1 -- 172.21.15.18:0/2311240540 reap_dead start 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 shutdown_connections 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 >> 172.21.15.18:0/2311240540 conn(0x7f9f9c0fb870 msgr2=0x7f9f9c0fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 shutdown_connections 2024-09-13T16:50:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.224+0000 7f9fa0a00640 1 -- 172.21.15.18:0/2311240540 wait complete. 2024-09-13T16:50:36.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:35 smithi144 ceph-mon[35328]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:36.339 INFO:teuthology.orchestra.run.smithi018.stdout:309237645341 2024-09-13T16:50:36.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-13T16:50:36.836 INFO:teuthology.orchestra.run.smithi018.stdout:253403070504 2024-09-13T16:50:36.836 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-13T16:50:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.821+0000 7ff150600640 1 -- 172.21.15.18:0/4076895401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff148073200 msgr2=0x7ff14810c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.821+0000 7ff150600640 1 --2- 172.21.15.18:0/4076895401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff148073200 0x7ff14810c060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff134009900 tx=0x7ff13402a480 comp rx=0 tx=0).stop 2024-09-13T16:50:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.821+0000 7ff150600640 1 -- 172.21.15.18:0/4076895401 shutdown_connections 2024-09-13T16:50:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.821+0000 7ff150600640 1 --2- 172.21.15.18:0/4076895401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff148073200 0x7ff14810c060 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.821+0000 7ff150600640 1 --2- 172.21.15.18:0/4076895401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff14810c5a0 0x7ff14810e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.821+0000 7ff150600640 1 --2- 172.21.15.18:0/4076895401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1480728e0 0x7ff148072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.821+0000 7ff150600640 1 -- 172.21.15.18:0/4076895401 >> 172.21.15.18:0/4076895401 conn(0x7ff1480fbaa0 msgr2=0x7ff1480fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.821+0000 7ff150600640 1 -- 172.21.15.18:0/4076895401 shutdown_connections 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.821+0000 7ff150600640 1 -- 172.21.15.18:0/4076895401 wait complete. 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.822+0000 7ff150600640 1 Processor -- start 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.822+0000 7ff150600640 1 -- start start 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff150600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1480728e0 0x7ff148198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff150600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff148073200 0x7ff148198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff150600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff14810c5a0 0x7ff14819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff150600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14819d410 con 0x7ff148073200 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff150600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14819d580 con 0x7ff1480728e0 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff150600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14819d6f0 con 0x7ff14810c5a0 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff14d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff148073200 0x7ff148198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff14dc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1480728e0 0x7ff148198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff14d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff148073200 0x7ff148198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46882/0 (socket says 172.21.15.18:46882) 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff14d200640 1 -- 172.21.15.18:0/12096574 learned_addr learned my addr 172.21.15.18:0/12096574 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.823+0000 7ff14e600640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff14810c5a0 0x7ff14819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.824+0000 7ff14dc00640 1 -- 172.21.15.18:0/12096574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff14810c5a0 msgr2=0x7ff14819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.824+0000 7ff14dc00640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff14810c5a0 0x7ff14819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.824+0000 7ff14dc00640 1 -- 172.21.15.18:0/12096574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff148073200 msgr2=0x7ff148198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.824+0000 7ff14dc00640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff148073200 0x7ff148198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.824+0000 7ff14dc00640 1 -- 172.21.15.18:0/12096574 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134009560 con 0x7ff1480728e0 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.824+0000 7ff14dc00640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1480728e0 0x7ff148198520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00e9f0 tx=0x7ff13c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.824+0000 7ff146000640 1 -- 172.21.15.18:0/12096574 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c00ccc0 con 0x7ff1480728e0 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.824+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14819d9d0 con 0x7ff1480728e0 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.825+0000 7ff146000640 1 -- 172.21.15.18:0/12096574 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff13c00ce20 con 0x7ff1480728e0 2024-09-13T16:50:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.825+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1481a5290 con 0x7ff1480728e0 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.825+0000 7ff146000640 1 -- 172.21.15.18:0/12096574 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c004a00 con 0x7ff1480728e0 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.826+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff128000fc0 con 0x7ff1480728e0 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.828+0000 7ff146000640 1 -- 172.21.15.18:0/12096574 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff13c004b60 con 0x7ff1480728e0 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.829+0000 7ff146000640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff1300a1190 0x7ff1300a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.829+0000 7ff146000640 1 -- 172.21.15.18:0/12096574 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff13c014070 con 0x7ff1480728e0 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.829+0000 7ff14d200640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff1300a1190 0x7ff1300a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.829+0000 7ff146000640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] conn(0x7ff1300ac220 0x7ff1300ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.829+0000 7ff146000640 1 -- 172.21.15.18:0/12096574 --> [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1300aed90 con 0x7ff1300ac220 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.829+0000 7ff146000640 1 -- 172.21.15.18:0/12096574 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff13c0cd240 con 0x7ff1480728e0 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.830+0000 7ff14e600640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] conn(0x7ff1300ac220 0x7ff1300ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.830+0000 7ff14d200640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff1300a1190 0x7ff1300a3650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff148199a80 tx=0x7ff134005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.831+0000 7ff14e600640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] conn(0x7ff1300ac220 0x7ff1300ae6c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.832+0000 7ff146000640 1 -- 172.21.15.18:0/12096574 <== osd.4 v2:172.21.15.94:6808/2294580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff1300aed90 con 0x7ff1300ac220 2024-09-13T16:50:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.860+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 --> [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff128002cb0 con 0x7ff1300ac220 2024-09-13T16:50:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.860+0000 7ff146000640 1 -- 172.21.15.18:0/12096574 <== osd.4 v2:172.21.15.94:6808/2294580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff128002cb0 con 0x7ff1300ac220 2024-09-13T16:50:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 >> [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] conn(0x7ff1300ac220 msgr2=0x7ff1300ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff150600640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] conn(0x7ff1300ac220 0x7ff1300ae6c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff1300a1190 msgr2=0x7ff1300a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff150600640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff1300a1190 0x7ff1300a3650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff148199a80 tx=0x7ff134005a20 comp rx=0 tx=0).stop 2024-09-13T16:50:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1480728e0 msgr2=0x7ff148198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff150600640 1 --2- 172.21.15.18:0/12096574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1480728e0 0x7ff148198520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00e9f0 tx=0x7ff13c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:50:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff14e600640 1 -- 172.21.15.18:0/12096574 reap_dead start 2024-09-13T16:50:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 shutdown_connections 2024-09-13T16:50:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 >> 172.21.15.18:0/12096574 conn(0x7ff1480fbaa0 msgr2=0x7ff1480fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 shutdown_connections 2024-09-13T16:50:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:36.861+0000 7ff150600640 1 -- 172.21.15.18:0/12096574 wait complete. 2024-09-13T16:50:38.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:37 smithi094 ceph-mon[35259]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:50:38.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:37 smithi018 ceph-mon[30981]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:50:38.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:37 smithi144 ceph-mon[35328]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:50:38.855 INFO:teuthology.orchestra.run.smithi018.stdout:107374182467 2024-09-13T16:50:38.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T16:50:39.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.264+0000 7f504c800640 1 -- 172.21.15.18:0/63591906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5044107330 msgr2=0x7f504410eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.264+0000 7f504c800640 1 --2- 172.21.15.18:0/63591906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5044107330 0x7f504410eeb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5040009cd0 tx=0x7f504002a8f0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.264+0000 7f504c800640 1 -- 172.21.15.18:0/63591906 shutdown_connections 2024-09-13T16:50:39.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.264+0000 7f504c800640 1 --2- 172.21.15.18:0/63591906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5044107330 0x7f504410eeb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.264+0000 7f504c800640 1 --2- 172.21.15.18:0/63591906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5044102bb0 0x7f5044106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.264+0000 7f504c800640 1 --2- 172.21.15.18:0/63591906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5044102200 0x7f50441025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.264+0000 7f504c800640 1 -- 172.21.15.18:0/63591906 >> 172.21.15.18:0/63591906 conn(0x7f50440fdc60 msgr2=0x7f5044100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.264+0000 7f504c800640 1 -- 172.21.15.18:0/63591906 shutdown_connections 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.264+0000 7f504c800640 1 -- 172.21.15.18:0/63591906 wait complete. 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.265+0000 7f504c800640 1 Processor -- start 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.265+0000 7f504c800640 1 -- start start 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.265+0000 7f504c800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5044102200 0x7f50441984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.265+0000 7f504c800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5044102bb0 0x7f50441989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f504c800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5044107330 0x7f504419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:39.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f504c800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504419d3f0 con 0x7f5044102bb0 2024-09-13T16:50:39.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f504c800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504419d560 con 0x7f5044107330 2024-09-13T16:50:39.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f504c800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504419d6d0 con 0x7f5044102200 2024-09-13T16:50:39.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f5049400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5044102bb0 0x7f50441989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:39.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f5049400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5044102bb0 0x7f50441989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46914/0 (socket says 172.21.15.18:46914) 2024-09-13T16:50:39.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f504a800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5044107330 0x7f504419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:39.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f5049400640 1 -- 172.21.15.18:0/238189500 learned_addr learned my addr 172.21.15.18:0/238189500 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:39.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f5049e00640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5044102200 0x7f50441984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:39.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f5049400640 1 -- 172.21.15.18:0/238189500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5044102200 msgr2=0x7f50441984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f5049400640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5044102200 0x7f50441984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f5049400640 1 -- 172.21.15.18:0/238189500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5044107330 msgr2=0x7f504419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f5049400640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5044107330 0x7f504419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f5049400640 1 -- 172.21.15.18:0/238189500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040009900 con 0x7f5044102bb0 2024-09-13T16:50:39.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.266+0000 7f504a800640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5044107330 0x7f504419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:50:39.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.267+0000 7f5049400640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5044102bb0 0x7f50441989f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f503400e9f0 tx=0x7f503400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:39.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.267+0000 7f503ea00640 1 -- 172.21.15.18:0/238189500 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034009720 con 0x7f5044102bb0 2024-09-13T16:50:39.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.267+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504419d9b0 con 0x7f5044102bb0 2024-09-13T16:50:39.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.267+0000 7f503ea00640 1 -- 172.21.15.18:0/238189500 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f503400cd80 con 0x7f5044102bb0 2024-09-13T16:50:39.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.267+0000 7f503ea00640 1 -- 172.21.15.18:0/238189500 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034018630 con 0x7f5044102bb0 2024-09-13T16:50:39.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.267+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50441a5270 con 0x7f5044102bb0 2024-09-13T16:50:39.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.268+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50441036e0 con 0x7f5044102bb0 2024-09-13T16:50:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.270+0000 7f503ea00640 1 -- 172.21.15.18:0/238189500 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5034004e00 con 0x7f5044102bb0 2024-09-13T16:50:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.271+0000 7f503ea00640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f502c0a1110 0x7f502c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.271+0000 7f503ea00640 1 -- 172.21.15.18:0/238189500 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5034014070 con 0x7f5044102bb0 2024-09-13T16:50:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.271+0000 7f5049e00640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f502c0a1110 0x7f502c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.272+0000 7f503ea00640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] conn(0x7f502c0ac1a0 0x7f502c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.272+0000 7f503ea00640 1 -- 172.21.15.18:0/238189500 --> [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f502c0aed10 con 0x7f502c0ac1a0 2024-09-13T16:50:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.272+0000 7f503ea00640 1 -- 172.21.15.18:0/238189500 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50340cf600 con 0x7f5044102bb0 2024-09-13T16:50:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.272+0000 7f5049e00640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f502c0a1110 0x7f502c0a35d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5038009bd0 tx=0x7f5038005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.272+0000 7f504a800640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] conn(0x7f502c0ac1a0 0x7f502c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.273+0000 7f504a800640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] conn(0x7f502c0ac1a0 0x7f502c0ae640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:39.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.274+0000 7f503ea00640 1 -- 172.21.15.18:0/238189500 <== osd.2 v2:172.21.15.144:6800/2547295971 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f502c0aed10 con 0x7f502c0ac1a0 2024-09-13T16:50:39.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.287+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 --> [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5044060b30 con 0x7f502c0ac1a0 2024-09-13T16:50:39.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.288+0000 7f503ea00640 1 -- 172.21.15.18:0/238189500 <== osd.2 v2:172.21.15.144:6800/2547295971 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5044060b30 con 0x7f502c0ac1a0 2024-09-13T16:50:39.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.288+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 >> [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] conn(0x7f502c0ac1a0 msgr2=0x7f502c0ae640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.288+0000 7f504c800640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] conn(0x7f502c0ac1a0 0x7f502c0ae640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.289+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f502c0a1110 msgr2=0x7f502c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.289+0000 7f504c800640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f502c0a1110 0x7f502c0a35d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5038009bd0 tx=0x7f5038005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:39.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.289+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5044102bb0 msgr2=0x7f50441989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.289+0000 7f504c800640 1 --2- 172.21.15.18:0/238189500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5044102bb0 0x7f50441989f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f503400e9f0 tx=0x7f503400edf0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.289+0000 7f504a800640 1 -- 172.21.15.18:0/238189500 reap_dead start 2024-09-13T16:50:39.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.289+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 shutdown_connections 2024-09-13T16:50:39.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.289+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 >> 172.21.15.18:0/238189500 conn(0x7f50440fdc60 msgr2=0x7f50440ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:39.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.289+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 shutdown_connections 2024-09-13T16:50:39.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:39.289+0000 7f504c800640 1 -- 172.21.15.18:0/238189500 wait complete. 2024-09-13T16:50:39.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.191+0000 7f80b1600640 1 -- 172.21.15.18:0/3430482469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80ac10a1a0 msgr2=0x7f80ac10c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.191+0000 7f80b1600640 1 --2- 172.21.15.18:0/3430482469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80ac10a1a0 0x7f80ac10c640 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009ca0 tx=0x7f80a402a950 comp rx=0 tx=0).stop 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.191+0000 7f80b1600640 1 -- 172.21.15.18:0/3430482469 shutdown_connections 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.191+0000 7f80b1600640 1 --2- 172.21.15.18:0/3430482469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80ac10a1a0 0x7f80ac10c640 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.191+0000 7f80b1600640 1 --2- 172.21.15.18:0/3430482469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80ac101690 0x7f80ac109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.191+0000 7f80b1600640 1 --2- 172.21.15.18:0/3430482469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80ac100d70 0x7f80ac101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.191+0000 7f80b1600640 1 -- 172.21.15.18:0/3430482469 >> 172.21.15.18:0/3430482469 conn(0x7f80ac0fa830 msgr2=0x7f80ac0fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.191+0000 7f80b1600640 1 -- 172.21.15.18:0/3430482469 shutdown_connections 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.191+0000 7f80b1600640 1 -- 172.21.15.18:0/3430482469 wait complete. 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.192+0000 7f80b1600640 1 Processor -- start 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.192+0000 7f80b1600640 1 -- start start 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.192+0000 7f80b1600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80ac100d70 0x7f80ac196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80b1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80ac101690 0x7f80ac196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80b1600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80ac10a1a0 0x7f80ac19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80b1600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac19af70 con 0x7f80ac10a1a0 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80b1600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac19b0e0 con 0x7f80ac100d70 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80b1600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac19b250 con 0x7f80ac101690 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80b0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80ac10a1a0 0x7f80ac19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80abe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80ac100d70 0x7f80ac196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80abe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80ac100d70 0x7f80ac196030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:37580/0 (socket says 172.21.15.18:37580) 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80b0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80ac10a1a0 0x7f80ac19a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46832/0 (socket says 172.21.15.18:46832) 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80abe00640 1 -- 172.21.15.18:0/4212288194 learned_addr learned my addr 172.21.15.18:0/4212288194 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80ab400640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80ac101690 0x7f80ac196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80abe00640 1 -- 172.21.15.18:0/4212288194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80ac101690 msgr2=0x7f80ac196570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80abe00640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80ac101690 0x7f80ac196570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80abe00640 1 -- 172.21.15.18:0/4212288194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80ac10a1a0 msgr2=0x7f80ac19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80abe00640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80ac10a1a0 0x7f80ac19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.193+0000 7f80abe00640 1 -- 172.21.15.18:0/4212288194 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a4009900 con 0x7f80ac100d70 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.194+0000 7f80abe00640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80ac100d70 0x7f80ac196030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f809c00e9f0 tx=0x7f809c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.194+0000 7f80a8c00640 1 -- 172.21.15.18:0/4212288194 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c009720 con 0x7f80ac100d70 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.194+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac19b530 con 0x7f80ac100d70 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.194+0000 7f80a8c00640 1 -- 172.21.15.18:0/4212288194 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f809c00cd80 con 0x7f80ac100d70 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.194+0000 7f80a8c00640 1 -- 172.21.15.18:0/4212288194 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c010430 con 0x7f80ac100d70 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.194+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac1a2df0 con 0x7f80ac100d70 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.195+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80ac0687e0 con 0x7f80ac100d70 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.197+0000 7f80a8c00640 1 -- 172.21.15.18:0/4212288194 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f809c005000 con 0x7f80ac100d70 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.198+0000 7f80a8c00640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f80900a1180 0x7f80900a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.199+0000 7f80a8c00640 1 -- 172.21.15.18:0/4212288194 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f809c014070 con 0x7f80ac100d70 2024-09-13T16:50:39.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.199+0000 7f80ab400640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f80900a1180 0x7f80900a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:39.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.199+0000 7f80a8c00640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] conn(0x7f80900ac210 0x7f80900ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:39.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.199+0000 7f80a8c00640 1 -- 172.21.15.18:0/4212288194 --> [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80900aed80 con 0x7f80900ac210 2024-09-13T16:50:39.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.199+0000 7f80a8c00640 1 -- 172.21.15.18:0/4212288194 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f809c0cd700 con 0x7f80ac100d70 2024-09-13T16:50:39.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.199+0000 7f80ab400640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f80900a1180 0x7f80900a3640 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f80ac1975e0 tx=0x7f8098005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:39.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.199+0000 7f80b0c00640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] conn(0x7f80900ac210 0x7f80900ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:39.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.200+0000 7f80b0c00640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] conn(0x7f80900ac210 0x7f80900ae6b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:39.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.201+0000 7f80a8c00640 1 -- 172.21.15.18:0/4212288194 <== osd.11 v2:172.21.15.144:6824/3936121056 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f80900aed80 con 0x7f80900ac210 2024-09-13T16:50:39.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.215+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 --> [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80ac10ff00 con 0x7f80900ac210 2024-09-13T16:50:39.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80a8c00640 1 -- 172.21.15.18:0/4212288194 <== osd.11 v2:172.21.15.144:6824/3936121056 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f80a402f5c0 con 0x7f80900ac210 2024-09-13T16:50:39.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 >> [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] conn(0x7f80900ac210 msgr2=0x7f80900ae6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b1600640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] conn(0x7f80900ac210 0x7f80900ae6b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f80900a1180 msgr2=0x7f80900a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b1600640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f80900a1180 0x7f80900a3640 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f80ac1975e0 tx=0x7f8098005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:39.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80ac100d70 msgr2=0x7f80ac196030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:39.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b1600640 1 --2- 172.21.15.18:0/4212288194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80ac100d70 0x7f80ac196030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f809c00e9f0 tx=0x7f809c00edf0 comp rx=0 tx=0).stop 2024-09-13T16:50:39.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b0c00640 1 -- 172.21.15.18:0/4212288194 reap_dead start 2024-09-13T16:50:39.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 shutdown_connections 2024-09-13T16:50:39.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 >> 172.21.15.18:0/4212288194 conn(0x7f80ac0fa830 msgr2=0x7f80ac0fbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:39.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 shutdown_connections 2024-09-13T16:50:39.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:34.216+0000 7f80b1600640 1 -- 172.21.15.18:0/4212288194 wait complete. 2024-09-13T16:50:40.118 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:39 smithi018 ceph-mon[30981]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:40.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:39 smithi094 ceph-mon[35259]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:40.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:39 smithi144 ceph-mon[35328]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:40.595 INFO:teuthology.orchestra.run.smithi018.stdout:343597383706 2024-09-13T16:50:40.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-13T16:50:41.171 INFO:teuthology.orchestra.run.smithi018.stdout:163208757306 2024-09-13T16:50:41.172 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T16:50:41.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.688+0000 7f0f7f200640 1 -- 172.21.15.18:0/3080478258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f801029c0 msgr2=0x7f0f80106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:41.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.688+0000 7f0f7f200640 1 --2- 172.21.15.18:0/3080478258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f801029c0 0x7f0f80106a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009930 tx=0x7f0f6802a420 comp rx=0 tx=0).stop 2024-09-13T16:50:41.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.688+0000 7f0f7f200640 1 -- 172.21.15.18:0/3080478258 shutdown_connections 2024-09-13T16:50:41.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.688+0000 7f0f7f200640 1 --2- 172.21.15.18:0/3080478258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f801029c0 0x7f0f80106a10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:41.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.688+0000 7f0f7f200640 1 --2- 172.21.15.18:0/3080478258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f80107140 0x7f0f8010ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:41.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.688+0000 7f0f7f200640 1 --2- 172.21.15.18:0/3080478258 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f80102010 0x7f0f801023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:41.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.688+0000 7f0f7f200640 1 -- 172.21.15.18:0/3080478258 >> 172.21.15.18:0/3080478258 conn(0x7f0f800fda70 msgr2=0x7f0f800ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:41.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.688+0000 7f0f7f200640 1 -- 172.21.15.18:0/3080478258 shutdown_connections 2024-09-13T16:50:41.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.688+0000 7f0f7f200640 1 -- 172.21.15.18:0/3080478258 wait complete. 2024-09-13T16:50:41.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.689+0000 7f0f7f200640 1 Processor -- start 2024-09-13T16:50:41.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.690+0000 7f0f7f200640 1 -- start start 2024-09-13T16:50:41.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.690+0000 7f0f7f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f80102010 0x7f0f801982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:41.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.690+0000 7f0f7f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f801029c0 0x7f0f80198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:41.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.690+0000 7f0f7f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f80107140 0x7f0f8019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.690+0000 7f0f7f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8019d230 con 0x7f0f801029c0 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.690+0000 7f0f7f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8019d3a0 con 0x7f0f80102010 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.690+0000 7f0f7f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8019d510 con 0x7f0f80107140 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.690+0000 7f0f75400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f801029c0 0x7f0f80198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f75400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f801029c0 0x7f0f80198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56016/0 (socket says 172.21.15.18:56016) 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f75400640 1 -- 172.21.15.18:0/1205166833 learned_addr learned my addr 172.21.15.18:0/1205166833 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f7de00640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f80102010 0x7f0f801982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f7e800640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f80107140 0x7f0f8019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f7de00640 1 -- 172.21.15.18:0/1205166833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f80107140 msgr2=0x7f0f8019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f7de00640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f80107140 0x7f0f8019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f7de00640 1 -- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f801029c0 msgr2=0x7f0f80198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f7de00640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f801029c0 0x7f0f80198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f7de00640 1 -- 172.21.15.18:0/1205166833 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68009560 con 0x7f0f80102010 2024-09-13T16:50:41.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f75400640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f801029c0 0x7f0f80198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:50:41.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.691+0000 7f0f7de00640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f80102010 0x7f0f801982f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000e9f0 tx=0x7f0f7000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:41.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.692+0000 7f0f77400640 1 -- 172.21.15.18:0/1205166833 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000ccc0 con 0x7f0f80102010 2024-09-13T16:50:41.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.692+0000 7f0f77400640 1 -- 172.21.15.18:0/1205166833 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f7000ce20 con 0x7f0f80102010 2024-09-13T16:50:41.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.692+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8019d7f0 con 0x7f0f80102010 2024-09-13T16:50:41.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.692+0000 7f0f77400640 1 -- 172.21.15.18:0/1205166833 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f700187c0 con 0x7f0f80102010 2024-09-13T16:50:41.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.692+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f801a50b0 con 0x7f0f80102010 2024-09-13T16:50:41.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.693+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f80112100 con 0x7f0f80102010 2024-09-13T16:50:41.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.695+0000 7f0f77400640 1 -- 172.21.15.18:0/1205166833 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0f70010430 con 0x7f0f80102010 2024-09-13T16:50:41.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.696+0000 7f0f77400640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0f640a1180 0x7f0f640a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:41.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.697+0000 7f0f77400640 1 -- 172.21.15.18:0/1205166833 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0f70014070 con 0x7f0f80102010 2024-09-13T16:50:41.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.697+0000 7f0f75400640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0f640a1180 0x7f0f640a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:41.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.697+0000 7f0f77400640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] conn(0x7f0f640ac210 0x7f0f640ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:41.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.697+0000 7f0f77400640 1 -- 172.21.15.18:0/1205166833 --> [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f640aed80 con 0x7f0f640ac210 2024-09-13T16:50:41.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.697+0000 7f0f77400640 1 -- 172.21.15.18:0/1205166833 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f700cd9f0 con 0x7f0f80102010 2024-09-13T16:50:41.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.697+0000 7f0f7e800640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] conn(0x7f0f640ac210 0x7f0f640ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:41.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.697+0000 7f0f75400640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0f640a1180 0x7f0f640a3640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f68000c00 tx=0x7f0f68005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:41.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.698+0000 7f0f7e800640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] conn(0x7f0f640ac210 0x7f0f640ae6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:41.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.699+0000 7f0f77400640 1 -- 172.21.15.18:0/1205166833 <== osd.9 v2:172.21.15.18:6826/2756311466 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f640aed80 con 0x7f0f640ac210 2024-09-13T16:50:41.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.713+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 --> [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f801034f0 con 0x7f0f640ac210 2024-09-13T16:50:41.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.713+0000 7f0f77400640 1 -- 172.21.15.18:0/1205166833 <== osd.9 v2:172.21.15.18:6826/2756311466 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0f801034f0 con 0x7f0f640ac210 2024-09-13T16:50:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.713+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] conn(0x7f0f640ac210 msgr2=0x7f0f640ae6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.713+0000 7f0f7f200640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] conn(0x7f0f640ac210 0x7f0f640ae6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.714+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0f640a1180 msgr2=0x7f0f640a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.714+0000 7f0f7f200640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0f640a1180 0x7f0f640a3640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f68000c00 tx=0x7f0f68005a20 comp rx=0 tx=0).stop 2024-09-13T16:50:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.714+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f80102010 msgr2=0x7f0f801982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.714+0000 7f0f7f200640 1 --2- 172.21.15.18:0/1205166833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f80102010 0x7f0f801982f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000e9f0 tx=0x7f0f7000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:50:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.714+0000 7f0f7e800640 1 -- 172.21.15.18:0/1205166833 reap_dead start 2024-09-13T16:50:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.714+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 shutdown_connections 2024-09-13T16:50:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.714+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 >> 172.21.15.18:0/1205166833 conn(0x7f0f800fda70 msgr2=0x7f0f800fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:41.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.714+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 shutdown_connections 2024-09-13T16:50:41.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:41.714+0000 7f0f7f200640 1 -- 172.21.15.18:0/1205166833 wait complete. 2024-09-13T16:50:42.082 INFO:teuthology.orchestra.run.smithi018.stdout:197568495666 2024-09-13T16:50:42.083 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-13T16:50:42.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:41 smithi018 ceph-mon[30981]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-13T16:50:42.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:41 smithi094 ceph-mon[35259]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-13T16:50:42.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:41 smithi144 ceph-mon[35328]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-13T16:50:43.146 INFO:teuthology.orchestra.run.smithi018.stdout:287762808870 2024-09-13T16:50:43.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-13T16:50:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.485+0000 7ff622800640 1 -- 172.21.15.18:0/906929997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff61c102010 msgr2=0x7ff61c1023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.485+0000 7ff622800640 1 --2- 172.21.15.18:0/906929997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff61c102010 0x7ff61c1023f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff610009cd0 tx=0x7ff61002a8e0 comp rx=0 tx=0).stop 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.485+0000 7ff622800640 1 -- 172.21.15.18:0/906929997 shutdown_connections 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.485+0000 7ff622800640 1 --2- 172.21.15.18:0/906929997 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff61c107140 0x7ff61c10ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.485+0000 7ff622800640 1 --2- 172.21.15.18:0/906929997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff61c1029c0 0x7ff61c106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.485+0000 7ff622800640 1 --2- 172.21.15.18:0/906929997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff61c102010 0x7ff61c1023f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.485+0000 7ff622800640 1 -- 172.21.15.18:0/906929997 >> 172.21.15.18:0/906929997 conn(0x7ff61c0fda70 msgr2=0x7ff61c0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.485+0000 7ff622800640 1 -- 172.21.15.18:0/906929997 shutdown_connections 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.485+0000 7ff622800640 1 -- 172.21.15.18:0/906929997 wait complete. 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.486+0000 7ff622800640 1 Processor -- start 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.486+0000 7ff622800640 1 -- start start 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff622800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff61c102010 0x7ff61c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff622800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff61c1029c0 0x7ff61c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff622800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff61c107140 0x7ff61c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff622800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c19d240 con 0x7ff61c102010 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff622800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c19d3b0 con 0x7ff61c107140 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff622800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c19d520 con 0x7ff61c1029c0 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff621400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff61c102010 0x7ff61c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff621400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff61c102010 0x7ff61c198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46896/0 (socket says 172.21.15.18:46896) 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff621400640 1 -- 172.21.15.18:0/172474883 learned_addr learned my addr 172.21.15.18:0/172474883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff620a00640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff61c1029c0 0x7ff61c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff621e00640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff61c107140 0x7ff61c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff621400640 1 -- 172.21.15.18:0/172474883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff61c1029c0 msgr2=0x7ff61c198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff621400640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff61c1029c0 0x7ff61c198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff621400640 1 -- 172.21.15.18:0/172474883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff61c107140 msgr2=0x7ff61c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff621400640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff61c107140 0x7ff61c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.487+0000 7ff621400640 1 -- 172.21.15.18:0/172474883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff610009900 con 0x7ff61c102010 2024-09-13T16:50:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.488+0000 7ff621400640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff61c102010 0x7ff61c198300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff610031040 tx=0x7ff610031a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.488+0000 7ff61a000640 1 -- 172.21.15.18:0/172474883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610003d80 con 0x7ff61c102010 2024-09-13T16:50:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.488+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c19d7a0 con 0x7ff61c102010 2024-09-13T16:50:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.488+0000 7ff61a000640 1 -- 172.21.15.18:0/172474883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6100308a0 con 0x7ff61c102010 2024-09-13T16:50:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.488+0000 7ff61a000640 1 -- 172.21.15.18:0/172474883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610045770 con 0x7ff61c102010 2024-09-13T16:50:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.488+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c1a50c0 con 0x7ff61c102010 2024-09-13T16:50:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.489+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff61c112110 con 0x7ff61c102010 2024-09-13T16:50:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.491+0000 7ff61a000640 1 -- 172.21.15.18:0/172474883 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff61000a040 con 0x7ff61c102010 2024-09-13T16:50:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.492+0000 7ff61a000640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6040a1180 0x7ff6040a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.493+0000 7ff61a000640 1 -- 172.21.15.18:0/172474883 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff6100ee8d0 con 0x7ff61c102010 2024-09-13T16:50:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.493+0000 7ff620a00640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6040a1180 0x7ff6040a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.493+0000 7ff61a000640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] conn(0x7ff6040ac210 0x7ff6040ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.493+0000 7ff61a000640 1 -- 172.21.15.18:0/172474883 --> [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6040aed80 con 0x7ff6040ac210 2024-09-13T16:50:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.493+0000 7ff61a000640 1 -- 172.21.15.18:0/172474883 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6100eec40 con 0x7ff61c102010 2024-09-13T16:50:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.493+0000 7ff620a00640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6040a1180 0x7ff6040a3640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff61c1998b0 tx=0x7ff608005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.493+0000 7ff621e00640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] conn(0x7ff6040ac210 0x7ff6040ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.494+0000 7ff621e00640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] conn(0x7ff6040ac210 0x7ff6040ae6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.495+0000 7ff61a000640 1 -- 172.21.15.18:0/172474883 <== osd.1 v2:172.21.15.94:6800/3875618914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff6040aed80 con 0x7ff6040ac210 2024-09-13T16:50:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.509+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 --> [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff61c1034f0 con 0x7ff6040ac210 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.509+0000 7ff61a000640 1 -- 172.21.15.18:0/172474883 <== osd.1 v2:172.21.15.94:6800/3875618914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff61c1034f0 con 0x7ff6040ac210 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 >> [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] conn(0x7ff6040ac210 msgr2=0x7ff6040ae6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff622800640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] conn(0x7ff6040ac210 0x7ff6040ae6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6040a1180 msgr2=0x7ff6040a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff622800640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6040a1180 0x7ff6040a3640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff61c1998b0 tx=0x7ff608005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff61c102010 msgr2=0x7ff61c198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff622800640 1 --2- 172.21.15.18:0/172474883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff61c102010 0x7ff61c198300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff610031040 tx=0x7ff610031a40 comp rx=0 tx=0).stop 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff621e00640 1 -- 172.21.15.18:0/172474883 reap_dead start 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 shutdown_connections 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 >> 172.21.15.18:0/172474883 conn(0x7ff61c0fda70 msgr2=0x7ff61c0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 shutdown_connections 2024-09-13T16:50:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:38.510+0000 7ff622800640 1 -- 172.21.15.18:0/172474883 wait complete. 2024-09-13T16:50:43.937 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:43 smithi018 ceph-mon[30981]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:44.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:43 smithi094 ceph-mon[35259]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:44.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:43 smithi144 ceph-mon[35328]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:44.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.299+0000 7f470be00640 1 -- 172.21.15.18:0/1296186167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4704073170 msgr2=0x7f4704110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:44.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.299+0000 7f470be00640 1 --2- 172.21.15.18:0/1296186167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4704073170 0x7f4704110850 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009900 tx=0x7f46f002a480 comp rx=0 tx=0).stop 2024-09-13T16:50:44.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.299+0000 7f470be00640 1 -- 172.21.15.18:0/1296186167 shutdown_connections 2024-09-13T16:50:44.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.299+0000 7f470be00640 1 --2- 172.21.15.18:0/1296186167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4704073170 0x7f4704110850 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:44.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.299+0000 7f470be00640 1 --2- 172.21.15.18:0/1296186167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4704110d90 0x7f4704113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:44.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.299+0000 7f470be00640 1 --2- 172.21.15.18:0/1296186167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4704072850 0x7f4704072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:44.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.299+0000 7f470be00640 1 -- 172.21.15.18:0/1296186167 >> 172.21.15.18:0/1296186167 conn(0x7f47040fba80 msgr2=0x7f47040fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:44.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.299+0000 7f470be00640 1 -- 172.21.15.18:0/1296186167 shutdown_connections 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.299+0000 7f470be00640 1 -- 172.21.15.18:0/1296186167 wait complete. 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.301+0000 7f470be00640 1 Processor -- start 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.301+0000 7f470be00640 1 -- start start 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.301+0000 7f470be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4704072850 0x7f47041a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.301+0000 7f470be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4704073170 0x7f47041a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.301+0000 7f470be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4704110d90 0x7f470419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.301+0000 7f470be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470419ceb0 con 0x7f4704072850 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.301+0000 7f470be00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470419d020 con 0x7f4704110d90 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.301+0000 7f470be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470419d1e0 con 0x7f4704073170 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.301+0000 7f4709400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4704072850 0x7f47041a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4709400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4704072850 0x7f47041a2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56030/0 (socket says 172.21.15.18:56030) 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4709400640 1 -- 172.21.15.18:0/2306320525 learned_addr learned my addr 172.21.15.18:0/2306320525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4708a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4704073170 0x7f47041a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4709e00640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4704110d90 0x7f470419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4709400640 1 -- 172.21.15.18:0/2306320525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4704073170 msgr2=0x7f47041a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4709400640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4704073170 0x7f47041a2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4709400640 1 -- 172.21.15.18:0/2306320525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4704110d90 msgr2=0x7f470419c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4709400640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4704110d90 0x7f470419c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4709400640 1 -- 172.21.15.18:0/2306320525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8009490 con 0x7f4704072850 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4708a00640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4704073170 0x7f47041a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4709e00640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4704110d90 0x7f470419c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.302+0000 7f4709400640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4704072850 0x7f47041a2670 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f46f800ea60 tx=0x7f46f800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.303+0000 7f4702000640 1 -- 172.21.15.18:0/2306320525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f800cde0 con 0x7f4704072850 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.303+0000 7f4702000640 1 -- 172.21.15.18:0/2306320525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46f80035f0 con 0x7f4704072850 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.303+0000 7f4702000640 1 -- 172.21.15.18:0/2306320525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f80044e0 con 0x7f4704072850 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.303+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f0009560 con 0x7f4704072850 2024-09-13T16:50:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.303+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470419d630 con 0x7f4704072850 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.304+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4704073f90 con 0x7f4704072850 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.306+0000 7f4702000640 1 -- 172.21.15.18:0/2306320525 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f46f8003a60 con 0x7f4704072850 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.307+0000 7f4702000640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f46ec0a1190 0x7f46ec0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.307+0000 7f4702000640 1 -- 172.21.15.18:0/2306320525 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f46f8014070 con 0x7f4704072850 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.307+0000 7f4708a00640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f46ec0a1190 0x7f46ec0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.307+0000 7f4702000640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] conn(0x7f46ec0ac220 0x7f46ec0ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.307+0000 7f4702000640 1 -- 172.21.15.18:0/2306320525 --> [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46ec0aed90 con 0x7f46ec0ac220 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.307+0000 7f4702000640 1 -- 172.21.15.18:0/2306320525 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46f80cd680 con 0x7f4704072850 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.308+0000 7f4709e00640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] conn(0x7f46ec0ac220 0x7f46ec0ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.308+0000 7f4708a00640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f46ec0a1190 0x7f46ec0a3650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f46f0005ab0 tx=0x7f46f0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.308+0000 7f4709e00640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] conn(0x7f46ec0ac220 0x7f46ec0ae6c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.309+0000 7f4702000640 1 -- 172.21.15.18:0/2306320525 <== osd.7 v2:172.21.15.94:6816/976410580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f46ec0aed90 con 0x7f46ec0ac220 2024-09-13T16:50:44.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.324+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 --> [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4704060b70 con 0x7f46ec0ac220 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.324+0000 7f4702000640 1 -- 172.21.15.18:0/2306320525 <== osd.7 v2:172.21.15.94:6816/976410580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4704060b70 con 0x7f46ec0ac220 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 >> [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] conn(0x7f46ec0ac220 msgr2=0x7f46ec0ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f470be00640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] conn(0x7f46ec0ac220 0x7f46ec0ae6c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f46ec0a1190 msgr2=0x7f46ec0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f470be00640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f46ec0a1190 0x7f46ec0a3650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f46f0005ab0 tx=0x7f46f0005a20 comp rx=0 tx=0).stop 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4704072850 msgr2=0x7f47041a2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f470be00640 1 --2- 172.21.15.18:0/2306320525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4704072850 0x7f47041a2670 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f46f800ea60 tx=0x7f46f800ef20 comp rx=0 tx=0).stop 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f4709e00640 1 -- 172.21.15.18:0/2306320525 reap_dead start 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 shutdown_connections 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 >> 172.21.15.18:0/2306320525 conn(0x7f47040fba80 msgr2=0x7f47040fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 shutdown_connections 2024-09-13T16:50:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:44.325+0000 7f470be00640 1 -- 172.21.15.18:0/2306320525 wait complete. 2024-09-13T16:50:44.966 INFO:teuthology.orchestra.run.smithi018.stdout:77309411400 2024-09-13T16:50:44.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T16:50:45.762 INFO:teuthology.orchestra.run.smithi018.stdout:34359738449 2024-09-13T16:50:45.762 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T16:50:46.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:45 smithi094 ceph-mon[35259]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:46.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:45 smithi018 ceph-mon[30981]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:46.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:45 smithi144 ceph-mon[35328]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:46.275 INFO:teuthology.orchestra.run.smithi018.stdout:219043332144 2024-09-13T16:50:46.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-13T16:50:46.696 INFO:teuthology.orchestra.run.smithi018.stdout:141733920830 2024-09-13T16:50:46.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T16:50:47.182 INFO:teuthology.orchestra.run.smithi018.stdout:55834574925 2024-09-13T16:50:47.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T16:50:47.305 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:47.672 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:47.693 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:47.702 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:47.705 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:48.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:47 smithi094 ceph-mon[35259]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:50:48.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:47 smithi018 ceph-mon[30981]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:50:48.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:47 smithi144 ceph-mon[35328]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:50:48.347 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:48.761 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:50.131 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:49 smithi018 ceph-mon[30981]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:49 smithi094 ceph-mon[35259]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:50.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:49 smithi144 ceph-mon[35328]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:50.393 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:50:52.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:51 smithi018 ceph-mon[30981]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:52.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:51 smithi094 ceph-mon[35259]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:52.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:51 smithi144 ceph-mon[35328]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:53.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:53 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2711729007' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T16:50:53.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:53 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2711729007' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T16:50:53.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:53 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2711729007' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T16:50:54.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:54 smithi018 ceph-mon[30981]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:54.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:54 smithi094 ceph-mon[35259]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:54.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:54 smithi144 ceph-mon[35328]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:50:55.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.768+0000 7fe4eae00640 1 -- 172.21.15.18:0/1960791805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e4104f50 msgr2=0x7fe4e410cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:55.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.768+0000 7fe4eae00640 1 --2- 172.21.15.18:0/1960791805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e4104f50 0x7fe4e410cad0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009cd0 tx=0x7fe4dc02a8e0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.768+0000 7fe4eae00640 1 -- 172.21.15.18:0/1960791805 shutdown_connections 2024-09-13T16:50:55.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.768+0000 7fe4eae00640 1 --2- 172.21.15.18:0/1960791805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e4104f50 0x7fe4e410cad0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.768+0000 7fe4eae00640 1 --2- 172.21.15.18:0/1960791805 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4e41007d0 0x7fe4e4104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.768+0000 7fe4eae00640 1 --2- 172.21.15.18:0/1960791805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e40ffe20 0x7fe4e4100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.768+0000 7fe4eae00640 1 -- 172.21.15.18:0/1960791805 >> 172.21.15.18:0/1960791805 conn(0x7fe4e40fb900 msgr2=0x7fe4e40fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:55.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.768+0000 7fe4eae00640 1 -- 172.21.15.18:0/1960791805 shutdown_connections 2024-09-13T16:50:55.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.768+0000 7fe4eae00640 1 -- 172.21.15.18:0/1960791805 wait complete. 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.769+0000 7fe4eae00640 1 Processor -- start 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4eae00640 1 -- start start 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4eae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e40ffe20 0x7fe4e4198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4eae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e41007d0 0x7fe4e4198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4eae00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4e4104f50 0x7fe4e419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4eae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e419d260 con 0x7fe4e41007d0 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4eae00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e419d3d0 con 0x7fe4e4104f50 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4eae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e419d540 con 0x7fe4e40ffe20 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4e9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e41007d0 0x7fe4e4198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4e9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e41007d0 0x7fe4e4198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55830/0 (socket says 172.21.15.18:55830) 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4e9000640 1 -- 172.21.15.18:0/2711729007 learned_addr learned my addr 172.21.15.18:0/2711729007 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4e9a00640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e40ffe20 0x7fe4e4198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:55.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.770+0000 7fe4ea400640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4e4104f50 0x7fe4e419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.771+0000 7fe4e9000640 1 -- 172.21.15.18:0/2711729007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e40ffe20 msgr2=0x7fe4e4198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.771+0000 7fe4e9000640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e40ffe20 0x7fe4e4198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.771+0000 7fe4e9000640 1 -- 172.21.15.18:0/2711729007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4e4104f50 msgr2=0x7fe4e419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.771+0000 7fe4e9000640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4e4104f50 0x7fe4e419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.771+0000 7fe4e9000640 1 -- 172.21.15.18:0/2711729007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc009900 con 0x7fe4e41007d0 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.771+0000 7fe4e9000640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e41007d0 0x7fe4e4198860 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000e9f0 tx=0x7fe4d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.771+0000 7fe4e2000640 1 -- 172.21.15.18:0/2711729007 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0009700 con 0x7fe4e41007d0 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.771+0000 7fe4e2000640 1 -- 172.21.15.18:0/2711729007 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4d000cd80 con 0x7fe4e41007d0 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.771+0000 7fe4e2000640 1 -- 172.21.15.18:0/2711729007 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0018860 con 0x7fe4e41007d0 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.771+0000 7fe4eae00640 1 -- 172.21.15.18:0/2711729007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e419d820 con 0x7fe4e41007d0 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.772+0000 7fe4eae00640 1 -- 172.21.15.18:0/2711729007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e41a50e0 con 0x7fe4e41007d0 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.773+0000 7fe4eae00640 1 -- 172.21.15.18:0/2711729007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e4101300 con 0x7fe4e41007d0 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.774+0000 7fe4e2000640 1 -- 172.21.15.18:0/2711729007 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe4d00189c0 con 0x7fe4e41007d0 2024-09-13T16:50:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.775+0000 7fe4e2000640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4cc0a1180 0x7fe4cc0a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:55.212 INFO:teuthology.orchestra.run.smithi018.stdout:197568495670 2024-09-13T16:50:55.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.776+0000 7fe4e2000640 1 -- 172.21.15.18:0/2711729007 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe4d0014070 con 0x7fe4e41007d0 2024-09-13T16:50:55.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.776+0000 7fe4e9a00640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4cc0a1180 0x7fe4cc0a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:55.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.777+0000 7fe4e9a00640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4cc0a1180 0x7fe4cc0a3640 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009bd0 tx=0x7fe4d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:55.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.780+0000 7fe4e2000640 1 -- 172.21.15.18:0/2711729007 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe4d0052e20 con 0x7fe4e41007d0 2024-09-13T16:50:55.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.970+0000 7fe4eae00640 1 -- 172.21.15.18:0/2711729007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe4e4100200 con 0x7fe4e41007d0 2024-09-13T16:50:55.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.970+0000 7fe4e2000640 1 -- 172.21.15.18:0/2711729007 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4d0096350 con 0x7fe4e41007d0 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.972+0000 7fe4eae00640 1 -- 172.21.15.18:0/2711729007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4cc0a1180 msgr2=0x7fe4cc0a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.972+0000 7fe4eae00640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4cc0a1180 0x7fe4cc0a3640 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009bd0 tx=0x7fe4d8005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.972+0000 7fe4eae00640 1 -- 172.21.15.18:0/2711729007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e41007d0 msgr2=0x7fe4e4198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.972+0000 7fe4eae00640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e41007d0 0x7fe4e4198860 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000e9f0 tx=0x7fe4d000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.973+0000 7fe4eae00640 1 -- 172.21.15.18:0/2711729007 shutdown_connections 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.973+0000 7fe4eae00640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe4cc0a1180 0x7fe4cc0a3640 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.973+0000 7fe4eae00640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e41007d0 0x7fe4e4198860 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.973+0000 7fe4eae00640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4e4104f50 0x7fe4e419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.973+0000 7fe4eae00640 1 --2- 172.21.15.18:0/2711729007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e40ffe20 0x7fe4e4198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.973+0000 7fe4eae00640 1 -- 172.21.15.18:0/2711729007 >> 172.21.15.18:0/2711729007 conn(0x7fe4e40fb900 msgr2=0x7fe4e40fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.973+0000 7fe4eae00640 1 -- 172.21.15.18:0/2711729007 shutdown_connections 2024-09-13T16:50:55.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:52.973+0000 7fe4eae00640 1 -- 172.21.15.18:0/2711729007 wait complete. 2024-09-13T16:50:56.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:55 smithi094 ceph-mon[35259]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:56.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:55 smithi018 ceph-mon[30981]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:56.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:55 smithi144 ceph-mon[35328]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:50:58.134 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:57 smithi018 ceph-mon[30981]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:50:58.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:57 smithi094 ceph-mon[35259]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:50:58.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:57 smithi144 ceph-mon[35328]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:50:58.686 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495666 got 197568495670 for osd.6 2024-09-13T16:50:58.687 DEBUG:teuthology.parallel:result is None 2024-09-13T16:50:59.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:58 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1664349740' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T16:50:59.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:58 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1664349740' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T16:50:59.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:58 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1664349740' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T16:50:59.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.347+0000 7fb193800640 1 -- 172.21.15.18:0/3791197378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb18c107330 msgr2=0x7fb18c10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:59.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.347+0000 7fb193800640 1 --2- 172.21.15.18:0/3791197378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb18c107330 0x7fb18c10eeb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb184009cd0 tx=0x7fb18402a8f0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.347+0000 7fb193800640 1 -- 172.21.15.18:0/3791197378 shutdown_connections 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.347+0000 7fb193800640 1 --2- 172.21.15.18:0/3791197378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb18c107330 0x7fb18c10eeb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.347+0000 7fb193800640 1 --2- 172.21.15.18:0/3791197378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18c102bb0 0x7fb18c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.347+0000 7fb193800640 1 --2- 172.21.15.18:0/3791197378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c102200 0x7fb18c1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.347+0000 7fb193800640 1 -- 172.21.15.18:0/3791197378 >> 172.21.15.18:0/3791197378 conn(0x7fb18c0fdc40 msgr2=0x7fb18c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.347+0000 7fb193800640 1 -- 172.21.15.18:0/3791197378 shutdown_connections 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.348+0000 7fb193800640 1 -- 172.21.15.18:0/3791197378 wait complete. 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb193800640 1 Processor -- start 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb193800640 1 -- start start 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb193800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c102200 0x7fb18c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb193800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18c102bb0 0x7fb18c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb193800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb18c107330 0x7fb18c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb193800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c19d3d0 con 0x7fb18c107330 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb193800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c19d540 con 0x7fb18c102bb0 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb193800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c19d6b0 con 0x7fb18c102200 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb190e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c102200 0x7fb18c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb191800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb18c107330 0x7fb18c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb190e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c102200 0x7fb18c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:45002/0 (socket says 172.21.15.18:45002) 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb190e00640 1 -- 172.21.15.18:0/1664349740 learned_addr learned my addr 172.21.15.18:0/1664349740 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.349+0000 7fb18be00640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18c102bb0 0x7fb18c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb190e00640 1 -- 172.21.15.18:0/1664349740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18c102bb0 msgr2=0x7fb18c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb190e00640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18c102bb0 0x7fb18c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb190e00640 1 -- 172.21.15.18:0/1664349740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb18c107330 msgr2=0x7fb18c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb190e00640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb18c107330 0x7fb18c19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb190e00640 1 -- 172.21.15.18:0/1664349740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184009900 con 0x7fb18c102200 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb190e00640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c102200 0x7fb18c198490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb18000e9f0 tx=0x7fb18000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb189600640 1 -- 172.21.15.18:0/1664349740 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180009700 con 0x7fb18c102200 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb189600640 1 -- 172.21.15.18:0/1664349740 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb18000cd80 con 0x7fb18c102200 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb193800640 1 -- 172.21.15.18:0/1664349740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c19d990 con 0x7fb18c102200 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb189600640 1 -- 172.21.15.18:0/1664349740 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180018860 con 0x7fb18c102200 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.350+0000 7fb193800640 1 -- 172.21.15.18:0/1664349740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c1a5250 con 0x7fb18c102200 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.351+0000 7fb193800640 1 -- 172.21.15.18:0/1664349740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c1036e0 con 0x7fb18c102200 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.353+0000 7fb189600640 1 -- 172.21.15.18:0/1664349740 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb1800189c0 con 0x7fb18c102200 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.355+0000 7fb189600640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb1740a1190 0x7fb1740a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.355+0000 7fb189600640 1 -- 172.21.15.18:0/1664349740 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb180014070 con 0x7fb18c102200 2024-09-13T16:50:59.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.355+0000 7fb18be00640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb1740a1190 0x7fb1740a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:50:59.371 INFO:teuthology.orchestra.run.smithi018.stdout:343597383711 2024-09-13T16:50:59.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.356+0000 7fb18be00640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb1740a1190 0x7fb1740a3650 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb18c199a40 tx=0x7fb178005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:50:59.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.356+0000 7fb189600640 1 -- 172.21.15.18:0/1664349740 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb180096390 con 0x7fb18c102200 2024-09-13T16:50:59.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.538+0000 7fb193800640 1 -- 172.21.15.18:0/1664349740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fb18c1025e0 con 0x7fb18c102200 2024-09-13T16:50:59.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.539+0000 7fb189600640 1 -- 172.21.15.18:0/1664349740 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fb1800999b0 con 0x7fb18c102200 2024-09-13T16:50:59.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 -- 172.21.15.18:0/1664349740 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb1740a1190 msgr2=0x7fb1740a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:59.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb1740a1190 0x7fb1740a3650 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb18c199a40 tx=0x7fb178005f90 comp rx=0 tx=0).stop 2024-09-13T16:50:59.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 -- 172.21.15.18:0/1664349740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c102200 msgr2=0x7fb18c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:50:59.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c102200 0x7fb18c198490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb18000e9f0 tx=0x7fb18000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 -- 172.21.15.18:0/1664349740 shutdown_connections 2024-09-13T16:50:59.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb1740a1190 0x7fb1740a3650 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb18c107330 0x7fb18c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb18c102bb0 0x7fb18c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 --2- 172.21.15.18:0/1664349740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c102200 0x7fb18c198490 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:50:59.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 -- 172.21.15.18:0/1664349740 >> 172.21.15.18:0/1664349740 conn(0x7fb18c0fdc40 msgr2=0x7fb18c0fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:50:59.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 -- 172.21.15.18:0/1664349740 shutdown_connections 2024-09-13T16:50:59.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:50:58.542+0000 7fb193800640 1 -- 172.21.15.18:0/1664349740 wait complete. 2024-09-13T16:51:00.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:50:59 smithi018 ceph-mon[30981]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:00.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:50:59 smithi094 ceph-mon[35259]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:00.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:50:59 smithi144 ceph-mon[35328]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:00.625 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383706 got 343597383711 for osd.11 2024-09-13T16:51:00.625 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:00.994 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:00 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2067624362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T16:51:01.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.254+0000 7f27f0000640 1 -- 172.21.15.18:0/1026598610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e8102200 msgr2=0x7f27e81025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:01.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.254+0000 7f27f0000640 1 --2- 172.21.15.18:0/1026598610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e8102200 0x7f27e81025e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009930 tx=0x7f27dc02a420 comp rx=0 tx=0).stop 2024-09-13T16:51:01.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.254+0000 7f27f0000640 1 -- 172.21.15.18:0/1026598610 shutdown_connections 2024-09-13T16:51:01.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.254+0000 7f27f0000640 1 --2- 172.21.15.18:0/1026598610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27e8107330 0x7f27e810eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.254+0000 7f27f0000640 1 --2- 172.21.15.18:0/1026598610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e8102bb0 0x7f27e8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.254+0000 7f27f0000640 1 --2- 172.21.15.18:0/1026598610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e8102200 0x7f27e81025e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.254+0000 7f27f0000640 1 -- 172.21.15.18:0/1026598610 >> 172.21.15.18:0/1026598610 conn(0x7f27e80fdc40 msgr2=0x7f27e8100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.254+0000 7f27f0000640 1 -- 172.21.15.18:0/1026598610 shutdown_connections 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.254+0000 7f27f0000640 1 -- 172.21.15.18:0/1026598610 wait complete. 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27f0000640 1 Processor -- start 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27f0000640 1 -- start start 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27f0000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27e8102200 0x7f27e8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27f0000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e8102bb0 0x7f27e8198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27f0000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e8107330 0x7f27e819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27f0000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e819d4a0 con 0x7f27e8107330 2024-09-13T16:51:01.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27f0000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e819d610 con 0x7f27e8102200 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27f0000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e819d780 con 0x7f27e8102bb0 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27ed600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27e8102200 0x7f27e8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27ee000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e8107330 0x7f27e819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.255+0000 7f27ed600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27e8102200 0x7f27e8198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:50656/0 (socket says 172.21.15.18:50656) 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.256+0000 7f27ed600640 1 -- 172.21.15.18:0/2067624362 learned_addr learned my addr 172.21.15.18:0/2067624362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.256+0000 7f27ecc00640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e8102bb0 0x7f27e8198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.256+0000 7f27ed600640 1 -- 172.21.15.18:0/2067624362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e8102bb0 msgr2=0x7f27e8198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.256+0000 7f27ed600640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e8102bb0 0x7f27e8198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.256+0000 7f27ed600640 1 -- 172.21.15.18:0/2067624362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e8107330 msgr2=0x7f27e819cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.256+0000 7f27ed600640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e8107330 0x7f27e819cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.256+0000 7f27ed600640 1 -- 172.21.15.18:0/2067624362 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc009560 con 0x7f27e8102200 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.256+0000 7f27ed600640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27e8102200 0x7f27e8198560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f27dc005ab0 tx=0x7f27dc003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.256+0000 7f27e6000640 1 -- 172.21.15.18:0/2067624362 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc003e00 con 0x7f27e8102200 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.257+0000 7f27e6000640 1 -- 172.21.15.18:0/2067624362 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27dc031b70 con 0x7f27e8102200 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.257+0000 7f27f0000640 1 -- 172.21.15.18:0/2067624362 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e819da00 con 0x7f27e8102200 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.257+0000 7f27e6000640 1 -- 172.21.15.18:0/2067624362 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc03bb70 con 0x7f27e8102200 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.257+0000 7f27f0000640 1 -- 172.21.15.18:0/2067624362 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e81a5150 con 0x7f27e8102200 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.258+0000 7f27f0000640 1 -- 172.21.15.18:0/2067624362 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e81036e0 con 0x7f27e8102200 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.260+0000 7f27e6000640 1 -- 172.21.15.18:0/2067624362 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f27dc03bcd0 con 0x7f27e8102200 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.261+0000 7f27e6000640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27d00a1110 0x7f27d00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.261+0000 7f27e6000640 1 -- 172.21.15.18:0/2067624362 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f27dc0ed950 con 0x7f27e8102200 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.261+0000 7f27ecc00640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27d00a1110 0x7f27d00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.262+0000 7f27ecc00640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27d00a1110 0x7f27d00a35d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f27e8199b10 tx=0x7f27d400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.263+0000 7f27e6000640 1 -- 172.21.15.18:0/2067624362 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f27dc0b6cc0 con 0x7f27e8102200 2024-09-13T16:51:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.445+0000 7f27f0000640 1 -- 172.21.15.18:0/2067624362 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f27e81998c0 con 0x7f27e8102200 2024-09-13T16:51:01.096 INFO:teuthology.orchestra.run.smithi018.stdout:163208757311 2024-09-13T16:51:01.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.446+0000 7f27e6000640 1 -- 172.21.15.18:0/2067624362 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27dc035020 con 0x7f27e8102200 2024-09-13T16:51:01.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.448+0000 7f27f0000640 1 -- 172.21.15.18:0/2067624362 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27d00a1110 msgr2=0x7f27d00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:01.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.448+0000 7f27f0000640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27d00a1110 0x7f27d00a35d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f27e8199b10 tx=0x7f27d400b410 comp rx=0 tx=0).stop 2024-09-13T16:51:01.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.448+0000 7f27f0000640 1 -- 172.21.15.18:0/2067624362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27e8102200 msgr2=0x7f27e8198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:01.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.448+0000 7f27f0000640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27e8102200 0x7f27e8198560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f27dc005ab0 tx=0x7f27dc003c10 comp rx=0 tx=0).stop 2024-09-13T16:51:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.448+0000 7f27f0000640 1 -- 172.21.15.18:0/2067624362 shutdown_connections 2024-09-13T16:51:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.448+0000 7f27f0000640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27d00a1110 0x7f27d00a35d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.448+0000 7f27f0000640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e8107330 0x7f27e819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.448+0000 7f27f0000640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e8102bb0 0x7f27e8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.448+0000 7f27f0000640 1 --2- 172.21.15.18:0/2067624362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27e8102200 0x7f27e8198560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.448+0000 7f27f0000640 1 -- 172.21.15.18:0/2067624362 >> 172.21.15.18:0/2067624362 conn(0x7f27e80fdc40 msgr2=0x7f27e80ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.449+0000 7f27f0000640 1 -- 172.21.15.18:0/2067624362 shutdown_connections 2024-09-13T16:51:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:00.449+0000 7f27f0000640 1 -- 172.21.15.18:0/2067624362 wait complete. 2024-09-13T16:51:01.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:00 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2067624362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T16:51:01.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:00 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2067624362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T16:51:01.993 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:01 smithi018 ceph-mon[30981]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:02.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:01 smithi094 ceph-mon[35259]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:02.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:01 smithi144 ceph-mon[35328]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:03.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:03 smithi018 ceph-mon[30981]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:04.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.096+0000 7f5536200640 1 -- 172.21.15.18:0/1181476707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5530102bb0 msgr2=0x7f5530106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.096+0000 7f5536200640 1 --2- 172.21.15.18:0/1181476707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5530102bb0 0x7f5530106c00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5518009890 tx=0x7f551802a360 comp rx=0 tx=0).stop 2024-09-13T16:51:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.096+0000 7f5536200640 1 -- 172.21.15.18:0/1181476707 shutdown_connections 2024-09-13T16:51:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.096+0000 7f5536200640 1 --2- 172.21.15.18:0/1181476707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5530107330 0x7f553010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.096+0000 7f5536200640 1 --2- 172.21.15.18:0/1181476707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5530102bb0 0x7f5530106c00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.096+0000 7f5536200640 1 --2- 172.21.15.18:0/1181476707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530102200 0x7f55301025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.096+0000 7f5536200640 1 -- 172.21.15.18:0/1181476707 >> 172.21.15.18:0/1181476707 conn(0x7f55300fdc60 msgr2=0x7f5530100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.096+0000 7f5536200640 1 -- 172.21.15.18:0/1181476707 shutdown_connections 2024-09-13T16:51:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.096+0000 7f5536200640 1 -- 172.21.15.18:0/1181476707 wait complete. 2024-09-13T16:51:04.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.097+0000 7f5536200640 1 Processor -- start 2024-09-13T16:51:04.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.097+0000 7f5536200640 1 -- start start 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.097+0000 7f5536200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530102200 0x7f5530198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f5536200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5530102bb0 0x7f5530198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f5536200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5530107330 0x7f553019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f5536200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553019d470 con 0x7f5530107330 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f5536200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553019d5e0 con 0x7f5530102bb0 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f5536200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553019d750 con 0x7f5530102200 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f5527e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5530102bb0 0x7f5530198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f552f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530102200 0x7f5530198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f5527e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5530102bb0 0x7f5530198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:50558/0 (socket says 172.21.15.18:50558) 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f5527e00640 1 -- 172.21.15.18:0/2845480129 learned_addr learned my addr 172.21.15.18:0/2845480129 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f552fe00640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5530107330 0x7f553019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.098+0000 7f552f400640 1 -- 172.21.15.18:0/2845480129 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5530102bb0 msgr2=0x7f5530198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.099+0000 7f552f400640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5530102bb0 0x7f5530198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.099+0000 7f552f400640 1 -- 172.21.15.18:0/2845480129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5530107330 msgr2=0x7f553019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.099+0000 7f552f400640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5530107330 0x7f553019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.099+0000 7f552f400640 1 -- 172.21.15.18:0/2845480129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528009900 con 0x7f5530102200 2024-09-13T16:51:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.099+0000 7f552f400640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530102200 0x7f5530198530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f552000e9f0 tx=0x7f552000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.099+0000 7f552cc00640 1 -- 172.21.15.18:0/2845480129 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552000ccc0 con 0x7f5530102200 2024-09-13T16:51:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.099+0000 7f552cc00640 1 -- 172.21.15.18:0/2845480129 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f552000ce20 con 0x7f5530102200 2024-09-13T16:51:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.099+0000 7f5536200640 1 -- 172.21.15.18:0/2845480129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5518009490 con 0x7f5530102200 2024-09-13T16:51:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.099+0000 7f552cc00640 1 -- 172.21.15.18:0/2845480129 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520004a00 con 0x7f5530102200 2024-09-13T16:51:04.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.099+0000 7f5536200640 1 -- 172.21.15.18:0/2845480129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55301a5120 con 0x7f5530102200 2024-09-13T16:51:04.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.101+0000 7f5536200640 1 -- 172.21.15.18:0/2845480129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55301036e0 con 0x7f5530102200 2024-09-13T16:51:04.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.103+0000 7f552cc00640 1 -- 172.21.15.18:0/2845480129 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5520005020 con 0x7f5530102200 2024-09-13T16:51:04.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.104+0000 7f552cc00640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55140a1110 0x7f55140a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:04.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.104+0000 7f552cc00640 1 -- 172.21.15.18:0/2845480129 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5520014070 con 0x7f5530102200 2024-09-13T16:51:04.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.104+0000 7f5527e00640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55140a1110 0x7f55140a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:04.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.106+0000 7f5527e00640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55140a1110 0x7f55140a35d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5530199ae0 tx=0x7f55180056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:04.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.107+0000 7f552cc00640 1 -- 172.21.15.18:0/2845480129 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5520096820 con 0x7f5530102200 2024-09-13T16:51:04.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:03 smithi094 ceph-mon[35259]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:04.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:03 smithi144 ceph-mon[35328]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:04.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.293+0000 7f5536200640 1 -- 172.21.15.18:0/2845480129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f55301025e0 con 0x7f5530102200 2024-09-13T16:51:04.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.294+0000 7f552cc00640 1 -- 172.21.15.18:0/2845480129 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5520099e40 con 0x7f5530102200 2024-09-13T16:51:04.297 INFO:teuthology.orchestra.run.smithi018.stdout:34359738455 2024-09-13T16:51:04.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 -- 172.21.15.18:0/2845480129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55140a1110 msgr2=0x7f55140a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:04.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55140a1110 0x7f55140a35d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5530199ae0 tx=0x7f55180056d0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 -- 172.21.15.18:0/2845480129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530102200 msgr2=0x7f5530198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:04.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530102200 0x7f5530198530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f552000e9f0 tx=0x7f552000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 -- 172.21.15.18:0/2845480129 shutdown_connections 2024-09-13T16:51:04.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55140a1110 0x7f55140a35d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5530107330 0x7f553019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5530102bb0 0x7f5530198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 --2- 172.21.15.18:0/2845480129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530102200 0x7f5530198530 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 -- 172.21.15.18:0/2845480129 >> 172.21.15.18:0/2845480129 conn(0x7f55300fdc60 msgr2=0x7f55300ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 -- 172.21.15.18:0/2845480129 shutdown_connections 2024-09-13T16:51:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:04.296+0000 7f5536200640 1 -- 172.21.15.18:0/2845480129 wait complete. 2024-09-13T16:51:05.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:04 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2845480129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T16:51:05.177 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:04 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2845480129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T16:51:05.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:04 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2845480129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T16:51:05.526 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757306 got 163208757311 for osd.5 2024-09-13T16:51:05.526 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:06.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:05 smithi094 ceph-mon[35259]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:06.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:05 smithi018 ceph-mon[30981]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:06.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:05 smithi144 ceph-mon[35328]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.513+0000 7f8c4e000640 1 -- 172.21.15.18:0/4107102193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c48105110 msgr2=0x7f8c4810cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.513+0000 7f8c4e000640 1 --2- 172.21.15.18:0/4107102193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c48105110 0x7f8c4810cc90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009cd0 tx=0x7f8c4002a8e0 comp rx=0 tx=0).stop 2024-09-13T16:51:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.513+0000 7f8c4e000640 1 -- 172.21.15.18:0/4107102193 shutdown_connections 2024-09-13T16:51:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.513+0000 7f8c4e000640 1 --2- 172.21.15.18:0/4107102193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c48105110 0x7f8c4810cc90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.513+0000 7f8c4e000640 1 --2- 172.21.15.18:0/4107102193 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c48100990 0x7f8c481049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.513+0000 7f8c4e000640 1 --2- 172.21.15.18:0/4107102193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c480fffe0 0x7f8c481003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.513+0000 7f8c4e000640 1 -- 172.21.15.18:0/4107102193 >> 172.21.15.18:0/4107102193 conn(0x7f8c480fba80 msgr2=0x7f8c480fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.513+0000 7f8c4e000640 1 -- 172.21.15.18:0/4107102193 shutdown_connections 2024-09-13T16:51:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.513+0000 7f8c4e000640 1 -- 172.21.15.18:0/4107102193 wait complete. 2024-09-13T16:51:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.514+0000 7f8c4e000640 1 Processor -- start 2024-09-13T16:51:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c4e000640 1 -- start start 2024-09-13T16:51:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c4e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c480fffe0 0x7f8c481984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c4e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c48100990 0x7f8c48198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c4e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c48105110 0x7f8c4819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c4e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4819d340 con 0x7f8c48100990 2024-09-13T16:51:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c4e000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4819d4b0 con 0x7f8c480fffe0 2024-09-13T16:51:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c4e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4819d620 con 0x7f8c48105110 2024-09-13T16:51:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c46a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c48100990 0x7f8c48198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c47400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c480fffe0 0x7f8c481984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c46a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c48100990 0x7f8c48198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48880/0 (socket says 172.21.15.18:48880) 2024-09-13T16:51:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c46a00640 1 -- 172.21.15.18:0/3211803848 learned_addr learned my addr 172.21.15.18:0/3211803848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.515+0000 7f8c47e00640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c48105110 0x7f8c4819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.516+0000 7f8c46a00640 1 -- 172.21.15.18:0/3211803848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c48105110 msgr2=0x7f8c4819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.516+0000 7f8c46a00640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c48105110 0x7f8c4819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.516+0000 7f8c46a00640 1 -- 172.21.15.18:0/3211803848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c480fffe0 msgr2=0x7f8c481984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.516+0000 7f8c46a00640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c480fffe0 0x7f8c481984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.516+0000 7f8c46a00640 1 -- 172.21.15.18:0/3211803848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c40009900 con 0x7f8c48100990 2024-09-13T16:51:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.516+0000 7f8c46a00640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c48100990 0x7f8c48198a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400d950 tx=0x7f8c3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.516+0000 7f8c3fe00640 1 -- 172.21.15.18:0/3211803848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34009a30 con 0x7f8c48100990 2024-09-13T16:51:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.516+0000 7f8c3fe00640 1 -- 172.21.15.18:0/3211803848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c34009b90 con 0x7f8c48100990 2024-09-13T16:51:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.516+0000 7f8c3fe00640 1 -- 172.21.15.18:0/3211803848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c340047a0 con 0x7f8c48100990 2024-09-13T16:51:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.516+0000 7f8c4e000640 1 -- 172.21.15.18:0/3211803848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4819d900 con 0x7f8c48100990 2024-09-13T16:51:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.517+0000 7f8c4e000640 1 -- 172.21.15.18:0/3211803848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c481a51c0 con 0x7f8c48100990 2024-09-13T16:51:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.518+0000 7f8c4e000640 1 -- 172.21.15.18:0/3211803848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c481014c0 con 0x7f8c48100990 2024-09-13T16:51:06.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.520+0000 7f8c3fe00640 1 -- 172.21.15.18:0/3211803848 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8c34009d00 con 0x7f8c48100990 2024-09-13T16:51:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.522+0000 7f8c3fe00640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8c2c0a1190 0x7f8c2c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.522+0000 7f8c3fe00640 1 -- 172.21.15.18:0/3211803848 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8c340cc6f0 con 0x7f8c48100990 2024-09-13T16:51:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.522+0000 7f8c47400640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8c2c0a1190 0x7f8c2c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.523+0000 7f8c47400640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8c2c0a1190 0x7f8c2c0a3650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8c38005fd0 tx=0x7f8c3800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.525+0000 7f8c3fe00640 1 -- 172.21.15.18:0/3211803848 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8c340959b0 con 0x7f8c48100990 2024-09-13T16:51:06.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.715+0000 7f8c4e000640 1 -- 172.21.15.18:0/3211803848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c4810fde0 con 0x7f8c48100990 2024-09-13T16:51:06.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.716+0000 7f8c3fe00640 1 -- 172.21.15.18:0/3211803848 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c34098fd0 con 0x7f8c48100990 2024-09-13T16:51:06.718 INFO:teuthology.orchestra.run.smithi018.stdout:107374182473 2024-09-13T16:51:06.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 -- 172.21.15.18:0/3211803848 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8c2c0a1190 msgr2=0x7f8c2c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8c2c0a1190 0x7f8c2c0a3650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8c38005fd0 tx=0x7f8c3800b390 comp rx=0 tx=0).stop 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 -- 172.21.15.18:0/3211803848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c48100990 msgr2=0x7f8c48198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c48100990 0x7f8c48198a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400d950 tx=0x7f8c3400de10 comp rx=0 tx=0).stop 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 -- 172.21.15.18:0/3211803848 shutdown_connections 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8c2c0a1190 0x7f8c2c0a3650 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c48100990 0x7f8c48198a00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c48105110 0x7f8c4819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 --2- 172.21.15.18:0/3211803848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c480fffe0 0x7f8c481984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 -- 172.21.15.18:0/3211803848 >> 172.21.15.18:0/3211803848 conn(0x7f8c480fba80 msgr2=0x7f8c480fbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.718+0000 7f8c4e000640 1 -- 172.21.15.18:0/3211803848 shutdown_connections 2024-09-13T16:51:06.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.719+0000 7f8c4e000640 1 -- 172.21.15.18:0/3211803848 wait complete. 2024-09-13T16:51:06.932 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:06 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3211803848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T16:51:07.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:06 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3211803848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T16:51:07.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:06 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3211803848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T16:51:08.165 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:07 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/795044799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T16:51:08.165 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:07 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3899338065' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T16:51:08.165 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:07 smithi094 ceph-mon[35259]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:08.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:07 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/795044799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T16:51:08.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:07 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3899338065' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T16:51:08.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:07 smithi018 ceph-mon[30981]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:08.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:07 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/795044799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T16:51:08.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:07 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3899338065' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T16:51:08.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:07 smithi144 ceph-mon[35328]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.542+0000 7f119a000640 1 -- 172.21.15.18:0/3806319593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1194102010 msgr2=0x7f11941023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.542+0000 7f119a000640 1 --2- 172.21.15.18:0/3806319593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1194102010 0x7f11941023f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1184009930 tx=0x7f118402a420 comp rx=0 tx=0).stop 2024-09-13T16:51:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.542+0000 7f119a000640 1 -- 172.21.15.18:0/3806319593 shutdown_connections 2024-09-13T16:51:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.542+0000 7f119a000640 1 --2- 172.21.15.18:0/3806319593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194107140 0x7f119410ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.542+0000 7f119a000640 1 --2- 172.21.15.18:0/3806319593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11941029c0 0x7f1194106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.542+0000 7f119a000640 1 --2- 172.21.15.18:0/3806319593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1194102010 0x7f11941023f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.542+0000 7f119a000640 1 -- 172.21.15.18:0/3806319593 >> 172.21.15.18:0/3806319593 conn(0x7f11940fda70 msgr2=0x7f11940ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.542+0000 7f119a000640 1 -- 172.21.15.18:0/3806319593 shutdown_connections 2024-09-13T16:51:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.542+0000 7f119a000640 1 -- 172.21.15.18:0/3806319593 wait complete. 2024-09-13T16:51:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.543+0000 7f119a000640 1 Processor -- start 2024-09-13T16:51:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.543+0000 7f119a000640 1 -- start start 2024-09-13T16:51:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.543+0000 7f119a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194102010 0x7f11941982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.543+0000 7f119a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11941029c0 0x7f1194198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.543+0000 7f119a000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1194107140 0x7f119419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.543+0000 7f119a000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119419d210 con 0x7f11941029c0 2024-09-13T16:51:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.543+0000 7f119a000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119419d380 con 0x7f1194107140 2024-09-13T16:51:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.543+0000 7f119a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119419d4f0 con 0x7f1194102010 2024-09-13T16:51:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.544+0000 7f1198c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194102010 0x7f11941982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.544+0000 7f118be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11941029c0 0x7f1194198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.544+0000 7f1198c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194102010 0x7f11941982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:36070/0 (socket says 172.21.15.18:36070) 2024-09-13T16:51:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.544+0000 7f1198c00640 1 -- 172.21.15.18:0/1602337457 learned_addr learned my addr 172.21.15.18:0/1602337457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.544+0000 7f1199600640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1194107140 0x7f119419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.544+0000 7f1198c00640 1 -- 172.21.15.18:0/1602337457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1194107140 msgr2=0x7f119419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.544+0000 7f1198c00640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1194107140 0x7f119419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.544+0000 7f1198c00640 1 -- 172.21.15.18:0/1602337457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11941029c0 msgr2=0x7f1194198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.544+0000 7f1198c00640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11941029c0 0x7f1194198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.544+0000 7f1198c00640 1 -- 172.21.15.18:0/1602337457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184009560 con 0x7f1194102010 2024-09-13T16:51:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.545+0000 7f1198c00640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194102010 0x7f11941982d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1184005ab0 tx=0x7f1184003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:08.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.545+0000 7f1192000640 1 -- 172.21.15.18:0/1602337457 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1184003e00 con 0x7f1194102010 2024-09-13T16:51:08.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.545+0000 7f1192000640 1 -- 172.21.15.18:0/1602337457 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1184031b70 con 0x7f1194102010 2024-09-13T16:51:08.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.545+0000 7f119a000640 1 -- 172.21.15.18:0/1602337457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119419d770 con 0x7f1194102010 2024-09-13T16:51:08.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.545+0000 7f1192000640 1 -- 172.21.15.18:0/1602337457 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118403bb50 con 0x7f1194102010 2024-09-13T16:51:08.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.545+0000 7f119a000640 1 -- 172.21.15.18:0/1602337457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11941a4ec0 con 0x7f1194102010 2024-09-13T16:51:08.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.546+0000 7f119a000640 1 -- 172.21.15.18:0/1602337457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11941034f0 con 0x7f1194102010 2024-09-13T16:51:08.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.548+0000 7f1192000640 1 -- 172.21.15.18:0/1602337457 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f118403bcb0 con 0x7f1194102010 2024-09-13T16:51:08.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.550+0000 7f1192000640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f11780a1100 0x7f11780a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:08.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.550+0000 7f1192000640 1 -- 172.21.15.18:0/1602337457 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f11840ed970 con 0x7f1194102010 2024-09-13T16:51:08.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.550+0000 7f118be00640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f11780a1100 0x7f11780a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:08.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.551+0000 7f118be00640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f11780a1100 0x7f11780a35c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1194199880 tx=0x7f117c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:08.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.552+0000 7f1192000640 1 -- 172.21.15.18:0/1602337457 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f11840b6ce0 con 0x7f1194102010 2024-09-13T16:51:08.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.318+0000 7fc058800640 1 -- 172.21.15.18:0/648840601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0501009a0 msgr2=0x7fc0501049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:08.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.318+0000 7fc058800640 1 --2- 172.21.15.18:0/648840601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0501009a0 0x7fc0501049f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc040009930 tx=0x7fc04002a420 comp rx=0 tx=0).stop 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.319+0000 7fc058800640 1 -- 172.21.15.18:0/648840601 shutdown_connections 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.319+0000 7fc058800640 1 --2- 172.21.15.18:0/648840601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0501009a0 0x7fc0501049f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.319+0000 7fc058800640 1 --2- 172.21.15.18:0/648840601 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc050105120 0x7fc05010cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.319+0000 7fc058800640 1 --2- 172.21.15.18:0/648840601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0500ffff0 0x7fc0501003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.319+0000 7fc058800640 1 -- 172.21.15.18:0/648840601 >> 172.21.15.18:0/648840601 conn(0x7fc0500fba90 msgr2=0x7fc0500fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.319+0000 7fc058800640 1 -- 172.21.15.18:0/648840601 shutdown_connections 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.319+0000 7fc058800640 1 -- 172.21.15.18:0/648840601 wait complete. 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc058800640 1 Processor -- start 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc058800640 1 -- start start 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc058800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0500ffff0 0x7fc0501962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc058800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0501009a0 0x7fc050196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc058800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc050105120 0x7fc05019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc058800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05019b200 con 0x7fc0500ffff0 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc058800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05019b370 con 0x7fc0501009a0 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc058800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05019b4e0 con 0x7fc050105120 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc055e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0500ffff0 0x7fc0501962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc055e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0500ffff0 0x7fc0501962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48920/0 (socket says 172.21.15.18:48920) 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc055e00640 1 -- 172.21.15.18:0/3899338065 learned_addr learned my addr 172.21.15.18:0/3899338065 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc055400640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0501009a0 0x7fc050196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.320+0000 7fc056800640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc050105120 0x7fc05019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.321+0000 7fc055e00640 1 -- 172.21.15.18:0/3899338065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc050105120 msgr2=0x7fc05019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.321+0000 7fc055e00640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc050105120 0x7fc05019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.321+0000 7fc055e00640 1 -- 172.21.15.18:0/3899338065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0501009a0 msgr2=0x7fc050196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.321+0000 7fc055e00640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0501009a0 0x7fc050196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.321+0000 7fc055e00640 1 -- 172.21.15.18:0/3899338065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c009840 con 0x7fc0500ffff0 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.321+0000 7fc055e00640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0500ffff0 0x7fc0501962c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc04400e9f0 tx=0x7fc04400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.321+0000 7fc04aa00640 1 -- 172.21.15.18:0/3899338065 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044009720 con 0x7fc0500ffff0 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.321+0000 7fc04aa00640 1 -- 172.21.15.18:0/3899338065 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0440054e0 con 0x7fc0500ffff0 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.321+0000 7fc058800640 1 -- 172.21.15.18:0/3899338065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc040009560 con 0x7fc0500ffff0 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.322+0000 7fc04aa00640 1 -- 172.21.15.18:0/3899338065 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044010430 con 0x7fc0500ffff0 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.322+0000 7fc058800640 1 -- 172.21.15.18:0/3899338065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0501a2eb0 con 0x7fc0500ffff0 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.323+0000 7fc058800640 1 -- 172.21.15.18:0/3899338065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0501014d0 con 0x7fc0500ffff0 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.325+0000 7fc04aa00640 1 -- 172.21.15.18:0/3899338065 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc044004ff0 con 0x7fc0500ffff0 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.327+0000 7fc04aa00640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc0380a1190 0x7fc0380a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.327+0000 7fc04aa00640 1 -- 172.21.15.18:0/3899338065 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc044014070 con 0x7fc0500ffff0 2024-09-13T16:51:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.327+0000 7fc055400640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc0380a1190 0x7fc0380a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.328+0000 7fc055400640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc0380a1190 0x7fc0380a3650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc040005940 tx=0x7fc0400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:08.645 INFO:teuthology.orchestra.run.smithi018.stdout:77309411406 2024-09-13T16:51:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.331+0000 7fc04aa00640 1 -- 172.21.15.18:0/3899338065 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc0440963b0 con 0x7fc0500ffff0 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.528+0000 7fc058800640 1 -- 172.21.15.18:0/3899338065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0501003d0 con 0x7fc0500ffff0 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.529+0000 7fc04aa00640 1 -- 172.21.15.18:0/3899338065 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0440999d0 con 0x7fc0500ffff0 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 -- 172.21.15.18:0/3899338065 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc0380a1190 msgr2=0x7fc0380a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc0380a1190 0x7fc0380a3650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc040005940 tx=0x7fc0400058d0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 -- 172.21.15.18:0/3899338065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0500ffff0 msgr2=0x7fc0501962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0500ffff0 0x7fc0501962c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc04400e9f0 tx=0x7fc04400edf0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 -- 172.21.15.18:0/3899338065 shutdown_connections 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc050105120 0x7fc05019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0501009a0 0x7fc050196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc0380a1190 0x7fc0380a3650 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 --2- 172.21.15.18:0/3899338065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0500ffff0 0x7fc0501962c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 -- 172.21.15.18:0/3899338065 >> 172.21.15.18:0/3899338065 conn(0x7fc0500fba90 msgr2=0x7fc0500fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 -- 172.21.15.18:0/3899338065 shutdown_connections 2024-09-13T16:51:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.532+0000 7fc058800640 1 -- 172.21.15.18:0/3899338065 wait complete. 2024-09-13T16:51:08.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.734+0000 7f119a000640 1 -- 172.21.15.18:0/1602337457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f11941996d0 con 0x7f1194102010 2024-09-13T16:51:08.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.735+0000 7f1192000640 1 -- 172.21.15.18:0/1602337457 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11840ba300 con 0x7f1194102010 2024-09-13T16:51:08.737 INFO:teuthology.orchestra.run.smithi018.stdout:287762808875 2024-09-13T16:51:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 -- 172.21.15.18:0/1602337457 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f11780a1100 msgr2=0x7f11780a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f11780a1100 0x7f11780a35c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1194199880 tx=0x7f117c00b410 comp rx=0 tx=0).stop 2024-09-13T16:51:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 -- 172.21.15.18:0/1602337457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194102010 msgr2=0x7f11941982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194102010 0x7f11941982d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1184005ab0 tx=0x7f1184003c10 comp rx=0 tx=0).stop 2024-09-13T16:51:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 -- 172.21.15.18:0/1602337457 shutdown_connections 2024-09-13T16:51:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f11780a1100 0x7f11780a35c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11941029c0 0x7f1194198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1194107140 0x7f119419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 --2- 172.21.15.18:0/1602337457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1194102010 0x7f11941982d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 -- 172.21.15.18:0/1602337457 >> 172.21.15.18:0/1602337457 conn(0x7f11940fda70 msgr2=0x7f11940feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 -- 172.21.15.18:0/1602337457 shutdown_connections 2024-09-13T16:51:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:08.737+0000 7f119a000640 1 -- 172.21.15.18:0/1602337457 wait complete. 2024-09-13T16:51:09.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:08 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1602337457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T16:51:09.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:08 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1602337457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T16:51:09.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:08 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1602337457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T16:51:09.438 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738449 got 34359738455 for osd.0 2024-09-13T16:51:09.439 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:10.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:09 smithi018 ceph-mon[30981]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:10.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:09 smithi094 ceph-mon[35259]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:10.191 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411400 got 77309411406 for osd.2 2024-09-13T16:51:10.191 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:10.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:09 smithi144 ceph-mon[35328]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:10.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.750+0000 7fe2bb200640 1 -- 172.21.15.18:0/1492895180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4110c40 msgr2=0x7fe2b4113030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.750+0000 7fe2bb200640 1 --2- 172.21.15.18:0/1492895180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4110c40 0x7fe2b4113030 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009ca0 tx=0x7fe2ac02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.751+0000 7fe2bb200640 1 -- 172.21.15.18:0/1492895180 shutdown_connections 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.751+0000 7fe2bb200640 1 --2- 172.21.15.18:0/1492895180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4110c40 0x7fe2b4113030 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.751+0000 7fe2bb200640 1 --2- 172.21.15.18:0/1492895180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4075300 0x7fe2b4110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.751+0000 7fe2bb200640 1 --2- 172.21.15.18:0/1492895180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b40749e0 0x7fe2b4074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.751+0000 7fe2bb200640 1 -- 172.21.15.18:0/1492895180 >> 172.21.15.18:0/1492895180 conn(0x7fe2b40fdc60 msgr2=0x7fe2b4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.751+0000 7fe2bb200640 1 -- 172.21.15.18:0/1492895180 shutdown_connections 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.751+0000 7fe2bb200640 1 -- 172.21.15.18:0/1492895180 wait complete. 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.752+0000 7fe2bb200640 1 Processor -- start 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.752+0000 7fe2bb200640 1 -- start start 2024-09-13T16:51:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.752+0000 7fe2bb200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b40749e0 0x7fe2b41a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2bb200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4075300 0x7fe2b41a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2bb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4110c40 0x7fe2b419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2bb200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b419ce60 con 0x7fe2b4075300 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2bb200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b419cfd0 con 0x7fe2b40749e0 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2bb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b419d190 con 0x7fe2b4110c40 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2b3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4075300 0x7fe2b41a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2b3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b40749e0 0x7fe2b41a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2b3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4075300 0x7fe2b41a2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48972/0 (socket says 172.21.15.18:48972) 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2b3400640 1 -- 172.21.15.18:0/377213202 learned_addr learned my addr 172.21.15.18:0/377213202 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2b9200640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4110c40 0x7fe2b419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:10.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2b3e00640 1 -- 172.21.15.18:0/377213202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4110c40 msgr2=0x7fe2b419c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2b3e00640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4110c40 0x7fe2b419c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2b3e00640 1 -- 172.21.15.18:0/377213202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4075300 msgr2=0x7fe2b41a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2b3e00640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4075300 0x7fe2b41a2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.753+0000 7fe2b3e00640 1 -- 172.21.15.18:0/377213202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac009900 con 0x7fe2b40749e0 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.754+0000 7fe2b3e00640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b40749e0 0x7fe2b41a2670 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400e9f0 tx=0x7fe2a400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.754+0000 7fe2b0c00640 1 -- 172.21.15.18:0/377213202 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a400ccc0 con 0x7fe2b40749e0 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.754+0000 7fe2bb200640 1 -- 172.21.15.18:0/377213202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b419d470 con 0x7fe2b40749e0 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.754+0000 7fe2b0c00640 1 -- 172.21.15.18:0/377213202 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2a400ce20 con 0x7fe2b40749e0 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.754+0000 7fe2b0c00640 1 -- 172.21.15.18:0/377213202 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40187c0 con 0x7fe2b40749e0 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.754+0000 7fe2bb200640 1 -- 172.21.15.18:0/377213202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b41a9660 con 0x7fe2b40749e0 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.755+0000 7fe2bb200640 1 -- 172.21.15.18:0/377213202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b4076120 con 0x7fe2b40749e0 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.757+0000 7fe2b0c00640 1 -- 172.21.15.18:0/377213202 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe2a4010430 con 0x7fe2b40749e0 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.758+0000 7fe2b0c00640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2980a1190 0x7fe2980a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:10.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.759+0000 7fe2b0c00640 1 -- 172.21.15.18:0/377213202 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe2a4014070 con 0x7fe2b40749e0 2024-09-13T16:51:10.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.759+0000 7fe2b3400640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2980a1190 0x7fe2980a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:10.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.759+0000 7fe2b3400640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2980a1190 0x7fe2980a3650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe2b419dbd0 tx=0x7fe2a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:10.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.760+0000 7fe2b0c00640 1 -- 172.21.15.18:0/377213202 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe2a40963b0 con 0x7fe2b40749e0 2024-09-13T16:51:10.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.960+0000 7fe2bb200640 1 -- 172.21.15.18:0/377213202 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe2b4074dc0 con 0x7fe2b40749e0 2024-09-13T16:51:10.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.961+0000 7fe2b0c00640 1 -- 172.21.15.18:0/377213202 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2a40999d0 con 0x7fe2b40749e0 2024-09-13T16:51:10.963 INFO:teuthology.orchestra.run.smithi018.stdout:219043332149 2024-09-13T16:51:10.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 -- 172.21.15.18:0/377213202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2980a1190 msgr2=0x7fe2980a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:10.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2980a1190 0x7fe2980a3650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe2b419dbd0 tx=0x7fe2a0005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 -- 172.21.15.18:0/377213202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b40749e0 msgr2=0x7fe2b41a2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b40749e0 0x7fe2b41a2670 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400e9f0 tx=0x7fe2a400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 -- 172.21.15.18:0/377213202 shutdown_connections 2024-09-13T16:51:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2980a1190 0x7fe2980a3650 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4075300 0x7fe2b41a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4110c40 0x7fe2b419c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 --2- 172.21.15.18:0/377213202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b40749e0 0x7fe2b41a2670 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 -- 172.21.15.18:0/377213202 >> 172.21.15.18:0/377213202 conn(0x7fe2b40fdc60 msgr2=0x7fe2b4100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 -- 172.21.15.18:0/377213202 shutdown_connections 2024-09-13T16:51:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:10.963+0000 7fe2bb200640 1 -- 172.21.15.18:0/377213202 wait complete. 2024-09-13T16:51:11.213 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:11 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/377213202' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T16:51:11.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.204+0000 7f0b53e00640 1 -- 172.21.15.18:0/2562956092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b540ffe20 msgr2=0x7f0b54100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:11.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.204+0000 7f0b53e00640 1 --2- 172.21.15.18:0/2562956092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b540ffe20 0x7f0b54100200 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009890 tx=0x7f0b4402a370 comp rx=0 tx=0).stop 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.204+0000 7f0b53e00640 1 -- 172.21.15.18:0/2562956092 shutdown_connections 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.204+0000 7f0b53e00640 1 --2- 172.21.15.18:0/2562956092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b541007d0 0x7f0b54104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.204+0000 7f0b53e00640 1 --2- 172.21.15.18:0/2562956092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b54104f50 0x7f0b5410cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.204+0000 7f0b53e00640 1 --2- 172.21.15.18:0/2562956092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b540ffe20 0x7f0b54100200 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.204+0000 7f0b53e00640 1 -- 172.21.15.18:0/2562956092 >> 172.21.15.18:0/2562956092 conn(0x7f0b540fb900 msgr2=0x7f0b540fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.204+0000 7f0b53e00640 1 -- 172.21.15.18:0/2562956092 shutdown_connections 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.204+0000 7f0b53e00640 1 -- 172.21.15.18:0/2562956092 wait complete. 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.205+0000 7f0b53e00640 1 Processor -- start 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b53e00640 1 -- start start 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b53e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b540ffe20 0x7f0b541983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b53e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b541007d0 0x7f0b541988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b53e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b54104f50 0x7f0b5419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:11.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b53e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5419d2e0 con 0x7f0b54104f50 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b53e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5419d450 con 0x7f0b540ffe20 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b53e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5419d5c0 con 0x7f0b541007d0 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b53400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b54104f50 0x7f0b5419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b53400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b54104f50 0x7f0b5419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34050/0 (socket says 172.21.15.18:34050) 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b53400640 1 -- 172.21.15.18:0/3762436145 learned_addr learned my addr 172.21.15.18:0/3762436145 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b52000640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b541007d0 0x7f0b541988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.206+0000 7f0b52a00640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b540ffe20 0x7f0b541983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b53400640 1 -- 172.21.15.18:0/3762436145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b541007d0 msgr2=0x7f0b541988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b53400640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b541007d0 0x7f0b541988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b53400640 1 -- 172.21.15.18:0/3762436145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b540ffe20 msgr2=0x7f0b541983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b53400640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b540ffe20 0x7f0b541983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b53400640 1 -- 172.21.15.18:0/3762436145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b40009560 con 0x7f0b54104f50 2024-09-13T16:51:11.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b53400640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b54104f50 0x7f0b5419cce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00eb10 tx=0x7f0b4c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b4b400640 1 -- 172.21.15.18:0/3762436145 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c004b20 con 0x7f0b54104f50 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b4b400640 1 -- 172.21.15.18:0/3762436145 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b4c004c80 con 0x7f0b54104f50 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b4b400640 1 -- 172.21.15.18:0/3762436145 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c010690 con 0x7f0b54104f50 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b53e00640 1 -- 172.21.15.18:0/3762436145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b44009490 con 0x7f0b54104f50 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.207+0000 7f0b53e00640 1 -- 172.21.15.18:0/3762436145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b541a4f90 con 0x7f0b54104f50 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.209+0000 7f0b53e00640 1 -- 172.21.15.18:0/3762436145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b54101300 con 0x7f0b54104f50 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.210+0000 7f0b4b400640 1 -- 172.21.15.18:0/3762436145 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0b4c005020 con 0x7f0b54104f50 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.212+0000 7f0b4b400640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b380a1100 0x7f0b380a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.212+0000 7f0b4b400640 1 -- 172.21.15.18:0/3762436145 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0b4c014070 con 0x7f0b54104f50 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.212+0000 7f0b52a00640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b380a1100 0x7f0b380a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.213+0000 7f0b52a00640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b380a1100 0x7f0b380a35c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0b4402a960 tx=0x7f0b440056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:11.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.217+0000 7f0b4b400640 1 -- 172.21.15.18:0/3762436145 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0b4c0965d0 con 0x7f0b54104f50 2024-09-13T16:51:11.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:11 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/377213202' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T16:51:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.923+0000 7fb60cc00640 1 -- 172.21.15.18:0/1459368810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6081029c0 msgr2=0x7fb608106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.923+0000 7fb60cc00640 1 --2- 172.21.15.18:0/1459368810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6081029c0 0x7fb608106a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009930 tx=0x7fb5f002a420 comp rx=0 tx=0).stop 2024-09-13T16:51:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.923+0000 7fb60cc00640 1 -- 172.21.15.18:0/1459368810 shutdown_connections 2024-09-13T16:51:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.924+0000 7fb60cc00640 1 --2- 172.21.15.18:0/1459368810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6081029c0 0x7fb608106a10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.924+0000 7fb60cc00640 1 --2- 172.21.15.18:0/1459368810 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb608107140 0x7fb60810ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.924+0000 7fb60cc00640 1 --2- 172.21.15.18:0/1459368810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb608102010 0x7fb6081023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.924+0000 7fb60cc00640 1 -- 172.21.15.18:0/1459368810 >> 172.21.15.18:0/1459368810 conn(0x7fb6080fda70 msgr2=0x7fb6080ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.924+0000 7fb60cc00640 1 -- 172.21.15.18:0/1459368810 shutdown_connections 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.924+0000 7fb60cc00640 1 -- 172.21.15.18:0/1459368810 wait complete. 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb60cc00640 1 Processor -- start 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb60cc00640 1 -- start start 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb60cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608102010 0x7fb6081983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb60cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6081029c0 0x7fb6081988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb60cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb608107140 0x7fb60819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb60cc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60819d2e0 con 0x7fb608102010 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb60cc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60819d450 con 0x7fb6081029c0 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb60cc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60819d5c0 con 0x7fb608107140 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb607400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608102010 0x7fb6081983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb607400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608102010 0x7fb6081983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48902/0 (socket says 172.21.15.18:48902) 2024-09-13T16:51:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb607400640 1 -- 172.21.15.18:0/795044799 learned_addr learned my addr 172.21.15.18:0/795044799 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.925+0000 7fb607e00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb608107140 0x7fb60819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb5ffe00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6081029c0 0x7fb6081988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb607400640 1 -- 172.21.15.18:0/795044799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb608107140 msgr2=0x7fb60819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb607400640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb608107140 0x7fb60819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb607400640 1 -- 172.21.15.18:0/795044799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6081029c0 msgr2=0x7fb6081988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb607400640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6081029c0 0x7fb6081988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb607400640 1 -- 172.21.15.18:0/795044799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0009560 con 0x7fb608102010 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb607e00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb608107140 0x7fb60819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb5ffe00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6081029c0 0x7fb6081988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb607400640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608102010 0x7fb6081983a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800e9f0 tx=0x7fb5f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb604c00640 1 -- 172.21.15.18:0/795044799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8009720 con 0x7fb608102010 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.926+0000 7fb604c00640 1 -- 172.21.15.18:0/795044799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5f800cd80 con 0x7fb608102010 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.927+0000 7fb60cc00640 1 -- 172.21.15.18:0/795044799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60819d8a0 con 0x7fb608102010 2024-09-13T16:51:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.927+0000 7fb604c00640 1 -- 172.21.15.18:0/795044799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8010430 con 0x7fb608102010 2024-09-13T16:51:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.927+0000 7fb60cc00640 1 -- 172.21.15.18:0/795044799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6081a5160 con 0x7fb608102010 2024-09-13T16:51:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.928+0000 7fb60cc00640 1 -- 172.21.15.18:0/795044799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6081034f0 con 0x7fb608102010 2024-09-13T16:51:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.930+0000 7fb604c00640 1 -- 172.21.15.18:0/795044799 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb5f8005020 con 0x7fb608102010 2024-09-13T16:51:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.931+0000 7fb604c00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5ec0a1180 0x7fb5ec0a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.931+0000 7fb604c00640 1 -- 172.21.15.18:0/795044799 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb5f8014070 con 0x7fb608102010 2024-09-13T16:51:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.931+0000 7fb5ffe00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5ec0a1180 0x7fb5ec0a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.932+0000 7fb5ffe00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5ec0a1180 0x7fb5ec0a3640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0005940 tx=0x7fb5f00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:06.936+0000 7fb604c00640 1 -- 172.21.15.18:0/795044799 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb5f80963a0 con 0x7fb608102010 2024-09-13T16:51:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.119+0000 7fb60cc00640 1 -- 172.21.15.18:0/795044799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fb6081023f0 con 0x7fb608102010 2024-09-13T16:51:11.346 INFO:teuthology.orchestra.run.smithi018.stdout:253403070512 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.120+0000 7fb604c00640 1 -- 172.21.15.18:0/795044799 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5f80999c0 con 0x7fb608102010 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.122+0000 7fb60cc00640 1 -- 172.21.15.18:0/795044799 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5ec0a1180 msgr2=0x7fb5ec0a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.122+0000 7fb60cc00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5ec0a1180 0x7fb5ec0a3640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0005940 tx=0x7fb5f00058d0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.122+0000 7fb60cc00640 1 -- 172.21.15.18:0/795044799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608102010 msgr2=0x7fb6081983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.122+0000 7fb60cc00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608102010 0x7fb6081983a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800e9f0 tx=0x7fb5f800edf0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.122+0000 7fb60cc00640 1 -- 172.21.15.18:0/795044799 shutdown_connections 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.122+0000 7fb60cc00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb608107140 0x7fb60819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.122+0000 7fb60cc00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6081029c0 0x7fb6081988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.122+0000 7fb60cc00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb5ec0a1180 0x7fb5ec0a3640 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.122+0000 7fb60cc00640 1 --2- 172.21.15.18:0/795044799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608102010 0x7fb6081983a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.122+0000 7fb60cc00640 1 -- 172.21.15.18:0/795044799 >> 172.21.15.18:0/795044799 conn(0x7fb6080fda70 msgr2=0x7fb6080fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.123+0000 7fb60cc00640 1 -- 172.21.15.18:0/795044799 shutdown_connections 2024-09-13T16:51:11.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:07.123+0000 7fb60cc00640 1 -- 172.21.15.18:0/795044799 wait complete. 2024-09-13T16:51:11.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.405+0000 7f0b53e00640 1 -- 172.21.15.18:0/3762436145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f0b54100200 con 0x7f0b54104f50 2024-09-13T16:51:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.405+0000 7f0b4b400640 1 -- 172.21.15.18:0/3762436145 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f0b4c099bf0 con 0x7f0b54104f50 2024-09-13T16:51:11.408 INFO:teuthology.orchestra.run.smithi018.stdout:309237645349 2024-09-13T16:51:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 -- 172.21.15.18:0/3762436145 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b380a1100 msgr2=0x7f0b380a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b380a1100 0x7f0b380a35c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0b4402a960 tx=0x7f0b440056d0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 -- 172.21.15.18:0/3762436145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b54104f50 msgr2=0x7f0b5419cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b54104f50 0x7f0b5419cce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00eb10 tx=0x7f0b4c00c2d0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 -- 172.21.15.18:0/3762436145 shutdown_connections 2024-09-13T16:51:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0b380a1100 0x7f0b380a35c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b54104f50 0x7f0b5419cce0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b541007d0 0x7f0b541988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 --2- 172.21.15.18:0/3762436145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b540ffe20 0x7f0b541983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 -- 172.21.15.18:0/3762436145 >> 172.21.15.18:0/3762436145 conn(0x7f0b540fb900 msgr2=0x7f0b540fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 -- 172.21.15.18:0/3762436145 shutdown_connections 2024-09-13T16:51:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:11.408+0000 7f0b53e00640 1 -- 172.21.15.18:0/3762436145 wait complete. 2024-09-13T16:51:11.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:11 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/377213202' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T16:51:12.376 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:12 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3762436145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T16:51:12.376 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:12 smithi018 ceph-mon[30981]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:12.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:12 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3762436145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T16:51:12.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:12 smithi094 ceph-mon[35259]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:12.464 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070504 got 253403070512 for osd.8 2024-09-13T16:51:12.464 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:12.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:12 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3762436145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T16:51:12.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:12 smithi144 ceph-mon[35328]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:13.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:13 smithi018 ceph-mon[30981]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-13T16:51:13.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]: dispatch 2024-09-13T16:51:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]: dispatch 2024-09-13T16:51:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-13T16:51:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:13 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-13T16:51:13.143 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645341 got 309237645349 for osd.10 2024-09-13T16:51:13.143 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:13.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:13 smithi094 ceph-mon[35259]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-13T16:51:13.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]: dispatch 2024-09-13T16:51:13.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]: dispatch 2024-09-13T16:51:13.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-13T16:51:13.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:13 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-13T16:51:13.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:13 smithi144 ceph-mon[35328]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-13T16:51:13.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]: dispatch 2024-09-13T16:51:13.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]: dispatch 2024-09-13T16:51:13.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-13T16:51:13.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:13 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-13T16:51:13.951 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808870 got 287762808875 for osd.9 2024-09-13T16:51:13.952 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]': finished 2024-09-13T16:51:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]': finished 2024-09-13T16:51:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-13T16:51:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:14 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-13T16:51:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:14 smithi018 ceph-mon[30981]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T16:51:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:14 smithi018 ceph-mon[30981]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-13T16:51:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:14 smithi018 ceph-mon[30981]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T16:51:14.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]': finished 2024-09-13T16:51:14.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]': finished 2024-09-13T16:51:14.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-13T16:51:14.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:14 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-13T16:51:14.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:14 smithi094 ceph-mon[35259]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T16:51:14.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:14 smithi094 ceph-mon[35259]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-13T16:51:14.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:14 smithi094 ceph-mon[35259]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T16:51:14.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]': finished 2024-09-13T16:51:14.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]': finished 2024-09-13T16:51:14.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-13T16:51:14.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:14 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-13T16:51:14.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:14 smithi144 ceph-mon[35328]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T16:51:14.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:14 smithi144 ceph-mon[35328]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-13T16:51:14.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:14 smithi144 ceph-mon[35328]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T16:51:14.606 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182467 got 107374182473 for osd.3 2024-09-13T16:51:14.607 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:15.665 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332144 got 219043332149 for osd.7 2024-09-13T16:51:15.665 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:15.898 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:15 smithi018 ceph-mon[30981]: pgmap v355: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-13T16:51:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.906+0000 7f2594e00640 1 -- 172.21.15.18:0/1211021707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2590104f40 msgr2=0x7f259010cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.906+0000 7f2594e00640 1 --2- 172.21.15.18:0/1211021707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2590104f40 0x7f259010cac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2588009cd0 tx=0x7f258802a8e0 comp rx=0 tx=0).stop 2024-09-13T16:51:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.906+0000 7f2594e00640 1 -- 172.21.15.18:0/1211021707 shutdown_connections 2024-09-13T16:51:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.906+0000 7f2594e00640 1 --2- 172.21.15.18:0/1211021707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2590104f40 0x7f259010cac0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.906+0000 7f2594e00640 1 --2- 172.21.15.18:0/1211021707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25901007c0 0x7f2590104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.906+0000 7f2594e00640 1 --2- 172.21.15.18:0/1211021707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25900ffe10 0x7f25901001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.906+0000 7f2594e00640 1 -- 172.21.15.18:0/1211021707 >> 172.21.15.18:0/1211021707 conn(0x7f25900fb870 msgr2=0x7f25900fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.906+0000 7f2594e00640 1 -- 172.21.15.18:0/1211021707 shutdown_connections 2024-09-13T16:51:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.906+0000 7f2594e00640 1 -- 172.21.15.18:0/1211021707 wait complete. 2024-09-13T16:51:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.907+0000 7f2594e00640 1 Processor -- start 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.907+0000 7f2594e00640 1 -- start start 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.907+0000 7f2594e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25900ffe10 0x7f2590198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f2594e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25901007c0 0x7f25901987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f2594e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2590104f40 0x7f259019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f2594e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259019d1d0 con 0x7f25901007c0 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f2594e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259019d340 con 0x7f2590104f40 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f2594e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259019d4b0 con 0x7f25900ffe10 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f2587e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25901007c0 0x7f25901987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f258f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25900ffe10 0x7f2590198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f2587e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25901007c0 0x7f25901987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34060/0 (socket says 172.21.15.18:34060) 2024-09-13T16:51:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f2587e00640 1 -- 172.21.15.18:0/1270673553 learned_addr learned my addr 172.21.15.18:0/1270673553 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f258fe00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2590104f40 0x7f259019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f258f400640 1 -- 172.21.15.18:0/1270673553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2590104f40 msgr2=0x7f259019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f258f400640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2590104f40 0x7f259019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f258f400640 1 -- 172.21.15.18:0/1270673553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25901007c0 msgr2=0x7f25901987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f258f400640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25901007c0 0x7f25901987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f258f400640 1 -- 172.21.15.18:0/1270673553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2588009900 con 0x7f25900ffe10 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.908+0000 7f2587e00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25901007c0 0x7f25901987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.909+0000 7f258f400640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25900ffe10 0x7f2590198290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f258000e9f0 tx=0x7f258000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.909+0000 7f258cc00640 1 -- 172.21.15.18:0/1270673553 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258000ccc0 con 0x7f25900ffe10 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.909+0000 7f2594e00640 1 -- 172.21.15.18:0/1270673553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259019d790 con 0x7f25900ffe10 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.909+0000 7f258cc00640 1 -- 172.21.15.18:0/1270673553 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f258000ce20 con 0x7f25900ffe10 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.909+0000 7f258cc00640 1 -- 172.21.15.18:0/1270673553 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580004a00 con 0x7f25900ffe10 2024-09-13T16:51:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.909+0000 7f2594e00640 1 -- 172.21.15.18:0/1270673553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25901a5050 con 0x7f25900ffe10 2024-09-13T16:51:15.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.910+0000 7f2594e00640 1 -- 172.21.15.18:0/1270673553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25901012f0 con 0x7f25900ffe10 2024-09-13T16:51:15.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.912+0000 7f258cc00640 1 -- 172.21.15.18:0/1270673553 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2580005020 con 0x7f25900ffe10 2024-09-13T16:51:15.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.913+0000 7f258cc00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25740a1070 0x7f25740a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:15.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.914+0000 7f258cc00640 1 -- 172.21.15.18:0/1270673553 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f2580014070 con 0x7f25900ffe10 2024-09-13T16:51:15.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.914+0000 7f2587e00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25740a1070 0x7f25740a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:15.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.914+0000 7f2587e00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25740a1070 0x7f25740a3530 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2590199840 tx=0x7f2578005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:15.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:15.918+0000 7f258cc00640 1 -- 172.21.15.18:0/1270673553 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2580095fd0 con 0x7f25900ffe10 2024-09-13T16:51:16.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.109+0000 7f2594e00640 1 -- 172.21.15.18:0/1270673553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f259010fc60 con 0x7f25900ffe10 2024-09-13T16:51:16.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.109+0000 7f258cc00640 1 -- 172.21.15.18:0/1270673553 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25800995f0 con 0x7f25900ffe10 2024-09-13T16:51:16.112 INFO:teuthology.orchestra.run.smithi018.stdout:141733920837 2024-09-13T16:51:16.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 -- 172.21.15.18:0/1270673553 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25740a1070 msgr2=0x7f25740a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:16.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25740a1070 0x7f25740a3530 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2590199840 tx=0x7f2578005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:16.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 -- 172.21.15.18:0/1270673553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25900ffe10 msgr2=0x7f2590198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:16.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25900ffe10 0x7f2590198290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f258000e9f0 tx=0x7f258000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:51:16.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 -- 172.21.15.18:0/1270673553 shutdown_connections 2024-09-13T16:51:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25740a1070 0x7f25740a3530 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25901007c0 0x7f25901987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2590104f40 0x7f259019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 --2- 172.21.15.18:0/1270673553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25900ffe10 0x7f2590198290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 -- 172.21.15.18:0/1270673553 >> 172.21.15.18:0/1270673553 conn(0x7f25900fb870 msgr2=0x7f25900fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 -- 172.21.15.18:0/1270673553 shutdown_connections 2024-09-13T16:51:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:16.112+0000 7f2594e00640 1 -- 172.21.15.18:0/1270673553 wait complete. 2024-09-13T16:51:16.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:15 smithi094 ceph-mon[35259]: pgmap v355: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-13T16:51:16.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:15 smithi144 ceph-mon[35328]: pgmap v355: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-13T16:51:17.024 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920830 got 141733920837 for osd.4 2024-09-13T16:51:17.024 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:17.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:16 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1270673553' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T16:51:17.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:16 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:51:17.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:16 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:51:17.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:16 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1270673553' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T16:51:17.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:16 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:51:17.175 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:16 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:51:17.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:16 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1270673553' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T16:51:17.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:16 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:51:17.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:16 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:51:17.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:51:17.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:51:17.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:51:17.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:17 smithi018 ceph-mon[30981]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 895 B/s wr, 7 op/s 2024-09-13T16:51:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:51:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:51:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:51:18.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:17 smithi094 ceph-mon[35259]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 895 B/s wr, 7 op/s 2024-09-13T16:51:18.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:51:18.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:51:18.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:51:18.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:17 smithi144 ceph-mon[35328]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 895 B/s wr, 7 op/s 2024-09-13T16:51:18.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.720+0000 7f8d56e00640 1 -- 172.21.15.18:0/3119236521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d501009a0 msgr2=0x7f8d501049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.720+0000 7f8d56e00640 1 --2- 172.21.15.18:0/3119236521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d501009a0 0x7f8d501049f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009930 tx=0x7f8d3c02a420 comp rx=0 tx=0).stop 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.720+0000 7f8d56e00640 1 -- 172.21.15.18:0/3119236521 shutdown_connections 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.720+0000 7f8d56e00640 1 --2- 172.21.15.18:0/3119236521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d501009a0 0x7f8d501049f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.720+0000 7f8d56e00640 1 --2- 172.21.15.18:0/3119236521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d50105120 0x7f8d5010cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.720+0000 7f8d56e00640 1 --2- 172.21.15.18:0/3119236521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d500ffff0 0x7f8d501003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.720+0000 7f8d56e00640 1 -- 172.21.15.18:0/3119236521 >> 172.21.15.18:0/3119236521 conn(0x7f8d500fba90 msgr2=0x7f8d500fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.720+0000 7f8d56e00640 1 -- 172.21.15.18:0/3119236521 shutdown_connections 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.720+0000 7f8d56e00640 1 -- 172.21.15.18:0/3119236521 wait complete. 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.721+0000 7f8d56e00640 1 Processor -- start 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d56e00640 1 -- start start 2024-09-13T16:51:18.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d56e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d500ffff0 0x7f8d50196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d56e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d501009a0 0x7f8d50196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d56e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d50105120 0x7f8d5019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d56e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5019b290 con 0x7f8d500ffff0 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d56e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5019b400 con 0x7f8d50105120 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d56e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5019b570 con 0x7f8d501009a0 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d500ffff0 0x7f8d50196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d500ffff0 0x7f8d50196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34078/0 (socket says 172.21.15.18:34078) 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d4fe00640 1 -- 172.21.15.18:0/1877426879 learned_addr learned my addr 172.21.15.18:0/1877426879 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d54e00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d50105120 0x7f8d5019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.722+0000 7f8d4f400640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d501009a0 0x7f8d50196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.723+0000 7f8d4fe00640 1 -- 172.21.15.18:0/1877426879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d501009a0 msgr2=0x7f8d50196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.723+0000 7f8d4fe00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d501009a0 0x7f8d50196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.723+0000 7f8d4fe00640 1 -- 172.21.15.18:0/1877426879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d50105120 msgr2=0x7f8d5019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.723+0000 7f8d4fe00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d50105120 0x7f8d5019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.723+0000 7f8d4fe00640 1 -- 172.21.15.18:0/1877426879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c009560 con 0x7f8d500ffff0 2024-09-13T16:51:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.723+0000 7f8d4fe00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d500ffff0 0x7f8d50196350 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000e9f0 tx=0x7f8d4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.723+0000 7f8d4cc00640 1 -- 172.21.15.18:0/1877426879 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40009720 con 0x7f8d500ffff0 2024-09-13T16:51:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.723+0000 7f8d4cc00640 1 -- 172.21.15.18:0/1877426879 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d4000cd80 con 0x7f8d500ffff0 2024-09-13T16:51:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.723+0000 7f8d4cc00640 1 -- 172.21.15.18:0/1877426879 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40010430 con 0x7f8d500ffff0 2024-09-13T16:51:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.723+0000 7f8d56e00640 1 -- 172.21.15.18:0/1877426879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5019b850 con 0x7f8d500ffff0 2024-09-13T16:51:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.724+0000 7f8d56e00640 1 -- 172.21.15.18:0/1877426879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5019bb00 con 0x7f8d500ffff0 2024-09-13T16:51:18.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.725+0000 7f8d56e00640 1 -- 172.21.15.18:0/1877426879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d501014d0 con 0x7f8d500ffff0 2024-09-13T16:51:18.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.727+0000 7f8d4cc00640 1 -- 172.21.15.18:0/1877426879 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8d40005020 con 0x7f8d500ffff0 2024-09-13T16:51:18.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.728+0000 7f8d4cc00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8d340a1100 0x7f8d340a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:18.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.728+0000 7f8d4cc00640 1 -- 172.21.15.18:0/1877426879 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f8d40014070 con 0x7f8d500ffff0 2024-09-13T16:51:18.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.728+0000 7f8d4f400640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8d340a1100 0x7f8d340a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:18.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.729+0000 7f8d4f400640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8d340a1100 0x7f8d340a35c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c031440 tx=0x7f8d3c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.732+0000 7f8d4cc00640 1 -- 172.21.15.18:0/1877426879 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8d400961e0 con 0x7f8d500ffff0 2024-09-13T16:51:18.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.918+0000 7f8d56e00640 1 -- 172.21.15.18:0/1877426879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d501003d0 con 0x7f8d500ffff0 2024-09-13T16:51:18.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.919+0000 7f8d4cc00640 1 -- 172.21.15.18:0/1877426879 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d40099800 con 0x7f8d500ffff0 2024-09-13T16:51:18.921 INFO:teuthology.orchestra.run.smithi018.stdout:55834574933 2024-09-13T16:51:18.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.921+0000 7f8d56e00640 1 -- 172.21.15.18:0/1877426879 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8d340a1100 msgr2=0x7f8d340a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:18.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.921+0000 7f8d56e00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8d340a1100 0x7f8d340a35c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c031440 tx=0x7f8d3c005a20 comp rx=0 tx=0).stop 2024-09-13T16:51:18.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.921+0000 7f8d56e00640 1 -- 172.21.15.18:0/1877426879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d500ffff0 msgr2=0x7f8d50196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:18.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.921+0000 7f8d56e00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d500ffff0 0x7f8d50196350 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000e9f0 tx=0x7f8d4000edf0 comp rx=0 tx=0).stop 2024-09-13T16:51:18.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.922+0000 7f8d56e00640 1 -- 172.21.15.18:0/1877426879 shutdown_connections 2024-09-13T16:51:18.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.922+0000 7f8d56e00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d50105120 0x7f8d5019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:18.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.922+0000 7f8d56e00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d501009a0 0x7f8d50196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:18.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.922+0000 7f8d56e00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8d340a1100 0x7f8d340a35c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:18.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.922+0000 7f8d56e00640 1 --2- 172.21.15.18:0/1877426879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d500ffff0 0x7f8d50196350 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:18.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.922+0000 7f8d56e00640 1 -- 172.21.15.18:0/1877426879 >> 172.21.15.18:0/1877426879 conn(0x7f8d500fba90 msgr2=0x7f8d500fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:18.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.922+0000 7f8d56e00640 1 -- 172.21.15.18:0/1877426879 shutdown_connections 2024-09-13T16:51:18.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:18.922+0000 7f8d56e00640 1 -- 172.21.15.18:0/1877426879 wait complete. 2024-09-13T16:51:19.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:19 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1877426879' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T16:51:19.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:19 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1877426879' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T16:51:19.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:19 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1877426879' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T16:51:19.822 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574925 got 55834574933 for osd.1 2024-09-13T16:51:19.822 DEBUG:teuthology.parallel:result is None 2024-09-13T16:51:19.822 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T16:51:19.823 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T16:51:20.147 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:20.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:20 smithi018 ceph-mon[30981]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 895 B/s wr, 6 op/s 2024-09-13T16:51:20.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:20 smithi094 ceph-mon[35259]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 895 B/s wr, 6 op/s 2024-09-13T16:51:20.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:20 smithi144 ceph-mon[35328]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 895 B/s wr, 6 op/s 2024-09-13T16:51:21.900 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:21 smithi018 ceph-mon[30981]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 584 B/s wr, 6 op/s 2024-09-13T16:51:22.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:21 smithi094 ceph-mon[35259]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 584 B/s wr, 6 op/s 2024-09-13T16:51:22.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:21 smithi144 ceph-mon[35328]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 584 B/s wr, 6 op/s 2024-09-13T16:51:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.323+0000 7fb8db200640 1 -- 172.21.15.18:0/160500168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d4107330 msgr2=0x7fb8d410eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.323+0000 7fb8db200640 1 --2- 172.21.15.18:0/160500168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d4107330 0x7fb8d410eeb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009cd0 tx=0x7fb8cc02a8e0 comp rx=0 tx=0).stop 2024-09-13T16:51:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.324+0000 7fb8db200640 1 -- 172.21.15.18:0/160500168 shutdown_connections 2024-09-13T16:51:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.324+0000 7fb8db200640 1 --2- 172.21.15.18:0/160500168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d4107330 0x7fb8d410eeb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.324+0000 7fb8db200640 1 --2- 172.21.15.18:0/160500168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8d4102bb0 0x7fb8d4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.324+0000 7fb8db200640 1 --2- 172.21.15.18:0/160500168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8d4102200 0x7fb8d41025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.324+0000 7fb8db200640 1 -- 172.21.15.18:0/160500168 >> 172.21.15.18:0/160500168 conn(0x7fb8d40fdc60 msgr2=0x7fb8d4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.324+0000 7fb8db200640 1 -- 172.21.15.18:0/160500168 shutdown_connections 2024-09-13T16:51:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.324+0000 7fb8db200640 1 -- 172.21.15.18:0/160500168 wait complete. 2024-09-13T16:51:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.324+0000 7fb8db200640 1 Processor -- start 2024-09-13T16:51:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8db200640 1 -- start start 2024-09-13T16:51:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8db200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d4102200 0x7fb8d4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8db200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8d4102bb0 0x7fb8d41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8db200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8d4107330 0x7fb8d419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8db200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d419d3d0 con 0x7fb8d4102200 2024-09-13T16:51:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8db200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d419d540 con 0x7fb8d4107330 2024-09-13T16:51:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8db200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d419d6b0 con 0x7fb8d4102bb0 2024-09-13T16:51:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d4102200 0x7fb8d4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d4102200 0x7fb8d4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45340/0 (socket says 172.21.15.18:45340) 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8d3e00640 1 -- 172.21.15.18:0/807390187 learned_addr learned my addr 172.21.15.18:0/807390187 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8d3400640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8d4102bb0 0x7fb8d41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.325+0000 7fb8d9200640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8d4107330 0x7fb8d419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.326+0000 7fb8d3e00640 1 -- 172.21.15.18:0/807390187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8d4102bb0 msgr2=0x7fb8d41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.326+0000 7fb8d3e00640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8d4102bb0 0x7fb8d41989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.326+0000 7fb8d3e00640 1 -- 172.21.15.18:0/807390187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8d4107330 msgr2=0x7fb8d419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.326+0000 7fb8d3e00640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8d4107330 0x7fb8d419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.326+0000 7fb8d3e00640 1 -- 172.21.15.18:0/807390187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4009490 con 0x7fb8d4102200 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.326+0000 7fb8d3e00640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d4102200 0x7fb8d4198490 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400ea60 tx=0x7fb8c400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.326+0000 7fb8d0c00640 1 -- 172.21.15.18:0/807390187 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c400cde0 con 0x7fb8d4102200 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.326+0000 7fb8d0c00640 1 -- 172.21.15.18:0/807390187 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8c40035f0 con 0x7fb8d4102200 2024-09-13T16:51:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.326+0000 7fb8db200640 1 -- 172.21.15.18:0/807390187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c0009490 con 0x7fb8d4102200 2024-09-13T16:51:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.326+0000 7fb8d0c00640 1 -- 172.21.15.18:0/807390187 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40044e0 con 0x7fb8d4102200 2024-09-13T16:51:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.327+0000 7fb8db200640 1 -- 172.21.15.18:0/807390187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc009900 con 0x7fb8d4102200 2024-09-13T16:51:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.328+0000 7fb8db200640 1 -- 172.21.15.18:0/807390187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d41036e0 con 0x7fb8d4102200 2024-09-13T16:51:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.330+0000 7fb8d0c00640 1 -- 172.21.15.18:0/807390187 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb8c4003a60 con 0x7fb8d4102200 2024-09-13T16:51:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.331+0000 7fb8d0c00640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb8b80a1080 0x7fb8b80a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.331+0000 7fb8d0c00640 1 -- 172.21.15.18:0/807390187 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fb8c4014070 con 0x7fb8d4102200 2024-09-13T16:51:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.331+0000 7fb8d3400640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb8b80a1080 0x7fb8b80a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.332+0000 7fb8d3400640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb8b80a1080 0x7fb8b80a3540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4199a40 tx=0x7fb8c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.335+0000 7fb8d0c00640 1 -- 172.21.15.18:0/807390187 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb8c40964f0 con 0x7fb8d4102200 2024-09-13T16:51:22.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.516+0000 7fb8db200640 1 -- 172.21.15.18:0/807390187 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8d4199890 con 0x7fb8b80a1080 2024-09-13T16:51:22.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.531+0000 7fb8d0c00640 1 -- 172.21.15.18:0/807390187 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427533 (secure 0 0 0) 0x7fb8d4199890 con 0x7fb8b80a1080 2024-09-13T16:51:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T16:51:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.536+0000 7fb8db200640 1 -- 172.21.15.18:0/807390187 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb8b80a1080 msgr2=0x7fb8b80a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.536+0000 7fb8db200640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb8b80a1080 0x7fb8b80a3540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4199a40 tx=0x7fb8c0005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.536+0000 7fb8db200640 1 -- 172.21.15.18:0/807390187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d4102200 msgr2=0x7fb8d4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.536+0000 7fb8db200640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d4102200 0x7fb8d4198490 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400ea60 tx=0x7fb8c400ef20 comp rx=0 tx=0).stop 2024-09-13T16:51:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.537+0000 7fb8db200640 1 -- 172.21.15.18:0/807390187 shutdown_connections 2024-09-13T16:51:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.537+0000 7fb8db200640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8d4107330 0x7fb8d419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.537+0000 7fb8db200640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8d4102bb0 0x7fb8d41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.537+0000 7fb8db200640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb8b80a1080 0x7fb8b80a3540 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.537+0000 7fb8db200640 1 --2- 172.21.15.18:0/807390187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d4102200 0x7fb8d4198490 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:22.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.537+0000 7fb8db200640 1 -- 172.21.15.18:0/807390187 >> 172.21.15.18:0/807390187 conn(0x7fb8d40fdc60 msgr2=0x7fb8d40fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:22.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.537+0000 7fb8db200640 1 -- 172.21.15.18:0/807390187 shutdown_connections 2024-09-13T16:51:22.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:22.537+0000 7fb8db200640 1 -- 172.21.15.18:0/807390187 wait complete. 2024-09-13T16:51:23.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:22 smithi094 ceph-mon[35259]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:51:23.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:22 smithi018 ceph-mon[30981]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:51:23.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:22 smithi144 ceph-mon[35328]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:51:23.457 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-13T16:51:21.787801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657160,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":638,"num_read_kb":421,"num_write":347,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1241461,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":784,"ondisk_log_size":784,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383728,"kb_used_data":14404,"kb_used_omap":18,"kb_used_meta":369133,"kb_avail":1124558096,"statfs":{"total":1151940427776,"available":1151547490304,"internally_reserved":0,"allocated":14749696,"data_stored":8172358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":377992517},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":27,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.764399"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025802+0000","last_change":"2024-09-13T16:49:27.652760+0000","last_active":"2024-09-13T16:51:13.025802+0000","last_peered":"2024-09-13T16:51:13.025802+0000","last_clean":"2024-09-13T16:51:13.025802+0000","last_became_active":"2024-09-13T16:49:27.647493+0000","last_became_peered":"2024-09-13T16:49:27.647493+0000","last_unstale":"2024-09-13T16:51:13.025802+0000","last_undegraded":"2024-09-13T16:51:13.025802+0000","last_fullsized":"2024-09-13T16:51:13.025802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:54.438761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025261+0000","last_change":"2024-09-13T16:50:13.652198+0000","last_active":"2024-09-13T16:51:13.025261+0000","last_peered":"2024-09-13T16:51:13.025261+0000","last_clean":"2024-09-13T16:51:13.025261+0000","last_became_active":"2024-09-13T16:50:13.651473+0000","last_became_peered":"2024-09-13T16:50:13.651473+0000","last_unstale":"2024-09-13T16:51:13.025261+0000","last_undegraded":"2024-09-13T16:51:13.025261+0000","last_fullsized":"2024-09-13T16:51:13.025261+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:06.880882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029299+0000","last_change":"2024-09-13T16:49:32.127597+0000","last_active":"2024-09-13T16:51:13.029299+0000","last_peered":"2024-09-13T16:51:13.029299+0000","last_clean":"2024-09-13T16:51:13.029299+0000","last_became_active":"2024-09-13T16:49:32.127122+0000","last_became_peered":"2024-09-13T16:49:32.127122+0000","last_unstale":"2024-09-13T16:51:13.029299+0000","last_undegraded":"2024-09-13T16:51:13.029299+0000","last_fullsized":"2024-09-13T16:51:13.029299+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:16.362727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.033368+0000","last_change":"2024-09-13T16:49:27.668009+0000","last_active":"2024-09-13T16:51:13.033368+0000","last_peered":"2024-09-13T16:51:13.033368+0000","last_clean":"2024-09-13T16:51:13.033368+0000","last_became_active":"2024-09-13T16:49:27.667713+0000","last_became_peered":"2024-09-13T16:49:27.667713+0000","last_unstale":"2024-09-13T16:51:13.033368+0000","last_undegraded":"2024-09-13T16:51:13.033368+0000","last_fullsized":"2024-09-13T16:51:13.033368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:51.427966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029643+0000","last_change":"2024-09-13T16:49:28.107799+0000","last_active":"2024-09-13T16:51:13.029643+0000","last_peered":"2024-09-13T16:51:13.029643+0000","last_clean":"2024-09-13T16:51:13.029643+0000","last_became_active":"2024-09-13T16:49:28.107432+0000","last_became_peered":"2024-09-13T16:49:28.107432+0000","last_unstale":"2024-09-13T16:51:13.029643+0000","last_undegraded":"2024-09-13T16:51:13.029643+0000","last_fullsized":"2024-09-13T16:51:13.029643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:31.554614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029005+0000","last_change":"2024-09-13T16:49:32.132328+0000","last_active":"2024-09-13T16:51:13.029005+0000","last_peered":"2024-09-13T16:51:13.029005+0000","last_clean":"2024-09-13T16:51:13.029005+0000","last_became_active":"2024-09-13T16:49:32.131831+0000","last_became_peered":"2024-09-13T16:49:32.131831+0000","last_unstale":"2024-09-13T16:51:13.029005+0000","last_undegraded":"2024-09-13T16:51:13.029005+0000","last_fullsized":"2024-09-13T16:51:13.029005+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:35.409572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026770+0000","last_change":"2024-09-13T16:49:27.651527+0000","last_active":"2024-09-13T16:51:13.026770+0000","last_peered":"2024-09-13T16:51:13.026770+0000","last_clean":"2024-09-13T16:51:13.026770+0000","last_became_active":"2024-09-13T16:49:27.650985+0000","last_became_peered":"2024-09-13T16:49:27.650985+0000","last_unstale":"2024-09-13T16:51:13.026770+0000","last_undegraded":"2024-09-13T16:51:13.026770+0000","last_fullsized":"2024-09-13T16:51:13.026770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:31.473563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031739+0000","last_change":"2024-09-13T16:49:28.101714+0000","last_active":"2024-09-13T16:51:13.031739+0000","last_peered":"2024-09-13T16:51:13.031739+0000","last_clean":"2024-09-13T16:51:13.031739+0000","last_became_active":"2024-09-13T16:49:28.101409+0000","last_became_peered":"2024-09-13T16:49:28.101409+0000","last_unstale":"2024-09-13T16:51:13.031739+0000","last_undegraded":"2024-09-13T16:51:13.031739+0000","last_fullsized":"2024-09-13T16:51:13.031739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:05.786731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028516+0000","last_change":"2024-09-13T16:49:32.133096+0000","last_active":"2024-09-13T16:51:13.028516+0000","last_peered":"2024-09-13T16:51:13.028516+0000","last_clean":"2024-09-13T16:51:13.028516+0000","last_became_active":"2024-09-13T16:49:32.132704+0000","last_became_peered":"2024-09-13T16:49:32.132704+0000","last_unstale":"2024-09-13T16:51:13.028516+0000","last_undegraded":"2024-09-13T16:51:13.028516+0000","last_fullsized":"2024-09-13T16:51:13.028516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:18.490892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026716+0000","last_change":"2024-09-13T16:49:27.650532+0000","last_active":"2024-09-13T16:51:13.026716+0000","last_peered":"2024-09-13T16:51:13.026716+0000","last_clean":"2024-09-13T16:51:13.026716+0000","last_became_active":"2024-09-13T16:49:27.650095+0000","last_became_peered":"2024-09-13T16:49:27.650095+0000","last_unstale":"2024-09-13T16:51:13.026716+0000","last_undegraded":"2024-09-13T16:51:13.026716+0000","last_fullsized":"2024-09-13T16:51:13.026716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:58.066902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030769+0000","last_change":"2024-09-13T16:49:28.104676+0000","last_active":"2024-09-13T16:51:13.030769+0000","last_peered":"2024-09-13T16:51:13.030769+0000","last_clean":"2024-09-13T16:51:13.030769+0000","last_became_active":"2024-09-13T16:49:28.104376+0000","last_became_peered":"2024-09-13T16:49:28.104376+0000","last_unstale":"2024-09-13T16:51:13.030769+0000","last_undegraded":"2024-09-13T16:51:13.030769+0000","last_fullsized":"2024-09-13T16:51:13.030769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:29.038008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028174+0000","last_change":"2024-09-13T16:49:32.127590+0000","last_active":"2024-09-13T16:51:13.028174+0000","last_peered":"2024-09-13T16:51:13.028174+0000","last_clean":"2024-09-13T16:51:13.028174+0000","last_became_active":"2024-09-13T16:49:32.127362+0000","last_became_peered":"2024-09-13T16:49:32.127362+0000","last_unstale":"2024-09-13T16:51:13.028174+0000","last_undegraded":"2024-09-13T16:51:13.028174+0000","last_fullsized":"2024-09-13T16:51:13.028174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:37.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131113+0000","last_change":"2024-09-13T16:49:28.104850+0000","last_active":"2024-09-13T16:51:13.131113+0000","last_peered":"2024-09-13T16:51:13.131113+0000","last_clean":"2024-09-13T16:51:13.131113+0000","last_became_active":"2024-09-13T16:49:28.104569+0000","last_became_peered":"2024-09-13T16:49:28.104569+0000","last_unstale":"2024-09-13T16:51:13.131113+0000","last_undegraded":"2024-09-13T16:51:13.131113+0000","last_fullsized":"2024-09-13T16:51:13.131113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:26.949030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026236+0000","last_change":"2024-09-13T16:49:27.649046+0000","last_active":"2024-09-13T16:51:13.026236+0000","last_peered":"2024-09-13T16:51:13.026236+0000","last_clean":"2024-09-13T16:51:13.026236+0000","last_became_active":"2024-09-13T16:49:27.648633+0000","last_became_peered":"2024-09-13T16:49:27.648633+0000","last_unstale":"2024-09-13T16:51:13.026236+0000","last_undegraded":"2024-09-13T16:51:13.026236+0000","last_fullsized":"2024-09-13T16:51:13.026236+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:07.191181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028329+0000","last_change":"2024-09-13T16:49:32.123910+0000","last_active":"2024-09-13T16:51:13.028329+0000","last_peered":"2024-09-13T16:51:13.028329+0000","last_clean":"2024-09-13T16:51:13.028329+0000","last_became_active":"2024-09-13T16:49:32.123515+0000","last_became_peered":"2024-09-13T16:49:32.123515+0000","last_unstale":"2024-09-13T16:51:13.028329+0000","last_undegraded":"2024-09-13T16:51:13.028329+0000","last_fullsized":"2024-09-13T16:51:13.028329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:13.667573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032418+0000","last_change":"2024-09-13T16:49:28.112299+0000","last_active":"2024-09-13T16:51:13.032418+0000","last_peered":"2024-09-13T16:51:13.032418+0000","last_clean":"2024-09-13T16:51:13.032418+0000","last_became_active":"2024-09-13T16:49:28.111945+0000","last_became_peered":"2024-09-13T16:49:28.111945+0000","last_unstale":"2024-09-13T16:51:13.032418+0000","last_undegraded":"2024-09-13T16:51:13.032418+0000","last_fullsized":"2024-09-13T16:51:13.032418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:42.813731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029103+0000","last_change":"2024-09-13T16:49:27.654517+0000","last_active":"2024-09-13T16:51:13.029103+0000","last_peered":"2024-09-13T16:51:13.029103+0000","last_clean":"2024-09-13T16:51:13.029103+0000","last_became_active":"2024-09-13T16:49:27.654207+0000","last_became_peered":"2024-09-13T16:49:27.654207+0000","last_unstale":"2024-09-13T16:51:13.029103+0000","last_undegraded":"2024-09-13T16:51:13.029103+0000","last_fullsized":"2024-09-13T16:51:13.029103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:14.562289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028939+0000","last_change":"2024-09-13T16:49:32.121834+0000","last_active":"2024-09-13T16:51:13.028939+0000","last_peered":"2024-09-13T16:51:13.028939+0000","last_clean":"2024-09-13T16:51:13.028939+0000","last_became_active":"2024-09-13T16:49:32.121409+0000","last_became_peered":"2024-09-13T16:49:32.121409+0000","last_unstale":"2024-09-13T16:51:13.028939+0000","last_undegraded":"2024-09-13T16:51:13.028939+0000","last_fullsized":"2024-09-13T16:51:13.028939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.112143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028782+0000","last_change":"2024-09-13T16:49:28.115111+0000","last_active":"2024-09-13T16:51:13.028782+0000","last_peered":"2024-09-13T16:51:13.028782+0000","last_clean":"2024-09-13T16:51:13.028782+0000","last_became_active":"2024-09-13T16:49:28.114491+0000","last_became_peered":"2024-09-13T16:49:28.114491+0000","last_unstale":"2024-09-13T16:51:13.028782+0000","last_undegraded":"2024-09-13T16:51:13.028782+0000","last_fullsized":"2024-09-13T16:51:13.028782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:59.639110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032734+0000","last_change":"2024-09-13T16:49:27.661045+0000","last_active":"2024-09-13T16:51:13.032734+0000","last_peered":"2024-09-13T16:51:13.032734+0000","last_clean":"2024-09-13T16:51:13.032734+0000","last_became_active":"2024-09-13T16:49:27.660728+0000","last_became_peered":"2024-09-13T16:49:27.660728+0000","last_unstale":"2024-09-13T16:51:13.032734+0000","last_undegraded":"2024-09-13T16:51:13.032734+0000","last_fullsized":"2024-09-13T16:51:13.032734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:37.292582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025452+0000","last_change":"2024-09-13T16:49:32.122407+0000","last_active":"2024-09-13T16:51:13.025452+0000","last_peered":"2024-09-13T16:51:13.025452+0000","last_clean":"2024-09-13T16:51:13.025452+0000","last_became_active":"2024-09-13T16:49:32.121540+0000","last_became_peered":"2024-09-13T16:49:32.121540+0000","last_unstale":"2024-09-13T16:51:13.025452+0000","last_undegraded":"2024-09-13T16:51:13.025452+0000","last_fullsized":"2024-09-13T16:51:13.025452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.577117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026030+0000","last_change":"2024-09-13T16:49:28.107534+0000","last_active":"2024-09-13T16:51:13.026030+0000","last_peered":"2024-09-13T16:51:13.026030+0000","last_clean":"2024-09-13T16:51:13.026030+0000","last_became_active":"2024-09-13T16:49:28.107167+0000","last_became_peered":"2024-09-13T16:49:28.107167+0000","last_unstale":"2024-09-13T16:51:13.026030+0000","last_undegraded":"2024-09-13T16:51:13.026030+0000","last_fullsized":"2024-09-13T16:51:13.026030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:50.515291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030918+0000","last_change":"2024-09-13T16:49:27.663125+0000","last_active":"2024-09-13T16:51:13.030918+0000","last_peered":"2024-09-13T16:51:13.030918+0000","last_clean":"2024-09-13T16:51:13.030918+0000","last_became_active":"2024-09-13T16:49:27.662822+0000","last_became_peered":"2024-09-13T16:49:27.662822+0000","last_unstale":"2024-09-13T16:51:13.030918+0000","last_undegraded":"2024-09-13T16:51:13.030918+0000","last_fullsized":"2024-09-13T16:51:13.030918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:42.841929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028447+0000","last_change":"2024-09-13T16:49:32.121929+0000","last_active":"2024-09-13T16:51:13.028447+0000","last_peered":"2024-09-13T16:51:13.028447+0000","last_clean":"2024-09-13T16:51:13.028447+0000","last_became_active":"2024-09-13T16:49:32.121485+0000","last_became_peered":"2024-09-13T16:49:32.121485+0000","last_unstale":"2024-09-13T16:51:13.028447+0000","last_undegraded":"2024-09-13T16:51:13.028447+0000","last_fullsized":"2024-09-13T16:51:13.028447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:34.224064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029890+0000","last_change":"2024-09-13T16:49:28.119746+0000","last_active":"2024-09-13T16:51:13.029890+0000","last_peered":"2024-09-13T16:51:13.029890+0000","last_clean":"2024-09-13T16:51:13.029890+0000","last_became_active":"2024-09-13T16:49:28.119463+0000","last_became_peered":"2024-09-13T16:49:28.119463+0000","last_unstale":"2024-09-13T16:51:13.029890+0000","last_undegraded":"2024-09-13T16:51:13.029890+0000","last_fullsized":"2024-09-13T16:51:13.029890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:17.092417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028716+0000","last_change":"2024-09-13T16:49:27.651799+0000","last_active":"2024-09-13T16:51:13.028716+0000","last_peered":"2024-09-13T16:51:13.028716+0000","last_clean":"2024-09-13T16:51:13.028716+0000","last_became_active":"2024-09-13T16:49:27.651487+0000","last_became_peered":"2024-09-13T16:49:27.651487+0000","last_unstale":"2024-09-13T16:51:13.028716+0000","last_undegraded":"2024-09-13T16:51:13.028716+0000","last_fullsized":"2024-09-13T16:51:13.028716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:45.307448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029477+0000","last_change":"2024-09-13T16:49:32.119333+0000","last_active":"2024-09-13T16:51:13.029477+0000","last_peered":"2024-09-13T16:51:13.029477+0000","last_clean":"2024-09-13T16:51:13.029477+0000","last_became_active":"2024-09-13T16:49:32.118997+0000","last_became_peered":"2024-09-13T16:49:32.118997+0000","last_unstale":"2024-09-13T16:51:13.029477+0000","last_undegraded":"2024-09-13T16:51:13.029477+0000","last_fullsized":"2024-09-13T16:51:13.029477+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:15.731556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.033094+0000","last_change":"2024-09-13T16:49:28.114937+0000","last_active":"2024-09-13T16:51:13.033094+0000","last_peered":"2024-09-13T16:51:13.033094+0000","last_clean":"2024-09-13T16:51:13.033094+0000","last_became_active":"2024-09-13T16:49:28.112566+0000","last_became_peered":"2024-09-13T16:49:28.112566+0000","last_unstale":"2024-09-13T16:51:13.033094+0000","last_undegraded":"2024-09-13T16:51:13.033094+0000","last_fullsized":"2024-09-13T16:51:13.033094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:25.123922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'6","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.077457+0000","last_change":"2024-09-13T16:49:27.658786+0000","last_active":"2024-09-13T16:51:13.077457+0000","last_peered":"2024-09-13T16:51:13.077457+0000","last_clean":"2024-09-13T16:51:13.077457+0000","last_became_active":"2024-09-13T16:49:27.658308+0000","last_became_peered":"2024-09-13T16:49:27.658308+0000","last_unstale":"2024-09-13T16:51:13.077457+0000","last_undegraded":"2024-09-13T16:51:13.077457+0000","last_fullsized":"2024-09-13T16:51:13.077457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:29.994600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032933+0000","last_change":"2024-09-13T16:49:32.130983+0000","last_active":"2024-09-13T16:51:13.032933+0000","last_peered":"2024-09-13T16:51:13.032933+0000","last_clean":"2024-09-13T16:51:13.032933+0000","last_became_active":"2024-09-13T16:49:32.130478+0000","last_became_peered":"2024-09-13T16:49:32.130478+0000","last_unstale":"2024-09-13T16:51:13.032933+0000","last_undegraded":"2024-09-13T16:51:13.032933+0000","last_fullsized":"2024-09-13T16:51:13.032933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:07.147495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029394+0000","last_change":"2024-09-13T16:49:28.100340+0000","last_active":"2024-09-13T16:51:13.029394+0000","last_peered":"2024-09-13T16:51:13.029394+0000","last_clean":"2024-09-13T16:51:13.029394+0000","last_became_active":"2024-09-13T16:49:28.099993+0000","last_became_peered":"2024-09-13T16:49:28.099993+0000","last_unstale":"2024-09-13T16:51:13.029394+0000","last_undegraded":"2024-09-13T16:51:13.029394+0000","last_fullsized":"2024-09-13T16:51:13.029394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:55.066929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026857+0000","last_change":"2024-09-13T16:49:27.665296+0000","last_active":"2024-09-13T16:51:13.026857+0000","last_peered":"2024-09-13T16:51:13.026857+0000","last_clean":"2024-09-13T16:51:13.026857+0000","last_became_active":"2024-09-13T16:49:27.664953+0000","last_became_peered":"2024-09-13T16:49:27.664953+0000","last_unstale":"2024-09-13T16:51:13.026857+0000","last_undegraded":"2024-09-13T16:51:13.026857+0000","last_fullsized":"2024-09-13T16:51:13.026857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:52.001210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028241+0000","last_change":"2024-09-13T16:49:32.129502+0000","last_active":"2024-09-13T16:51:13.028241+0000","last_peered":"2024-09-13T16:51:13.028241+0000","last_clean":"2024-09-13T16:51:13.028241+0000","last_became_active":"2024-09-13T16:49:32.128588+0000","last_became_peered":"2024-09-13T16:49:32.128588+0000","last_unstale":"2024-09-13T16:51:13.028241+0000","last_undegraded":"2024-09-13T16:51:13.028241+0000","last_fullsized":"2024-09-13T16:51:13.028241+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:12.836040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026410+0000","last_change":"2024-09-13T16:49:28.107066+0000","last_active":"2024-09-13T16:51:13.026410+0000","last_peered":"2024-09-13T16:51:13.026410+0000","last_clean":"2024-09-13T16:51:13.026410+0000","last_became_active":"2024-09-13T16:49:28.106774+0000","last_became_peered":"2024-09-13T16:49:28.106774+0000","last_unstale":"2024-09-13T16:51:13.026410+0000","last_undegraded":"2024-09-13T16:51:13.026410+0000","last_fullsized":"2024-09-13T16:51:13.026410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:02.159079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025849+0000","last_change":"2024-09-13T16:49:27.664742+0000","last_active":"2024-09-13T16:51:13.025849+0000","last_peered":"2024-09-13T16:51:13.025849+0000","last_clean":"2024-09-13T16:51:13.025849+0000","last_became_active":"2024-09-13T16:49:27.664206+0000","last_became_peered":"2024-09-13T16:49:27.664206+0000","last_unstale":"2024-09-13T16:51:13.025849+0000","last_undegraded":"2024-09-13T16:51:13.025849+0000","last_fullsized":"2024-09-13T16:51:13.025849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:29.255592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026035+0000","last_change":"2024-09-13T16:49:32.123418+0000","last_active":"2024-09-13T16:51:13.026035+0000","last_peered":"2024-09-13T16:51:13.026035+0000","last_clean":"2024-09-13T16:51:13.026035+0000","last_became_active":"2024-09-13T16:49:32.123001+0000","last_became_peered":"2024-09-13T16:49:32.123001+0000","last_unstale":"2024-09-13T16:51:13.026035+0000","last_undegraded":"2024-09-13T16:51:13.026035+0000","last_fullsized":"2024-09-13T16:51:13.026035+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:03.057538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026418+0000","last_change":"2024-09-13T16:49:28.102859+0000","last_active":"2024-09-13T16:51:13.026418+0000","last_peered":"2024-09-13T16:51:13.026418+0000","last_clean":"2024-09-13T16:51:13.026418+0000","last_became_active":"2024-09-13T16:49:28.102581+0000","last_became_peered":"2024-09-13T16:49:28.102581+0000","last_unstale":"2024-09-13T16:51:13.026418+0000","last_undegraded":"2024-09-13T16:51:13.026418+0000","last_fullsized":"2024-09-13T16:51:13.026418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:25.716170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131116+0000","last_change":"2024-09-13T16:49:27.660427+0000","last_active":"2024-09-13T16:51:13.131116+0000","last_peered":"2024-09-13T16:51:13.131116+0000","last_clean":"2024-09-13T16:51:13.131116+0000","last_became_active":"2024-09-13T16:49:27.660124+0000","last_became_peered":"2024-09-13T16:49:27.660124+0000","last_unstale":"2024-09-13T16:51:13.131116+0000","last_undegraded":"2024-09-13T16:51:13.131116+0000","last_fullsized":"2024-09-13T16:51:13.131116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:13.437432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029163+0000","last_change":"2024-09-13T16:49:32.134481+0000","last_active":"2024-09-13T16:51:13.029163+0000","last_peered":"2024-09-13T16:51:13.029163+0000","last_clean":"2024-09-13T16:51:13.029163+0000","last_became_active":"2024-09-13T16:49:32.132117+0000","last_became_peered":"2024-09-13T16:49:32.132117+0000","last_unstale":"2024-09-13T16:51:13.029163+0000","last_undegraded":"2024-09-13T16:51:13.029163+0000","last_fullsized":"2024-09-13T16:51:13.029163+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:06.386078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030223+0000","last_change":"2024-09-13T16:49:28.102780+0000","last_active":"2024-09-13T16:51:13.030223+0000","last_peered":"2024-09-13T16:51:13.030223+0000","last_clean":"2024-09-13T16:51:13.030223+0000","last_became_active":"2024-09-13T16:49:28.102484+0000","last_became_peered":"2024-09-13T16:49:28.102484+0000","last_unstale":"2024-09-13T16:51:13.030223+0000","last_undegraded":"2024-09-13T16:51:13.030223+0000","last_fullsized":"2024-09-13T16:51:13.030223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:56.922183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:15.928863+0000","last_change":"2024-09-13T16:49:27.669744+0000","last_active":"2024-09-13T16:51:15.928863+0000","last_peered":"2024-09-13T16:51:15.928863+0000","last_clean":"2024-09-13T16:51:15.928863+0000","last_became_active":"2024-09-13T16:49:27.667816+0000","last_became_peered":"2024-09-13T16:49:27.667816+0000","last_unstale":"2024-09-13T16:51:15.928863+0000","last_undegraded":"2024-09-13T16:51:15.928863+0000","last_fullsized":"2024-09-13T16:51:15.928863+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:36.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030039+0000","last_change":"2024-09-13T16:49:32.137114+0000","last_active":"2024-09-13T16:51:13.030039+0000","last_peered":"2024-09-13T16:51:13.030039+0000","last_clean":"2024-09-13T16:51:13.030039+0000","last_became_active":"2024-09-13T16:49:32.136077+0000","last_became_peered":"2024-09-13T16:49:32.136077+0000","last_unstale":"2024-09-13T16:51:13.030039+0000","last_undegraded":"2024-09-13T16:51:13.030039+0000","last_fullsized":"2024-09-13T16:51:13.030039+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:59.902852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028132+0000","last_change":"2024-09-13T16:50:13.652058+0000","last_active":"2024-09-13T16:51:13.028132+0000","last_peered":"2024-09-13T16:51:13.028132+0000","last_clean":"2024-09-13T16:51:13.028132+0000","last_became_active":"2024-09-13T16:50:13.651515+0000","last_became_peered":"2024-09-13T16:50:13.651515+0000","last_unstale":"2024-09-13T16:51:13.028132+0000","last_undegraded":"2024-09-13T16:51:13.028132+0000","last_fullsized":"2024-09-13T16:51:13.028132+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:58.582671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131033+0000","last_change":"2024-09-13T16:49:27.648000+0000","last_active":"2024-09-13T16:51:13.131033+0000","last_peered":"2024-09-13T16:51:13.131033+0000","last_clean":"2024-09-13T16:51:13.131033+0000","last_became_active":"2024-09-13T16:49:27.647639+0000","last_became_peered":"2024-09-13T16:49:27.647639+0000","last_unstale":"2024-09-13T16:51:13.131033+0000","last_undegraded":"2024-09-13T16:51:13.131033+0000","last_fullsized":"2024-09-13T16:51:13.131033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:28.941060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030194+0000","last_change":"2024-09-13T16:49:32.132868+0000","last_active":"2024-09-13T16:51:13.030194+0000","last_peered":"2024-09-13T16:51:13.030194+0000","last_clean":"2024-09-13T16:51:13.030194+0000","last_became_active":"2024-09-13T16:49:32.132562+0000","last_became_peered":"2024-09-13T16:49:32.132562+0000","last_unstale":"2024-09-13T16:51:13.030194+0000","last_undegraded":"2024-09-13T16:51:13.030194+0000","last_fullsized":"2024-09-13T16:51:13.030194+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:31.365339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.033405+0000","last_change":"2024-09-13T16:49:28.107483+0000","last_active":"2024-09-13T16:51:13.033405+0000","last_peered":"2024-09-13T16:51:13.033405+0000","last_clean":"2024-09-13T16:51:13.033405+0000","last_became_active":"2024-09-13T16:49:28.107111+0000","last_became_peered":"2024-09-13T16:49:28.107111+0000","last_unstale":"2024-09-13T16:51:13.033405+0000","last_undegraded":"2024-09-13T16:51:13.033405+0000","last_fullsized":"2024-09-13T16:51:13.033405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:56.987970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029264+0000","last_change":"2024-09-13T16:49:27.646872+0000","last_active":"2024-09-13T16:51:13.029264+0000","last_peered":"2024-09-13T16:51:13.029264+0000","last_clean":"2024-09-13T16:51:13.029264+0000","last_became_active":"2024-09-13T16:49:27.646523+0000","last_became_peered":"2024-09-13T16:49:27.646523+0000","last_unstale":"2024-09-13T16:51:13.029264+0000","last_undegraded":"2024-09-13T16:51:13.029264+0000","last_fullsized":"2024-09-13T16:51:13.029264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.384393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":336,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131141+0000","last_change":"2024-09-13T16:48:12.777004+0000","last_active":"2024-09-13T16:51:13.131141+0000","last_peered":"2024-09-13T16:51:13.131141+0000","last_clean":"2024-09-13T16:51:13.131141+0000","last_became_active":"2024-09-13T16:48:12.776499+0000","last_became_peered":"2024-09-13T16:48:12.776499+0000","last_unstale":"2024-09-13T16:51:13.131141+0000","last_undegraded":"2024-09-13T16:51:13.131141+0000","last_fullsized":"2024-09-13T16:51:13.131141+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:44:44.393091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:44:44.393091+0000","last_clean_scrub_stamp":"2024-09-13T16:44:44.393091+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:38.427421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131223+0000","last_change":"2024-09-13T16:49:32.119501+0000","last_active":"2024-09-13T16:51:13.131223+0000","last_peered":"2024-09-13T16:51:13.131223+0000","last_clean":"2024-09-13T16:51:13.131223+0000","last_became_active":"2024-09-13T16:49:32.118856+0000","last_became_peered":"2024-09-13T16:49:32.118856+0000","last_unstale":"2024-09-13T16:51:13.131223+0000","last_undegraded":"2024-09-13T16:51:13.131223+0000","last_fullsized":"2024-09-13T16:51:13.131223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:13.078311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131362+0000","last_change":"2024-09-13T16:49:28.106290+0000","last_active":"2024-09-13T16:51:13.131362+0000","last_peered":"2024-09-13T16:51:13.131362+0000","last_clean":"2024-09-13T16:51:13.131362+0000","last_became_active":"2024-09-13T16:49:28.105608+0000","last_became_peered":"2024-09-13T16:49:28.105608+0000","last_unstale":"2024-09-13T16:51:13.131362+0000","last_undegraded":"2024-09-13T16:51:13.131362+0000","last_fullsized":"2024-09-13T16:51:13.131362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:57.711931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030201+0000","last_change":"2024-09-13T16:49:27.667242+0000","last_active":"2024-09-13T16:51:13.030201+0000","last_peered":"2024-09-13T16:51:13.030201+0000","last_clean":"2024-09-13T16:51:13.030201+0000","last_became_active":"2024-09-13T16:49:27.666939+0000","last_became_peered":"2024-09-13T16:49:27.666939+0000","last_unstale":"2024-09-13T16:51:13.030201+0000","last_undegraded":"2024-09-13T16:51:13.030201+0000","last_fullsized":"2024-09-13T16:51:13.030201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:10.558691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031135+0000","last_change":"2024-09-13T16:49:32.128832+0000","last_active":"2024-09-13T16:51:13.031135+0000","last_peered":"2024-09-13T16:51:13.031135+0000","last_clean":"2024-09-13T16:51:13.031135+0000","last_became_active":"2024-09-13T16:49:32.128369+0000","last_became_peered":"2024-09-13T16:49:32.128369+0000","last_unstale":"2024-09-13T16:51:13.031135+0000","last_undegraded":"2024-09-13T16:51:13.031135+0000","last_fullsized":"2024-09-13T16:51:13.031135+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:26.756858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131224+0000","last_change":"2024-09-13T16:49:28.115686+0000","last_active":"2024-09-13T16:51:13.131224+0000","last_peered":"2024-09-13T16:51:13.131224+0000","last_clean":"2024-09-13T16:51:13.131224+0000","last_became_active":"2024-09-13T16:49:28.115439+0000","last_became_peered":"2024-09-13T16:49:28.115439+0000","last_unstale":"2024-09-13T16:51:13.131224+0000","last_undegraded":"2024-09-13T16:51:13.131224+0000","last_fullsized":"2024-09-13T16:51:13.131224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:03.134657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031070+0000","last_change":"2024-09-13T16:49:27.653794+0000","last_active":"2024-09-13T16:51:13.031070+0000","last_peered":"2024-09-13T16:51:13.031070+0000","last_clean":"2024-09-13T16:51:13.031070+0000","last_became_active":"2024-09-13T16:49:27.653483+0000","last_became_peered":"2024-09-13T16:49:27.653483+0000","last_unstale":"2024-09-13T16:51:13.031070+0000","last_undegraded":"2024-09-13T16:51:13.031070+0000","last_fullsized":"2024-09-13T16:51:13.031070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:49.488599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029204+0000","last_change":"2024-09-13T16:49:32.124277+0000","last_active":"2024-09-13T16:51:13.029204+0000","last_peered":"2024-09-13T16:51:13.029204+0000","last_clean":"2024-09-13T16:51:13.029204+0000","last_became_active":"2024-09-13T16:49:32.123858+0000","last_became_peered":"2024-09-13T16:49:32.123858+0000","last_unstale":"2024-09-13T16:51:13.029204+0000","last_undegraded":"2024-09-13T16:51:13.029204+0000","last_fullsized":"2024-09-13T16:51:13.029204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:40.965149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131310+0000","last_change":"2024-09-13T16:49:28.107349+0000","last_active":"2024-09-13T16:51:13.131310+0000","last_peered":"2024-09-13T16:51:13.131310+0000","last_clean":"2024-09-13T16:51:13.131310+0000","last_became_active":"2024-09-13T16:49:28.107048+0000","last_became_peered":"2024-09-13T16:49:28.107048+0000","last_unstale":"2024-09-13T16:51:13.131310+0000","last_undegraded":"2024-09-13T16:51:13.131310+0000","last_fullsized":"2024-09-13T16:51:13.131310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:00.188460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030239+0000","last_change":"2024-09-13T16:49:27.662761+0000","last_active":"2024-09-13T16:51:13.030239+0000","last_peered":"2024-09-13T16:51:13.030239+0000","last_clean":"2024-09-13T16:51:13.030239+0000","last_became_active":"2024-09-13T16:49:27.662452+0000","last_became_peered":"2024-09-13T16:49:27.662452+0000","last_unstale":"2024-09-13T16:51:13.030239+0000","last_undegraded":"2024-09-13T16:51:13.030239+0000","last_fullsized":"2024-09-13T16:51:13.030239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:51:10.175720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029852+0000","last_change":"2024-09-13T16:49:32.118043+0000","last_active":"2024-09-13T16:51:13.029852+0000","last_peered":"2024-09-13T16:51:13.029852+0000","last_clean":"2024-09-13T16:51:13.029852+0000","last_became_active":"2024-09-13T16:49:32.117423+0000","last_became_peered":"2024-09-13T16:49:32.117423+0000","last_unstale":"2024-09-13T16:51:13.029852+0000","last_undegraded":"2024-09-13T16:51:13.029852+0000","last_fullsized":"2024-09-13T16:51:13.029852+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:13.791606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028583+0000","last_change":"2024-09-13T16:49:28.104554+0000","last_active":"2024-09-13T16:51:13.028583+0000","last_peered":"2024-09-13T16:51:13.028583+0000","last_clean":"2024-09-13T16:51:13.028583+0000","last_became_active":"2024-09-13T16:49:28.104158+0000","last_became_peered":"2024-09-13T16:49:28.104158+0000","last_unstale":"2024-09-13T16:51:13.028583+0000","last_undegraded":"2024-09-13T16:51:13.028583+0000","last_fullsized":"2024-09-13T16:51:13.028583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:08.723966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028885+0000","last_change":"2024-09-13T16:50:13.657308+0000","last_active":"2024-09-13T16:51:13.028885+0000","last_peered":"2024-09-13T16:51:13.028885+0000","last_clean":"2024-09-13T16:51:13.028885+0000","last_became_active":"2024-09-13T16:50:13.648491+0000","last_became_peered":"2024-09-13T16:50:13.648491+0000","last_unstale":"2024-09-13T16:51:13.028885+0000","last_undegraded":"2024-09-13T16:51:13.028885+0000","last_fullsized":"2024-09-13T16:51:13.028885+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:57.087680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029922+0000","last_change":"2024-09-13T16:49:32.123998+0000","last_active":"2024-09-13T16:51:13.029922+0000","last_peered":"2024-09-13T16:51:13.029922+0000","last_clean":"2024-09-13T16:51:13.029922+0000","last_became_active":"2024-09-13T16:49:32.123619+0000","last_became_peered":"2024-09-13T16:49:32.123619+0000","last_unstale":"2024-09-13T16:51:13.029922+0000","last_undegraded":"2024-09-13T16:51:13.029922+0000","last_fullsized":"2024-09-13T16:51:13.029922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:32.271957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030122+0000","last_change":"2024-09-13T16:49:28.101110+0000","last_active":"2024-09-13T16:51:13.030122+0000","last_peered":"2024-09-13T16:51:13.030122+0000","last_clean":"2024-09-13T16:51:13.030122+0000","last_became_active":"2024-09-13T16:49:28.099342+0000","last_became_peered":"2024-09-13T16:49:28.099342+0000","last_unstale":"2024-09-13T16:51:13.030122+0000","last_undegraded":"2024-09-13T16:51:13.030122+0000","last_fullsized":"2024-09-13T16:51:13.030122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:44.331289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028209+0000","last_change":"2024-09-13T16:50:13.668091+0000","last_active":"2024-09-13T16:51:13.028209+0000","last_peered":"2024-09-13T16:51:13.028209+0000","last_clean":"2024-09-13T16:51:13.028209+0000","last_became_active":"2024-09-13T16:50:13.650668+0000","last_became_peered":"2024-09-13T16:50:13.650668+0000","last_unstale":"2024-09-13T16:51:13.028209+0000","last_undegraded":"2024-09-13T16:51:13.028209+0000","last_fullsized":"2024-09-13T16:51:13.028209+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:40.047203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:14.584516+0000","last_change":"2024-09-13T16:51:14.584516+0000","last_active":"2024-09-13T16:51:14.584516+0000","last_peered":"2024-09-13T16:51:14.584516+0000","last_clean":"2024-09-13T16:51:14.584516+0000","last_became_active":"2024-09-13T16:51:14.584117+0000","last_became_peered":"2024-09-13T16:51:14.584117+0000","last_unstale":"2024-09-13T16:51:14.584516+0000","last_undegraded":"2024-09-13T16:51:14.584516+0000","last_fullsized":"2024-09-13T16:51:14.584516+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:57.135059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.130803+0000","last_change":"2024-09-13T16:49:28.103828+0000","last_active":"2024-09-13T16:51:13.130803+0000","last_peered":"2024-09-13T16:51:13.130803+0000","last_clean":"2024-09-13T16:51:13.130803+0000","last_became_active":"2024-09-13T16:49:28.103526+0000","last_became_peered":"2024-09-13T16:49:28.103526+0000","last_unstale":"2024-09-13T16:51:13.130803+0000","last_undegraded":"2024-09-13T16:51:13.130803+0000","last_fullsized":"2024-09-13T16:51:13.130803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:21.612371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":113,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:19.937081+0000","last_change":"2024-09-13T16:49:27.643734+0000","last_active":"2024-09-13T16:51:19.937081+0000","last_peered":"2024-09-13T16:51:19.937081+0000","last_clean":"2024-09-13T16:51:19.937081+0000","last_became_active":"2024-09-13T16:49:27.643129+0000","last_became_peered":"2024-09-13T16:49:27.643129+0000","last_unstale":"2024-09-13T16:51:19.937081+0000","last_undegraded":"2024-09-13T16:51:19.937081+0000","last_fullsized":"2024-09-13T16:51:19.937081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:01.756293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1073,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025692+0000","last_change":"2024-09-13T16:49:32.132105+0000","last_active":"2024-09-13T16:51:13.025692+0000","last_peered":"2024-09-13T16:51:13.025692+0000","last_clean":"2024-09-13T16:51:13.025692+0000","last_became_active":"2024-09-13T16:49:32.131379+0000","last_became_peered":"2024-09-13T16:49:32.131379+0000","last_unstale":"2024-09-13T16:51:13.025692+0000","last_undegraded":"2024-09-13T16:51:13.025692+0000","last_fullsized":"2024-09-13T16:51:13.025692+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:09.215195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131237+0000","last_change":"2024-09-13T16:49:28.099072+0000","last_active":"2024-09-13T16:51:13.131237+0000","last_peered":"2024-09-13T16:51:13.131237+0000","last_clean":"2024-09-13T16:51:13.131237+0000","last_became_active":"2024-09-13T16:49:28.098797+0000","last_became_peered":"2024-09-13T16:49:28.098797+0000","last_unstale":"2024-09-13T16:51:13.131237+0000","last_undegraded":"2024-09-13T16:51:13.131237+0000","last_fullsized":"2024-09-13T16:51:13.131237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:36.997019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031216+0000","last_change":"2024-09-13T16:49:27.653581+0000","last_active":"2024-09-13T16:51:13.031216+0000","last_peered":"2024-09-13T16:51:13.031216+0000","last_clean":"2024-09-13T16:51:13.031216+0000","last_became_active":"2024-09-13T16:49:27.653245+0000","last_became_peered":"2024-09-13T16:49:27.653245+0000","last_unstale":"2024-09-13T16:51:13.031216+0000","last_undegraded":"2024-09-13T16:51:13.031216+0000","last_fullsized":"2024-09-13T16:51:13.031216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:47.639020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028467+0000","last_change":"2024-09-13T16:49:32.128569+0000","last_active":"2024-09-13T16:51:13.028467+0000","last_peered":"2024-09-13T16:51:13.028467+0000","last_clean":"2024-09-13T16:51:13.028467+0000","last_became_active":"2024-09-13T16:49:32.128180+0000","last_became_peered":"2024-09-13T16:49:32.128180+0000","last_unstale":"2024-09-13T16:51:13.028467+0000","last_undegraded":"2024-09-13T16:51:13.028467+0000","last_fullsized":"2024-09-13T16:51:13.028467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.887518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028286+0000","last_change":"2024-09-13T16:49:28.111923+0000","last_active":"2024-09-13T16:51:13.028286+0000","last_peered":"2024-09-13T16:51:13.028286+0000","last_clean":"2024-09-13T16:51:13.028286+0000","last_became_active":"2024-09-13T16:49:28.108483+0000","last_became_peered":"2024-09-13T16:49:28.108483+0000","last_unstale":"2024-09-13T16:51:13.028286+0000","last_undegraded":"2024-09-13T16:51:13.028286+0000","last_fullsized":"2024-09-13T16:51:13.028286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:11.921967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029694+0000","last_change":"2024-09-13T16:49:27.653823+0000","last_active":"2024-09-13T16:51:13.029694+0000","last_peered":"2024-09-13T16:51:13.029694+0000","last_clean":"2024-09-13T16:51:13.029694+0000","last_became_active":"2024-09-13T16:49:27.653389+0000","last_became_peered":"2024-09-13T16:49:27.653389+0000","last_unstale":"2024-09-13T16:51:13.029694+0000","last_undegraded":"2024-09-13T16:51:13.029694+0000","last_fullsized":"2024-09-13T16:51:13.029694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:32.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030682+0000","last_change":"2024-09-13T16:49:32.128133+0000","last_active":"2024-09-13T16:51:13.030682+0000","last_peered":"2024-09-13T16:51:13.030682+0000","last_clean":"2024-09-13T16:51:13.030682+0000","last_became_active":"2024-09-13T16:49:32.127641+0000","last_became_peered":"2024-09-13T16:49:32.127641+0000","last_unstale":"2024-09-13T16:51:13.030682+0000","last_undegraded":"2024-09-13T16:51:13.030682+0000","last_fullsized":"2024-09-13T16:51:13.030682+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:18.349527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026576+0000","last_change":"2024-09-13T16:49:28.106264+0000","last_active":"2024-09-13T16:51:13.026576+0000","last_peered":"2024-09-13T16:51:13.026576+0000","last_clean":"2024-09-13T16:51:13.026576+0000","last_became_active":"2024-09-13T16:49:28.105901+0000","last_became_peered":"2024-09-13T16:49:28.105901+0000","last_unstale":"2024-09-13T16:51:13.026576+0000","last_undegraded":"2024-09-13T16:51:13.026576+0000","last_fullsized":"2024-09-13T16:51:13.026576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:46.516128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'35","reported_seq":248,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:19.753684+0000","last_change":"2024-09-13T16:50:13.661807+0000","last_active":"2024-09-13T16:51:19.753684+0000","last_peered":"2024-09-13T16:51:19.753684+0000","last_clean":"2024-09-13T16:51:19.753684+0000","last_became_active":"2024-09-13T16:50:13.648306+0000","last_became_peered":"2024-09-13T16:50:13.648306+0000","last_unstale":"2024-09-13T16:51:19.753684+0000","last_undegraded":"2024-09-13T16:51:19.753684+0000","last_fullsized":"2024-09-13T16:51:19.753684+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:56.390172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61978,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":163,"num_read_kb":128,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60591,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:14.584582+0000","last_change":"2024-09-13T16:51:14.584582+0000","last_active":"2024-09-13T16:51:14.584582+0000","last_peered":"2024-09-13T16:51:14.584582+0000","last_clean":"2024-09-13T16:51:14.584582+0000","last_became_active":"2024-09-13T16:51:14.584129+0000","last_became_peered":"2024-09-13T16:51:14.584129+0000","last_unstale":"2024-09-13T16:51:14.584582+0000","last_undegraded":"2024-09-13T16:51:14.584582+0000","last_fullsized":"2024-09-13T16:51:14.584582+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:20.321247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,10],"acting":[9,8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031841+0000","last_change":"2024-09-13T16:49:28.102549+0000","last_active":"2024-09-13T16:51:13.031841+0000","last_peered":"2024-09-13T16:51:13.031841+0000","last_clean":"2024-09-13T16:51:13.031841+0000","last_became_active":"2024-09-13T16:49:28.102109+0000","last_became_peered":"2024-09-13T16:49:28.102109+0000","last_unstale":"2024-09-13T16:51:13.031841+0000","last_undegraded":"2024-09-13T16:51:13.031841+0000","last_fullsized":"2024-09-13T16:51:13.031841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:04.410795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030881+0000","last_change":"2024-09-13T16:49:27.663189+0000","last_active":"2024-09-13T16:51:13.030881+0000","last_peered":"2024-09-13T16:51:13.030881+0000","last_clean":"2024-09-13T16:51:13.030881+0000","last_became_active":"2024-09-13T16:49:27.662852+0000","last_became_peered":"2024-09-13T16:49:27.662852+0000","last_unstale":"2024-09-13T16:51:13.030881+0000","last_undegraded":"2024-09-13T16:51:13.030881+0000","last_fullsized":"2024-09-13T16:51:13.030881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:32.862451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:14.585018+0000","last_change":"2024-09-13T16:51:14.585018+0000","last_active":"2024-09-13T16:51:14.585018+0000","last_peered":"2024-09-13T16:51:14.585018+0000","last_clean":"2024-09-13T16:51:14.585018+0000","last_became_active":"2024-09-13T16:51:14.584448+0000","last_became_peered":"2024-09-13T16:51:14.584448+0000","last_unstale":"2024-09-13T16:51:14.585018+0000","last_undegraded":"2024-09-13T16:51:14.585018+0000","last_fullsized":"2024-09-13T16:51:14.585018+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:25:56.983857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029690+0000","last_change":"2024-09-13T16:49:28.112762+0000","last_active":"2024-09-13T16:51:13.029690+0000","last_peered":"2024-09-13T16:51:13.029690+0000","last_clean":"2024-09-13T16:51:13.029690+0000","last_became_active":"2024-09-13T16:49:28.111865+0000","last_became_peered":"2024-09-13T16:49:28.111865+0000","last_unstale":"2024-09-13T16:51:13.029690+0000","last_undegraded":"2024-09-13T16:51:13.029690+0000","last_fullsized":"2024-09-13T16:51:13.029690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:36.633413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131264+0000","last_change":"2024-09-13T16:50:13.651587+0000","last_active":"2024-09-13T16:51:13.131264+0000","last_peered":"2024-09-13T16:51:13.131264+0000","last_clean":"2024-09-13T16:51:13.131264+0000","last_became_active":"2024-09-13T16:50:13.648491+0000","last_became_peered":"2024-09-13T16:50:13.648491+0000","last_unstale":"2024-09-13T16:51:13.131264+0000","last_undegraded":"2024-09-13T16:51:13.131264+0000","last_fullsized":"2024-09-13T16:51:13.131264+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:50:56.385359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:14.485250+0000","last_change":"2024-09-13T16:51:14.484868+0000","last_active":"2024-09-13T16:51:14.485250+0000","last_peered":"2024-09-13T16:51:14.485250+0000","last_clean":"2024-09-13T16:51:14.485250+0000","last_became_active":"2024-09-13T16:51:14.484327+0000","last_became_peered":"2024-09-13T16:51:14.484327+0000","last_unstale":"2024-09-13T16:51:14.485250+0000","last_undegraded":"2024-09-13T16:51:14.485250+0000","last_fullsized":"2024-09-13T16:51:14.485250+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:49.276979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031545+0000","last_change":"2024-09-13T16:49:28.102721+0000","last_active":"2024-09-13T16:51:13.031545+0000","last_peered":"2024-09-13T16:51:13.031545+0000","last_clean":"2024-09-13T16:51:13.031545+0000","last_became_active":"2024-09-13T16:49:28.102431+0000","last_became_peered":"2024-09-13T16:49:28.102431+0000","last_unstale":"2024-09-13T16:51:13.031545+0000","last_undegraded":"2024-09-13T16:51:13.031545+0000","last_fullsized":"2024-09-13T16:51:13.031545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:38.921527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:18.923054+0000","last_change":"2024-09-13T16:49:27.653616+0000","last_active":"2024-09-13T16:51:18.923054+0000","last_peered":"2024-09-13T16:51:18.923054+0000","last_clean":"2024-09-13T16:51:18.923054+0000","last_became_active":"2024-09-13T16:49:27.653312+0000","last_became_peered":"2024-09-13T16:49:27.653312+0000","last_unstale":"2024-09-13T16:51:18.923054+0000","last_undegraded":"2024-09-13T16:51:18.923054+0000","last_fullsized":"2024-09-13T16:51:18.923054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:37.536821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032496+0000","last_change":"2024-09-13T16:49:32.121500+0000","last_active":"2024-09-13T16:51:13.032496+0000","last_peered":"2024-09-13T16:51:13.032496+0000","last_clean":"2024-09-13T16:51:13.032496+0000","last_became_active":"2024-09-13T16:49:32.120434+0000","last_became_peered":"2024-09-13T16:49:32.120434+0000","last_unstale":"2024-09-13T16:51:13.032496+0000","last_undegraded":"2024-09-13T16:51:13.032496+0000","last_fullsized":"2024-09-13T16:51:13.032496+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:14.832079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029702+0000","last_change":"2024-09-13T16:49:32.129276+0000","last_active":"2024-09-13T16:51:13.029702+0000","last_peered":"2024-09-13T16:51:13.029702+0000","last_clean":"2024-09-13T16:51:13.029702+0000","last_became_active":"2024-09-13T16:49:32.128351+0000","last_became_peered":"2024-09-13T16:49:32.128351+0000","last_unstale":"2024-09-13T16:51:13.029702+0000","last_undegraded":"2024-09-13T16:51:13.029702+0000","last_fullsized":"2024-09-13T16:51:13.029702+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:30.287034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025182+0000","last_change":"2024-09-13T16:49:28.105330+0000","last_active":"2024-09-13T16:51:13.025182+0000","last_peered":"2024-09-13T16:51:13.025182+0000","last_clean":"2024-09-13T16:51:13.025182+0000","last_became_active":"2024-09-13T16:49:28.105048+0000","last_became_peered":"2024-09-13T16:49:28.105048+0000","last_unstale":"2024-09-13T16:51:13.025182+0000","last_undegraded":"2024-09-13T16:51:13.025182+0000","last_fullsized":"2024-09-13T16:51:13.025182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:50.302087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030998+0000","last_change":"2024-09-13T16:49:27.645811+0000","last_active":"2024-09-13T16:51:13.030998+0000","last_peered":"2024-09-13T16:51:13.030998+0000","last_clean":"2024-09-13T16:51:13.030998+0000","last_became_active":"2024-09-13T16:49:27.645239+0000","last_became_peered":"2024-09-13T16:49:27.645239+0000","last_unstale":"2024-09-13T16:51:13.030998+0000","last_undegraded":"2024-09-13T16:51:13.030998+0000","last_fullsized":"2024-09-13T16:51:13.030998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:14.960763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028755+0000","last_change":"2024-09-13T16:49:32.129619+0000","last_active":"2024-09-13T16:51:13.028755+0000","last_peered":"2024-09-13T16:51:13.028755+0000","last_clean":"2024-09-13T16:51:13.028755+0000","last_became_active":"2024-09-13T16:49:32.128897+0000","last_became_peered":"2024-09-13T16:49:32.128897+0000","last_unstale":"2024-09-13T16:51:13.028755+0000","last_undegraded":"2024-09-13T16:51:13.028755+0000","last_fullsized":"2024-09-13T16:51:13.028755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:47.343520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.033275+0000","last_change":"2024-09-13T16:49:28.100409+0000","last_active":"2024-09-13T16:51:13.033275+0000","last_peered":"2024-09-13T16:51:13.033275+0000","last_clean":"2024-09-13T16:51:13.033275+0000","last_became_active":"2024-09-13T16:49:28.096557+0000","last_became_peered":"2024-09-13T16:49:28.096557+0000","last_unstale":"2024-09-13T16:51:13.033275+0000","last_undegraded":"2024-09-13T16:51:13.033275+0000","last_fullsized":"2024-09-13T16:51:13.033275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:06.959079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028235+0000","last_change":"2024-09-13T16:49:27.658366+0000","last_active":"2024-09-13T16:51:13.028235+0000","last_peered":"2024-09-13T16:51:13.028235+0000","last_clean":"2024-09-13T16:51:13.028235+0000","last_became_active":"2024-09-13T16:49:27.657907+0000","last_became_peered":"2024-09-13T16:49:27.657907+0000","last_unstale":"2024-09-13T16:51:13.028235+0000","last_undegraded":"2024-09-13T16:51:13.028235+0000","last_fullsized":"2024-09-13T16:51:13.028235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:11.493555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026157+0000","last_change":"2024-09-13T16:49:27.656786+0000","last_active":"2024-09-13T16:51:13.026157+0000","last_peered":"2024-09-13T16:51:13.026157+0000","last_clean":"2024-09-13T16:51:13.026157+0000","last_became_active":"2024-09-13T16:49:27.656508+0000","last_became_peered":"2024-09-13T16:49:27.656508+0000","last_unstale":"2024-09-13T16:51:13.026157+0000","last_undegraded":"2024-09-13T16:51:13.026157+0000","last_fullsized":"2024-09-13T16:51:13.026157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:22.867530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030682+0000","last_change":"2024-09-13T16:50:13.652393+0000","last_active":"2024-09-13T16:51:13.030682+0000","last_peered":"2024-09-13T16:51:13.030682+0000","last_clean":"2024-09-13T16:51:13.030682+0000","last_became_active":"2024-09-13T16:50:13.652017+0000","last_became_peered":"2024-09-13T16:50:13.652017+0000","last_unstale":"2024-09-13T16:51:13.030682+0000","last_undegraded":"2024-09-13T16:51:13.030682+0000","last_fullsized":"2024-09-13T16:51:13.030682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:03.311574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,8],"acting":[5,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029014+0000","last_change":"2024-09-13T16:49:32.128808+0000","last_active":"2024-09-13T16:51:13.029014+0000","last_peered":"2024-09-13T16:51:13.029014+0000","last_clean":"2024-09-13T16:51:13.029014+0000","last_became_active":"2024-09-13T16:49:32.128333+0000","last_became_peered":"2024-09-13T16:49:32.128333+0000","last_unstale":"2024-09-13T16:51:13.029014+0000","last_undegraded":"2024-09-13T16:51:13.029014+0000","last_fullsized":"2024-09-13T16:51:13.029014+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:03.484456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":112,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:16.920624+0000","last_change":"2024-09-13T16:49:27.648863+0000","last_active":"2024-09-13T16:51:16.920624+0000","last_peered":"2024-09-13T16:51:16.920624+0000","last_clean":"2024-09-13T16:51:16.920624+0000","last_became_active":"2024-09-13T16:49:27.648572+0000","last_became_peered":"2024-09-13T16:49:27.648572+0000","last_unstale":"2024-09-13T16:51:16.920624+0000","last_undegraded":"2024-09-13T16:51:16.920624+0000","last_fullsized":"2024-09-13T16:51:16.920624+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026993+0000","last_change":"2024-09-13T16:49:28.114013+0000","last_active":"2024-09-13T16:51:13.026993+0000","last_peered":"2024-09-13T16:51:13.026993+0000","last_clean":"2024-09-13T16:51:13.026993+0000","last_became_active":"2024-09-13T16:49:28.113722+0000","last_became_peered":"2024-09-13T16:49:28.113722+0000","last_unstale":"2024-09-13T16:51:13.026993+0000","last_undegraded":"2024-09-13T16:51:13.026993+0000","last_fullsized":"2024-09-13T16:51:13.026993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:42.560038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030284+0000","last_change":"2024-09-13T16:49:32.118308+0000","last_active":"2024-09-13T16:51:13.030284+0000","last_peered":"2024-09-13T16:51:13.030284+0000","last_clean":"2024-09-13T16:51:13.030284+0000","last_became_active":"2024-09-13T16:49:32.117963+0000","last_became_peered":"2024-09-13T16:49:32.117963+0000","last_unstale":"2024-09-13T16:51:13.030284+0000","last_undegraded":"2024-09-13T16:51:13.030284+0000","last_fullsized":"2024-09-13T16:51:13.030284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:26.939494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028324+0000","last_change":"2024-09-13T16:49:28.102325+0000","last_active":"2024-09-13T16:51:13.028324+0000","last_peered":"2024-09-13T16:51:13.028324+0000","last_clean":"2024-09-13T16:51:13.028324+0000","last_became_active":"2024-09-13T16:49:28.102007+0000","last_became_peered":"2024-09-13T16:49:28.102007+0000","last_unstale":"2024-09-13T16:51:13.028324+0000","last_undegraded":"2024-09-13T16:51:13.028324+0000","last_fullsized":"2024-09-13T16:51:13.028324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:10.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029624+0000","last_change":"2024-09-13T16:49:28.102964+0000","last_active":"2024-09-13T16:51:13.029624+0000","last_peered":"2024-09-13T16:51:13.029624+0000","last_clean":"2024-09-13T16:51:13.029624+0000","last_became_active":"2024-09-13T16:49:28.102678+0000","last_became_peered":"2024-09-13T16:49:28.102678+0000","last_unstale":"2024-09-13T16:51:13.029624+0000","last_undegraded":"2024-09-13T16:51:13.029624+0000","last_fullsized":"2024-09-13T16:51:13.029624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.255219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029009+0000","last_change":"2024-09-13T16:49:28.117353+0000","last_active":"2024-09-13T16:51:13.029009+0000","last_peered":"2024-09-13T16:51:13.029009+0000","last_clean":"2024-09-13T16:51:13.029009+0000","last_became_active":"2024-09-13T16:49:28.117020+0000","last_became_peered":"2024-09-13T16:49:28.117020+0000","last_unstale":"2024-09-13T16:51:13.029009+0000","last_undegraded":"2024-09-13T16:51:13.029009+0000","last_fullsized":"2024-09-13T16:51:13.029009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:46.896795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029306+0000","last_change":"2024-09-13T16:49:28.112090+0000","last_active":"2024-09-13T16:51:13.029306+0000","last_peered":"2024-09-13T16:51:13.029306+0000","last_clean":"2024-09-13T16:51:13.029306+0000","last_became_active":"2024-09-13T16:49:28.111793+0000","last_became_peered":"2024-09-13T16:49:28.111793+0000","last_unstale":"2024-09-13T16:51:13.029306+0000","last_undegraded":"2024-09-13T16:51:13.029306+0000","last_fullsized":"2024-09-13T16:51:13.029306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:45.462344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029301+0000","last_change":"2024-09-13T16:49:28.105186+0000","last_active":"2024-09-13T16:51:13.029301+0000","last_peered":"2024-09-13T16:51:13.029301+0000","last_clean":"2024-09-13T16:51:13.029301+0000","last_became_active":"2024-09-13T16:49:28.104827+0000","last_became_peered":"2024-09-13T16:49:28.104827+0000","last_unstale":"2024-09-13T16:51:13.029301+0000","last_undegraded":"2024-09-13T16:51:13.029301+0000","last_fullsized":"2024-09-13T16:51:13.029301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:07.872650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028693+0000","last_change":"2024-09-13T16:50:13.652095+0000","last_active":"2024-09-13T16:51:13.028693+0000","last_peered":"2024-09-13T16:51:13.028693+0000","last_clean":"2024-09-13T16:51:13.028693+0000","last_became_active":"2024-09-13T16:50:13.651745+0000","last_became_peered":"2024-09-13T16:50:13.651745+0000","last_unstale":"2024-09-13T16:51:13.028693+0000","last_undegraded":"2024-09-13T16:51:13.028693+0000","last_fullsized":"2024-09-13T16:51:13.028693+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:59.786923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030417+0000","last_change":"2024-09-13T16:49:28.101008+0000","last_active":"2024-09-13T16:51:13.030417+0000","last_peered":"2024-09-13T16:51:13.030417+0000","last_clean":"2024-09-13T16:51:13.030417+0000","last_became_active":"2024-09-13T16:49:28.100075+0000","last_became_peered":"2024-09-13T16:49:28.100075+0000","last_unstale":"2024-09-13T16:51:13.030417+0000","last_undegraded":"2024-09-13T16:51:13.030417+0000","last_fullsized":"2024-09-13T16:51:13.030417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:01.890674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032998+0000","last_change":"2024-09-13T16:49:28.108283+0000","last_active":"2024-09-13T16:51:13.032998+0000","last_peered":"2024-09-13T16:51:13.032998+0000","last_clean":"2024-09-13T16:51:13.032998+0000","last_became_active":"2024-09-13T16:49:28.107916+0000","last_became_peered":"2024-09-13T16:49:28.107916+0000","last_unstale":"2024-09-13T16:51:13.032998+0000","last_undegraded":"2024-09-13T16:51:13.032998+0000","last_fullsized":"2024-09-13T16:51:13.032998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:03.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030115+0000","last_change":"2024-09-13T16:49:28.106680+0000","last_active":"2024-09-13T16:51:13.030115+0000","last_peered":"2024-09-13T16:51:13.030115+0000","last_clean":"2024-09-13T16:51:13.030115+0000","last_became_active":"2024-09-13T16:49:28.105210+0000","last_became_peered":"2024-09-13T16:49:28.105210+0000","last_unstale":"2024-09-13T16:51:13.030115+0000","last_undegraded":"2024-09-13T16:51:13.030115+0000","last_fullsized":"2024-09-13T16:51:13.030115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:34.220082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032672+0000","last_change":"2024-09-13T16:49:28.104596+0000","last_active":"2024-09-13T16:51:13.032672+0000","last_peered":"2024-09-13T16:51:13.032672+0000","last_clean":"2024-09-13T16:51:13.032672+0000","last_became_active":"2024-09-13T16:49:28.104306+0000","last_became_peered":"2024-09-13T16:49:28.104306+0000","last_unstale":"2024-09-13T16:51:13.032672+0000","last_undegraded":"2024-09-13T16:51:13.032672+0000","last_fullsized":"2024-09-13T16:51:13.032672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:02.248968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031326+0000","last_change":"2024-09-13T16:49:28.105229+0000","last_active":"2024-09-13T16:51:13.031326+0000","last_peered":"2024-09-13T16:51:13.031326+0000","last_clean":"2024-09-13T16:51:13.031326+0000","last_became_active":"2024-09-13T16:49:28.104832+0000","last_became_peered":"2024-09-13T16:49:28.104832+0000","last_unstale":"2024-09-13T16:51:13.031326+0000","last_undegraded":"2024-09-13T16:51:13.031326+0000","last_fullsized":"2024-09-13T16:51:13.031326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:36.637117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028349+0000","last_change":"2024-09-13T16:49:28.105370+0000","last_active":"2024-09-13T16:51:13.028349+0000","last_peered":"2024-09-13T16:51:13.028349+0000","last_clean":"2024-09-13T16:51:13.028349+0000","last_became_active":"2024-09-13T16:49:28.105024+0000","last_became_peered":"2024-09-13T16:49:28.105024+0000","last_unstale":"2024-09-13T16:51:13.028349+0000","last_undegraded":"2024-09-13T16:51:13.028349+0000","last_fullsized":"2024-09-13T16:51:13.028349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:32.056178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028390+0000","last_change":"2024-09-13T16:49:28.106106+0000","last_active":"2024-09-13T16:51:13.028390+0000","last_peered":"2024-09-13T16:51:13.028390+0000","last_clean":"2024-09-13T16:51:13.028390+0000","last_became_active":"2024-09-13T16:49:28.105034+0000","last_became_peered":"2024-09-13T16:49:28.105034+0000","last_unstale":"2024-09-13T16:51:13.028390+0000","last_undegraded":"2024-09-13T16:51:13.028390+0000","last_fullsized":"2024-09-13T16:51:13.028390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:08.126157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030108+0000","last_change":"2024-09-13T16:49:28.116862+0000","last_active":"2024-09-13T16:51:13.030108+0000","last_peered":"2024-09-13T16:51:13.030108+0000","last_clean":"2024-09-13T16:51:13.030108+0000","last_became_active":"2024-09-13T16:49:28.116535+0000","last_became_peered":"2024-09-13T16:49:28.116535+0000","last_unstale":"2024-09-13T16:51:13.030108+0000","last_undegraded":"2024-09-13T16:51:13.030108+0000","last_fullsized":"2024-09-13T16:51:13.030108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:07.216968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025556+0000","last_change":"2024-09-13T16:49:28.096500+0000","last_active":"2024-09-13T16:51:13.025556+0000","last_peered":"2024-09-13T16:51:13.025556+0000","last_clean":"2024-09-13T16:51:13.025556+0000","last_became_active":"2024-09-13T16:49:28.096218+0000","last_became_peered":"2024-09-13T16:49:28.096218+0000","last_unstale":"2024-09-13T16:51:13.025556+0000","last_undegraded":"2024-09-13T16:51:13.025556+0000","last_fullsized":"2024-09-13T16:51:13.025556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:16.274941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029097+0000","last_change":"2024-09-13T16:49:28.114943+0000","last_active":"2024-09-13T16:51:13.029097+0000","last_peered":"2024-09-13T16:51:13.029097+0000","last_clean":"2024-09-13T16:51:13.029097+0000","last_became_active":"2024-09-13T16:49:28.114477+0000","last_became_peered":"2024-09-13T16:49:28.114477+0000","last_unstale":"2024-09-13T16:51:13.029097+0000","last_undegraded":"2024-09-13T16:51:13.029097+0000","last_fullsized":"2024-09-13T16:51:13.029097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:21.222638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030893+0000","last_change":"2024-09-13T16:49:28.103795+0000","last_active":"2024-09-13T16:51:13.030893+0000","last_peered":"2024-09-13T16:51:13.030893+0000","last_clean":"2024-09-13T16:51:13.030893+0000","last_became_active":"2024-09-13T16:49:28.103531+0000","last_became_peered":"2024-09-13T16:49:28.103531+0000","last_unstale":"2024-09-13T16:51:13.030893+0000","last_undegraded":"2024-09-13T16:51:13.030893+0000","last_fullsized":"2024-09-13T16:51:13.030893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:17.886309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028891+0000","last_change":"2024-09-13T16:50:13.651345+0000","last_active":"2024-09-13T16:51:13.028891+0000","last_peered":"2024-09-13T16:51:13.028891+0000","last_clean":"2024-09-13T16:51:13.028891+0000","last_became_active":"2024-09-13T16:50:13.650909+0000","last_became_peered":"2024-09-13T16:50:13.650909+0000","last_unstale":"2024-09-13T16:51:13.028891+0000","last_undegraded":"2024-09-13T16:51:13.028891+0000","last_fullsized":"2024-09-13T16:51:13.028891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:51.776319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029124+0000","last_change":"2024-09-13T16:49:28.114265+0000","last_active":"2024-09-13T16:51:13.029124+0000","last_peered":"2024-09-13T16:51:13.029124+0000","last_clean":"2024-09-13T16:51:13.029124+0000","last_became_active":"2024-09-13T16:49:28.111350+0000","last_became_peered":"2024-09-13T16:49:28.111350+0000","last_unstale":"2024-09-13T16:51:13.029124+0000","last_undegraded":"2024-09-13T16:51:13.029124+0000","last_fullsized":"2024-09-13T16:51:13.029124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:11.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028342+0000","last_change":"2024-09-13T16:49:28.088565+0000","last_active":"2024-09-13T16:51:13.028342+0000","last_peered":"2024-09-13T16:51:13.028342+0000","last_clean":"2024-09-13T16:51:13.028342+0000","last_became_active":"2024-09-13T16:49:28.088070+0000","last_became_peered":"2024-09-13T16:49:28.088070+0000","last_unstale":"2024-09-13T16:51:13.028342+0000","last_undegraded":"2024-09-13T16:51:13.028342+0000","last_fullsized":"2024-09-13T16:51:13.028342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:23.134281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029090+0000","last_change":"2024-09-13T16:49:28.107501+0000","last_active":"2024-09-13T16:51:13.029090+0000","last_peered":"2024-09-13T16:51:13.029090+0000","last_clean":"2024-09-13T16:51:13.029090+0000","last_became_active":"2024-09-13T16:49:28.107222+0000","last_became_peered":"2024-09-13T16:49:28.107222+0000","last_unstale":"2024-09-13T16:51:13.029090+0000","last_undegraded":"2024-09-13T16:51:13.029090+0000","last_fullsized":"2024-09-13T16:51:13.029090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:04:00.465540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131341+0000","last_change":"2024-09-13T16:49:28.108274+0000","last_active":"2024-09-13T16:51:13.131341+0000","last_peered":"2024-09-13T16:51:13.131341+0000","last_clean":"2024-09-13T16:51:13.131341+0000","last_became_active":"2024-09-13T16:49:28.107977+0000","last_became_peered":"2024-09-13T16:49:28.107977+0000","last_unstale":"2024-09-13T16:51:13.131341+0000","last_undegraded":"2024-09-13T16:51:13.131341+0000","last_fullsized":"2024-09-13T16:51:13.131341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:31.398072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026404+0000","last_change":"2024-09-13T16:49:28.098428+0000","last_active":"2024-09-13T16:51:13.026404+0000","last_peered":"2024-09-13T16:51:13.026404+0000","last_clean":"2024-09-13T16:51:13.026404+0000","last_became_active":"2024-09-13T16:49:28.098139+0000","last_became_peered":"2024-09-13T16:49:28.098139+0000","last_unstale":"2024-09-13T16:51:13.026404+0000","last_undegraded":"2024-09-13T16:51:13.026404+0000","last_fullsized":"2024-09-13T16:51:13.026404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:36.977026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031794+0000","last_change":"2024-09-13T16:49:28.103117+0000","last_active":"2024-09-13T16:51:13.031794+0000","last_peered":"2024-09-13T16:51:13.031794+0000","last_clean":"2024-09-13T16:51:13.031794+0000","last_became_active":"2024-09-13T16:49:28.102850+0000","last_became_peered":"2024-09-13T16:49:28.102850+0000","last_unstale":"2024-09-13T16:51:13.031794+0000","last_undegraded":"2024-09-13T16:51:13.031794+0000","last_fullsized":"2024-09-13T16:51:13.031794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:21.883563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.033401+0000","last_change":"2024-09-13T16:49:28.105876+0000","last_active":"2024-09-13T16:51:13.033401+0000","last_peered":"2024-09-13T16:51:13.033401+0000","last_clean":"2024-09-13T16:51:13.033401+0000","last_became_active":"2024-09-13T16:49:28.104340+0000","last_became_peered":"2024-09-13T16:49:28.104340+0000","last_unstale":"2024-09-13T16:51:13.033401+0000","last_undegraded":"2024-09-13T16:51:13.033401+0000","last_fullsized":"2024-09-13T16:51:13.033401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:06.385262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.130941+0000","last_change":"2024-09-13T16:49:28.104638+0000","last_active":"2024-09-13T16:51:13.130941+0000","last_peered":"2024-09-13T16:51:13.130941+0000","last_clean":"2024-09-13T16:51:13.130941+0000","last_became_active":"2024-09-13T16:49:28.104145+0000","last_became_peered":"2024-09-13T16:49:28.104145+0000","last_unstale":"2024-09-13T16:51:13.130941+0000","last_undegraded":"2024-09-13T16:51:13.130941+0000","last_fullsized":"2024-09-13T16:51:13.130941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:12.502634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026254+0000","last_change":"2024-09-13T16:50:13.645977+0000","last_active":"2024-09-13T16:51:13.026254+0000","last_peered":"2024-09-13T16:51:13.026254+0000","last_clean":"2024-09-13T16:51:13.026254+0000","last_became_active":"2024-09-13T16:50:13.645623+0000","last_became_peered":"2024-09-13T16:50:13.645623+0000","last_unstale":"2024-09-13T16:51:13.026254+0000","last_undegraded":"2024-09-13T16:51:13.026254+0000","last_fullsized":"2024-09-13T16:51:13.026254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:40.864700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026132+0000","last_change":"2024-09-13T16:49:28.116644+0000","last_active":"2024-09-13T16:51:13.026132+0000","last_peered":"2024-09-13T16:51:13.026132+0000","last_clean":"2024-09-13T16:51:13.026132+0000","last_became_active":"2024-09-13T16:49:28.116350+0000","last_became_peered":"2024-09-13T16:49:28.116350+0000","last_unstale":"2024-09-13T16:51:13.026132+0000","last_undegraded":"2024-09-13T16:51:13.026132+0000","last_fullsized":"2024-09-13T16:51:13.026132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:07.922567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029006+0000","last_change":"2024-09-13T16:49:28.107528+0000","last_active":"2024-09-13T16:51:13.029006+0000","last_peered":"2024-09-13T16:51:13.029006+0000","last_clean":"2024-09-13T16:51:13.029006+0000","last_became_active":"2024-09-13T16:49:28.107260+0000","last_became_peered":"2024-09-13T16:49:28.107260+0000","last_unstale":"2024-09-13T16:51:13.029006+0000","last_undegraded":"2024-09-13T16:51:13.029006+0000","last_fullsized":"2024-09-13T16:51:13.029006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:23.482772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029569+0000","last_change":"2024-09-13T16:49:28.105396+0000","last_active":"2024-09-13T16:51:13.029569+0000","last_peered":"2024-09-13T16:51:13.029569+0000","last_clean":"2024-09-13T16:51:13.029569+0000","last_became_active":"2024-09-13T16:49:28.105050+0000","last_became_peered":"2024-09-13T16:49:28.105050+0000","last_unstale":"2024-09-13T16:51:13.029569+0000","last_undegraded":"2024-09-13T16:51:13.029569+0000","last_fullsized":"2024-09-13T16:51:13.029569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:51.533286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029866+0000","last_change":"2024-09-13T16:49:28.112680+0000","last_active":"2024-09-13T16:51:13.029866+0000","last_peered":"2024-09-13T16:51:13.029866+0000","last_clean":"2024-09-13T16:51:13.029866+0000","last_became_active":"2024-09-13T16:49:28.112389+0000","last_became_peered":"2024-09-13T16:49:28.112389+0000","last_unstale":"2024-09-13T16:51:13.029866+0000","last_undegraded":"2024-09-13T16:51:13.029866+0000","last_fullsized":"2024-09-13T16:51:13.029866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:05.464951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029001+0000","last_change":"2024-09-13T16:49:28.105746+0000","last_active":"2024-09-13T16:51:13.029001+0000","last_peered":"2024-09-13T16:51:13.029001+0000","last_clean":"2024-09-13T16:51:13.029001+0000","last_became_active":"2024-09-13T16:49:28.105217+0000","last_became_peered":"2024-09-13T16:49:28.105217+0000","last_unstale":"2024-09-13T16:51:13.029001+0000","last_undegraded":"2024-09-13T16:51:13.029001+0000","last_fullsized":"2024-09-13T16:51:13.029001+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:13.165993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66558,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":512,"num_read_kb":312,"num_write":164,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":60725,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":199674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383716,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":1064960,"data_stored":518981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.45500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.748,"5min":1.486,"15min":1.486},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.71699999999999997,"5min":0.749,"15min":0.749},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.752,"5min":0.755,"15min":0.755},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40400000000000003},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.503},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":1.363,"15min":1.363},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.72799999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51300000000000001,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.871,"15min":0.871},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83099999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.622,"15min":0.63500000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.69399999999999995,"15min":0.71099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82799999999999996,"5min":1.141,"15min":1.141},"last":0.63},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.89900000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.88}]},{"osd":8,"last update":"Fri Sep 13 16:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.71899999999999997}]},{"osd":9,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90700000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98399999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.89900000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.55100000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.87,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95299999999999996,"5min":0.995,"15min":0.995},"last":0.83799999999999997}]}]},{"osd":10,"up_from":72,"seq":309237645352,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1736704,"data_stored":1168297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.28899999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.54100000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41899999999999998,"15min":0.42299999999999999},"min":{"1min":0.318,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51200000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.626},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73599999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.74199999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63100000000000001,"15min":0.64500000000000002},"min":{"1min":0.42299999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.75700000000000001,"5min":1.196,"15min":1.196},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.499,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66600000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52800000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65000000000000002,"15min":0.66600000000000004},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.80400000000000005,"5min":0.88,"15min":0.88},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":1.115,"15min":1.115},"last":0.95499999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56100000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.50700000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.67000000000000004,"15min":0.68600000000000005},"min":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.82599999999999996}]},{"osd":9,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.48799999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85299999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71299999999999997,"15min":0.73399999999999999},"min":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74299999999999999}]},{"osd":11,"last update":"Fri Sep 13 16:50:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.76300000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.876},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.91800000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808878,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":1073152,"data_stored":523179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61599999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64500000000000002,"5min":1.177,"15min":1.177},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82299999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90900000000000003,"5min":1.621,"15min":1.621},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.54300000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81299999999999994,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82799999999999996,"5min":1.55,"15min":1.55},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.74199999999999999,"15min":0.78100000000000003},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92800000000000005,"5min":1.458,"15min":1.458},"last":0.621}]},{"osd":4,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89100000000000001,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.80300000000000005,"15min":0.84299999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95099999999999996,"5min":1.635,"15min":1.635},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.871,"15min":0.91700000000000004},"min":{"1min":0.53800000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93300000000000005,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.90500000000000003,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:48:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.081},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.2589999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.76200000000000001,"15min":0.78600000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86699999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.92100000000000004,"15min":0.98399999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91300000000000003,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.72999999999999998}]},{"osd":8,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.81499999999999995,"15min":0.84699999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.83299999999999996,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.97599999999999998,"15min":1.036},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98999999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.69599999999999995}]},{"osd":10,"last update":"Fri Sep 13 16:51:16 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.91100000000000003,"15min":0.96899999999999997},"min":{"1min":0.61499999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0169999999999999,"5min":1.294,"15min":1.294},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.92500000000000004,"15min":0.98399999999999999},"min":{"1min":0.54700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":0.95799999999999996,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.751}]},{"osd":11,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.74399999999999999}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":518538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.505},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.36499999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.52600000000000002,"15min":0.51500000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60799999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.29999999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":5.5099999999999998,"5min":5.5099999999999998,"15min":5.5099999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.749,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.49099999999999999,"15min":0.49199999999999999},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.36699999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.746},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.624,"15min":0.625},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.46100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.76800000000000002}]},{"osd":9,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69699999999999995,"15min":0.68300000000000005},"min":{"1min":0.53200000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.044,"5min":0.75900000000000001,"15min":0.70899999999999996},"min":{"1min":0.64500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":5.5339999999999998,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.81999999999999995}]},{"osd":10,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.626},"min":{"1min":0.59399999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94799999999999995,"5min":1.008,"15min":1.008},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.627,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.88200000000000001}]},{"osd":11,"last update":"Fri Sep 13 16:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85299999999999998}]}]},{"osd":7,"up_from":51,"seq":219043332151,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40936,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93704216,"statfs":{"total":95995035648,"available":95953117184,"internally_reserved":0,"allocated":1662976,"data_stored":1115491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38500000000000001,"15min":0.38600000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.57799999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.41599999999999998,"15min":0.41999999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71399999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.628}]},{"osd":4,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.312,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.438}]},{"osd":5,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69499999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.61799999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.77400000000000002,"5min":0.88,"15min":0.88},"last":0.754}]},{"osd":8,"last update":"Fri Sep 13 16:50:20 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.40899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.64600000000000002}]},{"osd":9,"last update":"Fri Sep 13 16:50:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84299999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.77000000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:51:15 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80900000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71499999999999997}]},{"osd":11,"last update":"Fri Sep 13 16:50:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82499999999999996}]}]},{"osd":6,"up_from":46,"seq":197568495676,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":514259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.41699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54000000000000004,"15min":0.55700000000000005},"min":{"1min":0.32400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.48599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.74199999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.73299999999999998,"15min":0.70899999999999996},"min":{"1min":0.49099999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72499999999999998,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.84699999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.56599999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.749,"15min":0.747},"min":{"1min":0.47599999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.65500000000000003,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.871}]},{"osd":7,"last update":"Fri Sep 13 16:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81399999999999995,"15min":0.80000000000000004},"min":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.78600000000000003,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.54100000000000004}]},{"osd":8,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.78400000000000003,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":1.022},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.83799999999999997,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.7999999999999998,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":0.85799999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.8719999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.871,"15min":0.877},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.72599999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:51:12 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.91400000000000003,"15min":0.91300000000000003},"min":{"1min":0.70699999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.7589999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.93200000000000005,"15min":0.92900000000000005},"min":{"1min":0.71999999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.81499999999999995}]},{"osd":11,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":1}]}]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28648,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716504,"statfs":{"total":95995035648,"available":95965700096,"internally_reserved":0,"allocated":1671168,"data_stored":1110594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57299999999999995,"15min":0.52400000000000002},"min":{"1min":0.34399999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":3.488,"15min":3.488},"last":0.441},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83399999999999996,"5min":1.579,"15min":1.579},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66100000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.54400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39300000000000002,"15min":0.375},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.68300000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83399999999999996,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.79200000000000004,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59899999999999998,"15min":0.55500000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83799999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.623},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76200000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:50:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.624,"15min":0.60999999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0580000000000001,"5min":1.881,"15min":1.881},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61199999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68200000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.62,"15min":0.59399999999999997},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80900000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.75600000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:51:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.502,"15min":0.49299999999999999},"min":{"1min":0.40200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70599999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73499999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61199999999999999}]},{"osd":9,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.70599999999999996},"min":{"1min":0.47199999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.78800000000000003,"5min":3.5350000000000001,"15min":3.5350000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89500000000000002,"5min":1.111,"15min":1.111},"last":0.78400000000000003}]},{"osd":10,"last update":"Fri Sep 13 16:51:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69299999999999995,"15min":0.69199999999999995},"min":{"1min":0.47099999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81599999999999995,"5min":1.006,"15min":1.006},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.70199999999999996},"min":{"1min":0.51700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.83399999999999996,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81399999999999995}]}]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1130496,"data_stored":581372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72499999999999998,"5min":0.879,"15min":0.879},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.37,"15min":0.34999999999999998},"min":{"1min":0.26700000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59699999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.437},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.52000000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.46500000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66800000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79200000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77900000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80300000000000005,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:51:12 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58699999999999997,"15min":0.55300000000000005},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.53800000000000003},"min":{"1min":0.48499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66700000000000004,"5min":1.004,"15min":1.004},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Sep 13 16:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.623,"15min":0.628},"min":{"1min":0.40999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.75}]},{"osd":7,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49099999999999999,"15min":0.497},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.505},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.751,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.69899999999999995}]},{"osd":8,"last update":"Fri Sep 13 16:51:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.60999999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84399999999999997,"5min":0.872,"15min":0.872},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.53600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71899999999999997}]},{"osd":9,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.504,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85099999999999998,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.71999999999999997},"min":{"1min":0.57899999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.84999999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.81599999999999995}]},{"osd":10,"last update":"Fri Sep 13 16:51:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78100000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88800000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83699999999999997}]},{"osd":11,"last update":"Fri Sep 13 16:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.84899999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":1056768,"data_stored":514122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.42999999999999999,"15min":0.38200000000000001},"min":{"1min":0.29999999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.48199999999999998,"15min":0.44},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.61899999999999999,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64200000000000002,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65100000000000002,"15min":0.59099999999999997},"min":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.625},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.69899999999999995,"15min":0.63500000000000001},"min":{"1min":0.56100000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.048,"5min":3.048,"15min":3.048},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:50:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.73099999999999998,"15min":0.65000000000000002},"min":{"1min":0.60599999999999998,"5min":0.371,"15min":0.371},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.66200000000000003,"15min":0.59599999999999997},"min":{"1min":0.47799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.58399999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.877,"15min":0.73299999999999998},"min":{"1min":0.55500000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":3.0169999999999999,"5min":8.7889999999999997,"15min":8.7889999999999997},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:50:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71299999999999997,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.089,"5min":3.089,"15min":3.089},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.61399999999999999,"15min":0.59399999999999997},"min":{"1min":0.48399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.82199999999999995,"15min":0.79000000000000004},"min":{"1min":0.67700000000000005,"5min":0.497,"15min":0.497},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.73199999999999998,"15min":0.72199999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.645,"5min":2.645,"15min":2.645},"last":0.53500000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93300000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0629999999999999,"5min":0.76700000000000002,"15min":0.71699999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":8.7639999999999993,"5min":8.7639999999999993,"15min":8.7639999999999993},"last":0.84399999999999997}]},{"osd":9,"last update":"Fri Sep 13 16:50:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.88900000000000001,"15min":0.875},"min":{"1min":0.66400000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.54700000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.89300000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.76500000000000001,"15min":0.745},"min":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.026,"5min":0.90300000000000002,"15min":0.88500000000000001},"min":{"1min":0.76600000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.67800000000000005}]},{"osd":11,"last update":"Fri Sep 13 16:50:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.82199999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":515731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53600000000000003,"15min":0.55500000000000005},"min":{"1min":0.42199999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.78600000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.55400000000000005},"min":{"1min":0.41599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77800000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:50:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56200000000000006,"15min":0.53000000000000003},"min":{"1min":0.40600000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81899999999999995,"5min":0.873,"15min":0.873},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.50800000000000001},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69799999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59099999999999997}]},{"osd":3,"last update":"Fri Sep 13 16:50:18 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.38400000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.433,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.44}]},{"osd":4,"last update":"Fri Sep 13 16:50:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.44,"15min":0.40300000000000002},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.70599999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.35299999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:50:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80700000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.52200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83599999999999997,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68899999999999995}]},{"osd":7,"last update":"Fri Sep 13 16:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.73199999999999998}]},{"osd":8,"last update":"Fri Sep 13 16:50:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.38100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77500000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.50800000000000001}]},{"osd":9,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.56899999999999995,"5min":0.502,"15min":0.502},"max":{"1min":0.89100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70399999999999996,"15min":0.69899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.88900000000000001,"5min":1.01,"15min":1.01},"last":0.65400000000000003}]},{"osd":10,"last update":"Fri Sep 13 16:50:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.47699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.751},{"interface":"front","average":{"1min":0.754,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.74299999999999999}]},{"osd":11,"last update":"Fri Sep 13 16:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.67700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":576147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54900000000000004,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.82899999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56000000000000005,"15min":0.51600000000000001},"min":{"1min":0.373,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.57399999999999995,"15min":0.89800000000000002},"min":{"1min":0.44900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":10.377000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.51900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79500000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Sep 13 16:50:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84599999999999997,"5min":1.081,"15min":1.081},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.92300000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99199999999999999,"5min":10.347,"15min":10.347},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.41499999999999998,"15min":0.379},"min":{"1min":0.29899999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.372},"min":{"1min":0.33400000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.57799999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57099999999999995,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84599999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57699999999999996,"15min":0.51400000000000001},"min":{"1min":0.45100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.754,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Sep 13 16:50:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59399999999999997,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.627},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.52800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89200000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.45900000000000002},"min":{"1min":0.36299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67900000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.495,"15min":0.439},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.71999999999999997}]},{"osd":8,"last update":"Fri Sep 13 16:50:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.63,"15min":0.60999999999999999},"min":{"1min":0.48299999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84699999999999998,"5min":0.879,"15min":0.879},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.64900000000000002,"15min":0.61499999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.88100000000000001}]},{"osd":9,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.53600000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.53700000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85899999999999999,"5min":1.115,"15min":1.115},"last":3.7069999999999999}]},{"osd":10,"last update":"Fri Sep 13 16:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85299999999999998,"5min":1.097,"15min":1.097},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41699999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73399999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.69799999999999995}]},{"osd":11,"last update":"Fri Sep 13 16:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.749}]}]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":515647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.60999999999999999,"15min":0.56000000000000005},"min":{"1min":0.42899999999999999,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.65100000000000002,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.34999999999999998,"15min":0.33800000000000002},"max":{"1min":1.236,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Sep 13 16:50:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67200000000000004,"15min":0.65700000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.194,"5min":1.194,"15min":2.0019999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.871},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Sep 13 16:50:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:50:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.60599999999999998},"min":{"1min":0.46999999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66400000000000003,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:51:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.65700000000000003,"15min":0.622},"min":{"1min":0.53200000000000003,"5min":0.438,"15min":0.438},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.70999999999999996,"15min":0.67400000000000004},"min":{"1min":0.51200000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:50:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66900000000000004,"15min":0.65100000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.64600000000000002,"15min":0.622},"min":{"1min":0.434,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:50:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.94599999999999995}]},{"osd":8,"last update":"Fri Sep 13 16:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.755,"15min":0.755},"min":{"1min":0.54200000000000004,"5min":0.505,"15min":0.505},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.82099999999999995,"15min":0.81499999999999995},"min":{"1min":0.61299999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.83399999999999996}]},{"osd":9,"last update":"Fri Sep 13 16:50:55 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.84299999999999997},"min":{"1min":0.47299999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.79300000000000004,"15min":0.79600000000000004},"min":{"1min":0.52000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.84999999999999998}]},{"osd":10,"last update":"Fri Sep 13 16:51:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.629,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85799999999999998,"15min":0.87},"min":{"1min":0.66100000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.91900000000000004}]},{"osd":11,"last update":"Fri Sep 13 16:50:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.85199999999999998,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.87,"5min":0.83599999999999997,"15min":0.82999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.89900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:51:23.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T16:51:23.791 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:24.160 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:23 smithi018 ceph-mon[30981]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:51:24.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:23 smithi094 ceph-mon[35259]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:51:24.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:23 smithi144 ceph-mon[35328]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-13T16:51:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.972+0000 7f8b60200640 1 -- 172.21.15.18:0/1572506071 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b58101860 msgr2=0x7f8b58109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.972+0000 7f8b60200640 1 --2- 172.21.15.18:0/1572506071 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b58101860 0x7f8b58109d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009860 tx=0x7f8b4402a3d0 comp rx=0 tx=0).stop 2024-09-13T16:51:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.973+0000 7f8b60200640 1 -- 172.21.15.18:0/1572506071 shutdown_connections 2024-09-13T16:51:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.973+0000 7f8b60200640 1 --2- 172.21.15.18:0/1572506071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5810a370 0x7f8b5810c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.973+0000 7f8b60200640 1 --2- 172.21.15.18:0/1572506071 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b58101860 0x7f8b58109d50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.973+0000 7f8b60200640 1 --2- 172.21.15.18:0/1572506071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b58100f40 0x7f8b58101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.973+0000 7f8b60200640 1 -- 172.21.15.18:0/1572506071 >> 172.21.15.18:0/1572506071 conn(0x7f8b580fa980 msgr2=0x7f8b580fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.973+0000 7f8b60200640 1 -- 172.21.15.18:0/1572506071 shutdown_connections 2024-09-13T16:51:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.973+0000 7f8b60200640 1 -- 172.21.15.18:0/1572506071 wait complete. 2024-09-13T16:51:25.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b60200640 1 Processor -- start 2024-09-13T16:51:25.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b60200640 1 -- start start 2024-09-13T16:51:25.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b60200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b58100f40 0x7f8b581984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:25.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b60200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b58101860 0x7f8b581989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:25.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b60200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5810a370 0x7f8b5819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:25.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b60200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5819d3e0 con 0x7f8b58101860 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b60200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5819d550 con 0x7f8b58100f40 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b60200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5819d6c0 con 0x7f8b5810a370 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b5ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b58101860 0x7f8b581989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b5ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b58101860 0x7f8b581989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45360/0 (socket says 172.21.15.18:45360) 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b5ce00640 1 -- 172.21.15.18:0/2284774435 learned_addr learned my addr 172.21.15.18:0/2284774435 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.974+0000 7f8b5d800640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b58100f40 0x7f8b581984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.975+0000 7f8b5e200640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5810a370 0x7f8b5819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.975+0000 7f8b5d800640 1 -- 172.21.15.18:0/2284774435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5810a370 msgr2=0x7f8b5819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.975+0000 7f8b5d800640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5810a370 0x7f8b5819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.975+0000 7f8b5d800640 1 -- 172.21.15.18:0/2284774435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b58101860 msgr2=0x7f8b581989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.975+0000 7f8b5d800640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b58101860 0x7f8b581989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.975+0000 7f8b5d800640 1 -- 172.21.15.18:0/2284774435 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c009560 con 0x7f8b58100f40 2024-09-13T16:51:25.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.975+0000 7f8b5ce00640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b58101860 0x7f8b581989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:25.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.975+0000 7f8b5d800640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b58100f40 0x7f8b581984a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c005fd0 tx=0x7f8b4c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:25.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.975+0000 7f8b56000640 1 -- 172.21.15.18:0/2284774435 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c00cd00 con 0x7f8b58100f40 2024-09-13T16:51:25.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.975+0000 7f8b56000640 1 -- 172.21.15.18:0/2284774435 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b4c0044e0 con 0x7f8b58100f40 2024-09-13T16:51:25.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.976+0000 7f8b56000640 1 -- 172.21.15.18:0/2284774435 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c010430 con 0x7f8b58100f40 2024-09-13T16:51:25.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.976+0000 7f8b60200640 1 -- 172.21.15.18:0/2284774435 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b44009490 con 0x7f8b58100f40 2024-09-13T16:51:25.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.976+0000 7f8b60200640 1 -- 172.21.15.18:0/2284774435 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b581a5090 con 0x7f8b58100f40 2024-09-13T16:51:25.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.977+0000 7f8b60200640 1 -- 172.21.15.18:0/2284774435 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b58069000 con 0x7f8b58100f40 2024-09-13T16:51:25.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.978+0000 7f8b56000640 1 -- 172.21.15.18:0/2284774435 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8b4c0035f0 con 0x7f8b58100f40 2024-09-13T16:51:25.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.980+0000 7f8b56000640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b400a1080 0x7f8b400a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:25.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.980+0000 7f8b56000640 1 -- 172.21.15.18:0/2284774435 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f8b4c014070 con 0x7f8b58100f40 2024-09-13T16:51:25.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.980+0000 7f8b5ce00640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b400a1080 0x7f8b400a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:25.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.980+0000 7f8b5ce00640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b400a1080 0x7f8b400a3540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8b58199a50 tx=0x7f8b440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:25.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:25.984+0000 7f8b56000640 1 -- 172.21.15.18:0/2284774435 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8b4c0963b0 con 0x7f8b58100f40 2024-09-13T16:51:26.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:25 smithi094 ceph-mon[35259]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 435 B/s wr, 7 op/s 2024-09-13T16:51:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.160+0000 7f8b60200640 1 -- 172.21.15.18:0/2284774435 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b5810fdd0 con 0x7f8b400a1080 2024-09-13T16:51:26.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:25 smithi018 ceph-mon[30981]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 435 B/s wr, 7 op/s 2024-09-13T16:51:26.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.172+0000 7f8b56000640 1 -- 172.21.15.18:0/2284774435 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427469 (secure 0 0 0) 0x7f8b5810fdd0 con 0x7f8b400a1080 2024-09-13T16:51:26.180 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:26.182 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T16:51:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 -- 172.21.15.18:0/2284774435 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b400a1080 msgr2=0x7f8b400a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b400a1080 0x7f8b400a3540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8b58199a50 tx=0x7f8b440058d0 comp rx=0 tx=0).stop 2024-09-13T16:51:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 -- 172.21.15.18:0/2284774435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b58100f40 msgr2=0x7f8b581984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b58100f40 0x7f8b581984a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c005fd0 tx=0x7f8b4c00ee50 comp rx=0 tx=0).stop 2024-09-13T16:51:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 -- 172.21.15.18:0/2284774435 shutdown_connections 2024-09-13T16:51:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b400a1080 0x7f8b400a3540 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b58101860 0x7f8b581989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5810a370 0x7f8b5819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 --2- 172.21.15.18:0/2284774435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b58100f40 0x7f8b581984a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 -- 172.21.15.18:0/2284774435 >> 172.21.15.18:0/2284774435 conn(0x7f8b580fa980 msgr2=0x7f8b580ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 -- 172.21.15.18:0/2284774435 shutdown_connections 2024-09-13T16:51:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:26.177+0000 7f8b60200640 1 -- 172.21.15.18:0/2284774435 wait complete. 2024-09-13T16:51:26.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:25 smithi144 ceph-mon[35328]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 435 B/s wr, 7 op/s 2024-09-13T16:51:27.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:26 smithi018 ceph-mon[30981]: from='client.25064 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:51:27.142 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-09-13T16:51:25.788936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657160,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":663,"num_read_kb":436,"num_write":347,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1241461,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":784,"ondisk_log_size":784,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383728,"kb_used_data":14404,"kb_used_omap":18,"kb_used_meta":369133,"kb_avail":1124558096,"statfs":{"total":1151940427776,"available":1151547490304,"internally_reserved":0,"allocated":14749696,"data_stored":8172358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":377992517},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.763557"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025802+0000","last_change":"2024-09-13T16:49:27.652760+0000","last_active":"2024-09-13T16:51:13.025802+0000","last_peered":"2024-09-13T16:51:13.025802+0000","last_clean":"2024-09-13T16:51:13.025802+0000","last_became_active":"2024-09-13T16:49:27.647493+0000","last_became_peered":"2024-09-13T16:49:27.647493+0000","last_unstale":"2024-09-13T16:51:13.025802+0000","last_undegraded":"2024-09-13T16:51:13.025802+0000","last_fullsized":"2024-09-13T16:51:13.025802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:54.438761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025261+0000","last_change":"2024-09-13T16:50:13.652198+0000","last_active":"2024-09-13T16:51:13.025261+0000","last_peered":"2024-09-13T16:51:13.025261+0000","last_clean":"2024-09-13T16:51:13.025261+0000","last_became_active":"2024-09-13T16:50:13.651473+0000","last_became_peered":"2024-09-13T16:50:13.651473+0000","last_unstale":"2024-09-13T16:51:13.025261+0000","last_undegraded":"2024-09-13T16:51:13.025261+0000","last_fullsized":"2024-09-13T16:51:13.025261+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:06.880882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029299+0000","last_change":"2024-09-13T16:49:32.127597+0000","last_active":"2024-09-13T16:51:13.029299+0000","last_peered":"2024-09-13T16:51:13.029299+0000","last_clean":"2024-09-13T16:51:13.029299+0000","last_became_active":"2024-09-13T16:49:32.127122+0000","last_became_peered":"2024-09-13T16:49:32.127122+0000","last_unstale":"2024-09-13T16:51:13.029299+0000","last_undegraded":"2024-09-13T16:51:13.029299+0000","last_fullsized":"2024-09-13T16:51:13.029299+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:16.362727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.033368+0000","last_change":"2024-09-13T16:49:27.668009+0000","last_active":"2024-09-13T16:51:13.033368+0000","last_peered":"2024-09-13T16:51:13.033368+0000","last_clean":"2024-09-13T16:51:13.033368+0000","last_became_active":"2024-09-13T16:49:27.667713+0000","last_became_peered":"2024-09-13T16:49:27.667713+0000","last_unstale":"2024-09-13T16:51:13.033368+0000","last_undegraded":"2024-09-13T16:51:13.033368+0000","last_fullsized":"2024-09-13T16:51:13.033368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:51.427966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029643+0000","last_change":"2024-09-13T16:49:28.107799+0000","last_active":"2024-09-13T16:51:13.029643+0000","last_peered":"2024-09-13T16:51:13.029643+0000","last_clean":"2024-09-13T16:51:13.029643+0000","last_became_active":"2024-09-13T16:49:28.107432+0000","last_became_peered":"2024-09-13T16:49:28.107432+0000","last_unstale":"2024-09-13T16:51:13.029643+0000","last_undegraded":"2024-09-13T16:51:13.029643+0000","last_fullsized":"2024-09-13T16:51:13.029643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:31.554614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029005+0000","last_change":"2024-09-13T16:49:32.132328+0000","last_active":"2024-09-13T16:51:13.029005+0000","last_peered":"2024-09-13T16:51:13.029005+0000","last_clean":"2024-09-13T16:51:13.029005+0000","last_became_active":"2024-09-13T16:49:32.131831+0000","last_became_peered":"2024-09-13T16:49:32.131831+0000","last_unstale":"2024-09-13T16:51:13.029005+0000","last_undegraded":"2024-09-13T16:51:13.029005+0000","last_fullsized":"2024-09-13T16:51:13.029005+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:35.409572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026770+0000","last_change":"2024-09-13T16:49:27.651527+0000","last_active":"2024-09-13T16:51:13.026770+0000","last_peered":"2024-09-13T16:51:13.026770+0000","last_clean":"2024-09-13T16:51:13.026770+0000","last_became_active":"2024-09-13T16:49:27.650985+0000","last_became_peered":"2024-09-13T16:49:27.650985+0000","last_unstale":"2024-09-13T16:51:13.026770+0000","last_undegraded":"2024-09-13T16:51:13.026770+0000","last_fullsized":"2024-09-13T16:51:13.026770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:31.473563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031739+0000","last_change":"2024-09-13T16:49:28.101714+0000","last_active":"2024-09-13T16:51:13.031739+0000","last_peered":"2024-09-13T16:51:13.031739+0000","last_clean":"2024-09-13T16:51:13.031739+0000","last_became_active":"2024-09-13T16:49:28.101409+0000","last_became_peered":"2024-09-13T16:49:28.101409+0000","last_unstale":"2024-09-13T16:51:13.031739+0000","last_undegraded":"2024-09-13T16:51:13.031739+0000","last_fullsized":"2024-09-13T16:51:13.031739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:05.786731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028516+0000","last_change":"2024-09-13T16:49:32.133096+0000","last_active":"2024-09-13T16:51:13.028516+0000","last_peered":"2024-09-13T16:51:13.028516+0000","last_clean":"2024-09-13T16:51:13.028516+0000","last_became_active":"2024-09-13T16:49:32.132704+0000","last_became_peered":"2024-09-13T16:49:32.132704+0000","last_unstale":"2024-09-13T16:51:13.028516+0000","last_undegraded":"2024-09-13T16:51:13.028516+0000","last_fullsized":"2024-09-13T16:51:13.028516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:18.490892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026716+0000","last_change":"2024-09-13T16:49:27.650532+0000","last_active":"2024-09-13T16:51:13.026716+0000","last_peered":"2024-09-13T16:51:13.026716+0000","last_clean":"2024-09-13T16:51:13.026716+0000","last_became_active":"2024-09-13T16:49:27.650095+0000","last_became_peered":"2024-09-13T16:49:27.650095+0000","last_unstale":"2024-09-13T16:51:13.026716+0000","last_undegraded":"2024-09-13T16:51:13.026716+0000","last_fullsized":"2024-09-13T16:51:13.026716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:58.066902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030769+0000","last_change":"2024-09-13T16:49:28.104676+0000","last_active":"2024-09-13T16:51:13.030769+0000","last_peered":"2024-09-13T16:51:13.030769+0000","last_clean":"2024-09-13T16:51:13.030769+0000","last_became_active":"2024-09-13T16:49:28.104376+0000","last_became_peered":"2024-09-13T16:49:28.104376+0000","last_unstale":"2024-09-13T16:51:13.030769+0000","last_undegraded":"2024-09-13T16:51:13.030769+0000","last_fullsized":"2024-09-13T16:51:13.030769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:29.038008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028174+0000","last_change":"2024-09-13T16:49:32.127590+0000","last_active":"2024-09-13T16:51:13.028174+0000","last_peered":"2024-09-13T16:51:13.028174+0000","last_clean":"2024-09-13T16:51:13.028174+0000","last_became_active":"2024-09-13T16:49:32.127362+0000","last_became_peered":"2024-09-13T16:49:32.127362+0000","last_unstale":"2024-09-13T16:51:13.028174+0000","last_undegraded":"2024-09-13T16:51:13.028174+0000","last_fullsized":"2024-09-13T16:51:13.028174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:37.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131113+0000","last_change":"2024-09-13T16:49:28.104850+0000","last_active":"2024-09-13T16:51:13.131113+0000","last_peered":"2024-09-13T16:51:13.131113+0000","last_clean":"2024-09-13T16:51:13.131113+0000","last_became_active":"2024-09-13T16:49:28.104569+0000","last_became_peered":"2024-09-13T16:49:28.104569+0000","last_unstale":"2024-09-13T16:51:13.131113+0000","last_undegraded":"2024-09-13T16:51:13.131113+0000","last_fullsized":"2024-09-13T16:51:13.131113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:26.949030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026236+0000","last_change":"2024-09-13T16:49:27.649046+0000","last_active":"2024-09-13T16:51:13.026236+0000","last_peered":"2024-09-13T16:51:13.026236+0000","last_clean":"2024-09-13T16:51:13.026236+0000","last_became_active":"2024-09-13T16:49:27.648633+0000","last_became_peered":"2024-09-13T16:49:27.648633+0000","last_unstale":"2024-09-13T16:51:13.026236+0000","last_undegraded":"2024-09-13T16:51:13.026236+0000","last_fullsized":"2024-09-13T16:51:13.026236+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:07.191181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028329+0000","last_change":"2024-09-13T16:49:32.123910+0000","last_active":"2024-09-13T16:51:13.028329+0000","last_peered":"2024-09-13T16:51:13.028329+0000","last_clean":"2024-09-13T16:51:13.028329+0000","last_became_active":"2024-09-13T16:49:32.123515+0000","last_became_peered":"2024-09-13T16:49:32.123515+0000","last_unstale":"2024-09-13T16:51:13.028329+0000","last_undegraded":"2024-09-13T16:51:13.028329+0000","last_fullsized":"2024-09-13T16:51:13.028329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:13.667573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032418+0000","last_change":"2024-09-13T16:49:28.112299+0000","last_active":"2024-09-13T16:51:13.032418+0000","last_peered":"2024-09-13T16:51:13.032418+0000","last_clean":"2024-09-13T16:51:13.032418+0000","last_became_active":"2024-09-13T16:49:28.111945+0000","last_became_peered":"2024-09-13T16:49:28.111945+0000","last_unstale":"2024-09-13T16:51:13.032418+0000","last_undegraded":"2024-09-13T16:51:13.032418+0000","last_fullsized":"2024-09-13T16:51:13.032418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:42.813731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029103+0000","last_change":"2024-09-13T16:49:27.654517+0000","last_active":"2024-09-13T16:51:13.029103+0000","last_peered":"2024-09-13T16:51:13.029103+0000","last_clean":"2024-09-13T16:51:13.029103+0000","last_became_active":"2024-09-13T16:49:27.654207+0000","last_became_peered":"2024-09-13T16:49:27.654207+0000","last_unstale":"2024-09-13T16:51:13.029103+0000","last_undegraded":"2024-09-13T16:51:13.029103+0000","last_fullsized":"2024-09-13T16:51:13.029103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:14.562289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028939+0000","last_change":"2024-09-13T16:49:32.121834+0000","last_active":"2024-09-13T16:51:13.028939+0000","last_peered":"2024-09-13T16:51:13.028939+0000","last_clean":"2024-09-13T16:51:13.028939+0000","last_became_active":"2024-09-13T16:49:32.121409+0000","last_became_peered":"2024-09-13T16:49:32.121409+0000","last_unstale":"2024-09-13T16:51:13.028939+0000","last_undegraded":"2024-09-13T16:51:13.028939+0000","last_fullsized":"2024-09-13T16:51:13.028939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:36.112143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028782+0000","last_change":"2024-09-13T16:49:28.115111+0000","last_active":"2024-09-13T16:51:13.028782+0000","last_peered":"2024-09-13T16:51:13.028782+0000","last_clean":"2024-09-13T16:51:13.028782+0000","last_became_active":"2024-09-13T16:49:28.114491+0000","last_became_peered":"2024-09-13T16:49:28.114491+0000","last_unstale":"2024-09-13T16:51:13.028782+0000","last_undegraded":"2024-09-13T16:51:13.028782+0000","last_fullsized":"2024-09-13T16:51:13.028782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:59.639110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032734+0000","last_change":"2024-09-13T16:49:27.661045+0000","last_active":"2024-09-13T16:51:13.032734+0000","last_peered":"2024-09-13T16:51:13.032734+0000","last_clean":"2024-09-13T16:51:13.032734+0000","last_became_active":"2024-09-13T16:49:27.660728+0000","last_became_peered":"2024-09-13T16:49:27.660728+0000","last_unstale":"2024-09-13T16:51:13.032734+0000","last_undegraded":"2024-09-13T16:51:13.032734+0000","last_fullsized":"2024-09-13T16:51:13.032734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:37.292582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025452+0000","last_change":"2024-09-13T16:49:32.122407+0000","last_active":"2024-09-13T16:51:13.025452+0000","last_peered":"2024-09-13T16:51:13.025452+0000","last_clean":"2024-09-13T16:51:13.025452+0000","last_became_active":"2024-09-13T16:49:32.121540+0000","last_became_peered":"2024-09-13T16:49:32.121540+0000","last_unstale":"2024-09-13T16:51:13.025452+0000","last_undegraded":"2024-09-13T16:51:13.025452+0000","last_fullsized":"2024-09-13T16:51:13.025452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.577117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026030+0000","last_change":"2024-09-13T16:49:28.107534+0000","last_active":"2024-09-13T16:51:13.026030+0000","last_peered":"2024-09-13T16:51:13.026030+0000","last_clean":"2024-09-13T16:51:13.026030+0000","last_became_active":"2024-09-13T16:49:28.107167+0000","last_became_peered":"2024-09-13T16:49:28.107167+0000","last_unstale":"2024-09-13T16:51:13.026030+0000","last_undegraded":"2024-09-13T16:51:13.026030+0000","last_fullsized":"2024-09-13T16:51:13.026030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:50.515291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030918+0000","last_change":"2024-09-13T16:49:27.663125+0000","last_active":"2024-09-13T16:51:13.030918+0000","last_peered":"2024-09-13T16:51:13.030918+0000","last_clean":"2024-09-13T16:51:13.030918+0000","last_became_active":"2024-09-13T16:49:27.662822+0000","last_became_peered":"2024-09-13T16:49:27.662822+0000","last_unstale":"2024-09-13T16:51:13.030918+0000","last_undegraded":"2024-09-13T16:51:13.030918+0000","last_fullsized":"2024-09-13T16:51:13.030918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:42.841929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028447+0000","last_change":"2024-09-13T16:49:32.121929+0000","last_active":"2024-09-13T16:51:13.028447+0000","last_peered":"2024-09-13T16:51:13.028447+0000","last_clean":"2024-09-13T16:51:13.028447+0000","last_became_active":"2024-09-13T16:49:32.121485+0000","last_became_peered":"2024-09-13T16:49:32.121485+0000","last_unstale":"2024-09-13T16:51:13.028447+0000","last_undegraded":"2024-09-13T16:51:13.028447+0000","last_fullsized":"2024-09-13T16:51:13.028447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:34.224064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029890+0000","last_change":"2024-09-13T16:49:28.119746+0000","last_active":"2024-09-13T16:51:13.029890+0000","last_peered":"2024-09-13T16:51:13.029890+0000","last_clean":"2024-09-13T16:51:13.029890+0000","last_became_active":"2024-09-13T16:49:28.119463+0000","last_became_peered":"2024-09-13T16:49:28.119463+0000","last_unstale":"2024-09-13T16:51:13.029890+0000","last_undegraded":"2024-09-13T16:51:13.029890+0000","last_fullsized":"2024-09-13T16:51:13.029890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:17.092417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028716+0000","last_change":"2024-09-13T16:49:27.651799+0000","last_active":"2024-09-13T16:51:13.028716+0000","last_peered":"2024-09-13T16:51:13.028716+0000","last_clean":"2024-09-13T16:51:13.028716+0000","last_became_active":"2024-09-13T16:49:27.651487+0000","last_became_peered":"2024-09-13T16:49:27.651487+0000","last_unstale":"2024-09-13T16:51:13.028716+0000","last_undegraded":"2024-09-13T16:51:13.028716+0000","last_fullsized":"2024-09-13T16:51:13.028716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:45.307448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029477+0000","last_change":"2024-09-13T16:49:32.119333+0000","last_active":"2024-09-13T16:51:13.029477+0000","last_peered":"2024-09-13T16:51:13.029477+0000","last_clean":"2024-09-13T16:51:13.029477+0000","last_became_active":"2024-09-13T16:49:32.118997+0000","last_became_peered":"2024-09-13T16:49:32.118997+0000","last_unstale":"2024-09-13T16:51:13.029477+0000","last_undegraded":"2024-09-13T16:51:13.029477+0000","last_fullsized":"2024-09-13T16:51:13.029477+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:15.731556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.033094+0000","last_change":"2024-09-13T16:49:28.114937+0000","last_active":"2024-09-13T16:51:13.033094+0000","last_peered":"2024-09-13T16:51:13.033094+0000","last_clean":"2024-09-13T16:51:13.033094+0000","last_became_active":"2024-09-13T16:49:28.112566+0000","last_became_peered":"2024-09-13T16:49:28.112566+0000","last_unstale":"2024-09-13T16:51:13.033094+0000","last_undegraded":"2024-09-13T16:51:13.033094+0000","last_fullsized":"2024-09-13T16:51:13.033094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:25.123922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'6","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.077457+0000","last_change":"2024-09-13T16:49:27.658786+0000","last_active":"2024-09-13T16:51:13.077457+0000","last_peered":"2024-09-13T16:51:13.077457+0000","last_clean":"2024-09-13T16:51:13.077457+0000","last_became_active":"2024-09-13T16:49:27.658308+0000","last_became_peered":"2024-09-13T16:49:27.658308+0000","last_unstale":"2024-09-13T16:51:13.077457+0000","last_undegraded":"2024-09-13T16:51:13.077457+0000","last_fullsized":"2024-09-13T16:51:13.077457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:29.994600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032933+0000","last_change":"2024-09-13T16:49:32.130983+0000","last_active":"2024-09-13T16:51:13.032933+0000","last_peered":"2024-09-13T16:51:13.032933+0000","last_clean":"2024-09-13T16:51:13.032933+0000","last_became_active":"2024-09-13T16:49:32.130478+0000","last_became_peered":"2024-09-13T16:49:32.130478+0000","last_unstale":"2024-09-13T16:51:13.032933+0000","last_undegraded":"2024-09-13T16:51:13.032933+0000","last_fullsized":"2024-09-13T16:51:13.032933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:07.147495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029394+0000","last_change":"2024-09-13T16:49:28.100340+0000","last_active":"2024-09-13T16:51:13.029394+0000","last_peered":"2024-09-13T16:51:13.029394+0000","last_clean":"2024-09-13T16:51:13.029394+0000","last_became_active":"2024-09-13T16:49:28.099993+0000","last_became_peered":"2024-09-13T16:49:28.099993+0000","last_unstale":"2024-09-13T16:51:13.029394+0000","last_undegraded":"2024-09-13T16:51:13.029394+0000","last_fullsized":"2024-09-13T16:51:13.029394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:55.066929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026857+0000","last_change":"2024-09-13T16:49:27.665296+0000","last_active":"2024-09-13T16:51:13.026857+0000","last_peered":"2024-09-13T16:51:13.026857+0000","last_clean":"2024-09-13T16:51:13.026857+0000","last_became_active":"2024-09-13T16:49:27.664953+0000","last_became_peered":"2024-09-13T16:49:27.664953+0000","last_unstale":"2024-09-13T16:51:13.026857+0000","last_undegraded":"2024-09-13T16:51:13.026857+0000","last_fullsized":"2024-09-13T16:51:13.026857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:52.001210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028241+0000","last_change":"2024-09-13T16:49:32.129502+0000","last_active":"2024-09-13T16:51:13.028241+0000","last_peered":"2024-09-13T16:51:13.028241+0000","last_clean":"2024-09-13T16:51:13.028241+0000","last_became_active":"2024-09-13T16:49:32.128588+0000","last_became_peered":"2024-09-13T16:49:32.128588+0000","last_unstale":"2024-09-13T16:51:13.028241+0000","last_undegraded":"2024-09-13T16:51:13.028241+0000","last_fullsized":"2024-09-13T16:51:13.028241+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:12.836040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026410+0000","last_change":"2024-09-13T16:49:28.107066+0000","last_active":"2024-09-13T16:51:13.026410+0000","last_peered":"2024-09-13T16:51:13.026410+0000","last_clean":"2024-09-13T16:51:13.026410+0000","last_became_active":"2024-09-13T16:49:28.106774+0000","last_became_peered":"2024-09-13T16:49:28.106774+0000","last_unstale":"2024-09-13T16:51:13.026410+0000","last_undegraded":"2024-09-13T16:51:13.026410+0000","last_fullsized":"2024-09-13T16:51:13.026410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:02.159079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025849+0000","last_change":"2024-09-13T16:49:27.664742+0000","last_active":"2024-09-13T16:51:13.025849+0000","last_peered":"2024-09-13T16:51:13.025849+0000","last_clean":"2024-09-13T16:51:13.025849+0000","last_became_active":"2024-09-13T16:49:27.664206+0000","last_became_peered":"2024-09-13T16:49:27.664206+0000","last_unstale":"2024-09-13T16:51:13.025849+0000","last_undegraded":"2024-09-13T16:51:13.025849+0000","last_fullsized":"2024-09-13T16:51:13.025849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:29.255592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026035+0000","last_change":"2024-09-13T16:49:32.123418+0000","last_active":"2024-09-13T16:51:13.026035+0000","last_peered":"2024-09-13T16:51:13.026035+0000","last_clean":"2024-09-13T16:51:13.026035+0000","last_became_active":"2024-09-13T16:49:32.123001+0000","last_became_peered":"2024-09-13T16:49:32.123001+0000","last_unstale":"2024-09-13T16:51:13.026035+0000","last_undegraded":"2024-09-13T16:51:13.026035+0000","last_fullsized":"2024-09-13T16:51:13.026035+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:03.057538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026418+0000","last_change":"2024-09-13T16:49:28.102859+0000","last_active":"2024-09-13T16:51:13.026418+0000","last_peered":"2024-09-13T16:51:13.026418+0000","last_clean":"2024-09-13T16:51:13.026418+0000","last_became_active":"2024-09-13T16:49:28.102581+0000","last_became_peered":"2024-09-13T16:49:28.102581+0000","last_unstale":"2024-09-13T16:51:13.026418+0000","last_undegraded":"2024-09-13T16:51:13.026418+0000","last_fullsized":"2024-09-13T16:51:13.026418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:25.716170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131116+0000","last_change":"2024-09-13T16:49:27.660427+0000","last_active":"2024-09-13T16:51:13.131116+0000","last_peered":"2024-09-13T16:51:13.131116+0000","last_clean":"2024-09-13T16:51:13.131116+0000","last_became_active":"2024-09-13T16:49:27.660124+0000","last_became_peered":"2024-09-13T16:49:27.660124+0000","last_unstale":"2024-09-13T16:51:13.131116+0000","last_undegraded":"2024-09-13T16:51:13.131116+0000","last_fullsized":"2024-09-13T16:51:13.131116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:13.437432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029163+0000","last_change":"2024-09-13T16:49:32.134481+0000","last_active":"2024-09-13T16:51:13.029163+0000","last_peered":"2024-09-13T16:51:13.029163+0000","last_clean":"2024-09-13T16:51:13.029163+0000","last_became_active":"2024-09-13T16:49:32.132117+0000","last_became_peered":"2024-09-13T16:49:32.132117+0000","last_unstale":"2024-09-13T16:51:13.029163+0000","last_undegraded":"2024-09-13T16:51:13.029163+0000","last_fullsized":"2024-09-13T16:51:13.029163+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:06.386078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030223+0000","last_change":"2024-09-13T16:49:28.102780+0000","last_active":"2024-09-13T16:51:13.030223+0000","last_peered":"2024-09-13T16:51:13.030223+0000","last_clean":"2024-09-13T16:51:13.030223+0000","last_became_active":"2024-09-13T16:49:28.102484+0000","last_became_peered":"2024-09-13T16:49:28.102484+0000","last_unstale":"2024-09-13T16:51:13.030223+0000","last_undegraded":"2024-09-13T16:51:13.030223+0000","last_fullsized":"2024-09-13T16:51:13.030223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:56.922183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":110,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:20.937890+0000","last_change":"2024-09-13T16:49:27.669744+0000","last_active":"2024-09-13T16:51:20.937890+0000","last_peered":"2024-09-13T16:51:20.937890+0000","last_clean":"2024-09-13T16:51:20.937890+0000","last_became_active":"2024-09-13T16:49:27.667816+0000","last_became_peered":"2024-09-13T16:49:27.667816+0000","last_unstale":"2024-09-13T16:51:20.937890+0000","last_undegraded":"2024-09-13T16:51:20.937890+0000","last_fullsized":"2024-09-13T16:51:20.937890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:36.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030039+0000","last_change":"2024-09-13T16:49:32.137114+0000","last_active":"2024-09-13T16:51:13.030039+0000","last_peered":"2024-09-13T16:51:13.030039+0000","last_clean":"2024-09-13T16:51:13.030039+0000","last_became_active":"2024-09-13T16:49:32.136077+0000","last_became_peered":"2024-09-13T16:49:32.136077+0000","last_unstale":"2024-09-13T16:51:13.030039+0000","last_undegraded":"2024-09-13T16:51:13.030039+0000","last_fullsized":"2024-09-13T16:51:13.030039+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:59.902852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028132+0000","last_change":"2024-09-13T16:50:13.652058+0000","last_active":"2024-09-13T16:51:13.028132+0000","last_peered":"2024-09-13T16:51:13.028132+0000","last_clean":"2024-09-13T16:51:13.028132+0000","last_became_active":"2024-09-13T16:50:13.651515+0000","last_became_peered":"2024-09-13T16:50:13.651515+0000","last_unstale":"2024-09-13T16:51:13.028132+0000","last_undegraded":"2024-09-13T16:51:13.028132+0000","last_fullsized":"2024-09-13T16:51:13.028132+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:58.582671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131033+0000","last_change":"2024-09-13T16:49:27.648000+0000","last_active":"2024-09-13T16:51:13.131033+0000","last_peered":"2024-09-13T16:51:13.131033+0000","last_clean":"2024-09-13T16:51:13.131033+0000","last_became_active":"2024-09-13T16:49:27.647639+0000","last_became_peered":"2024-09-13T16:49:27.647639+0000","last_unstale":"2024-09-13T16:51:13.131033+0000","last_undegraded":"2024-09-13T16:51:13.131033+0000","last_fullsized":"2024-09-13T16:51:13.131033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:28.941060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030194+0000","last_change":"2024-09-13T16:49:32.132868+0000","last_active":"2024-09-13T16:51:13.030194+0000","last_peered":"2024-09-13T16:51:13.030194+0000","last_clean":"2024-09-13T16:51:13.030194+0000","last_became_active":"2024-09-13T16:49:32.132562+0000","last_became_peered":"2024-09-13T16:49:32.132562+0000","last_unstale":"2024-09-13T16:51:13.030194+0000","last_undegraded":"2024-09-13T16:51:13.030194+0000","last_fullsized":"2024-09-13T16:51:13.030194+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:31.365339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.033405+0000","last_change":"2024-09-13T16:49:28.107483+0000","last_active":"2024-09-13T16:51:13.033405+0000","last_peered":"2024-09-13T16:51:13.033405+0000","last_clean":"2024-09-13T16:51:13.033405+0000","last_became_active":"2024-09-13T16:49:28.107111+0000","last_became_peered":"2024-09-13T16:49:28.107111+0000","last_unstale":"2024-09-13T16:51:13.033405+0000","last_undegraded":"2024-09-13T16:51:13.033405+0000","last_fullsized":"2024-09-13T16:51:13.033405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:56.987970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029264+0000","last_change":"2024-09-13T16:49:27.646872+0000","last_active":"2024-09-13T16:51:13.029264+0000","last_peered":"2024-09-13T16:51:13.029264+0000","last_clean":"2024-09-13T16:51:13.029264+0000","last_became_active":"2024-09-13T16:49:27.646523+0000","last_became_peered":"2024-09-13T16:49:27.646523+0000","last_unstale":"2024-09-13T16:51:13.029264+0000","last_undegraded":"2024-09-13T16:51:13.029264+0000","last_fullsized":"2024-09-13T16:51:13.029264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.384393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":336,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131141+0000","last_change":"2024-09-13T16:48:12.777004+0000","last_active":"2024-09-13T16:51:13.131141+0000","last_peered":"2024-09-13T16:51:13.131141+0000","last_clean":"2024-09-13T16:51:13.131141+0000","last_became_active":"2024-09-13T16:48:12.776499+0000","last_became_peered":"2024-09-13T16:48:12.776499+0000","last_unstale":"2024-09-13T16:51:13.131141+0000","last_undegraded":"2024-09-13T16:51:13.131141+0000","last_fullsized":"2024-09-13T16:51:13.131141+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:44:44.393091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:44:44.393091+0000","last_clean_scrub_stamp":"2024-09-13T16:44:44.393091+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:38.427421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131223+0000","last_change":"2024-09-13T16:49:32.119501+0000","last_active":"2024-09-13T16:51:13.131223+0000","last_peered":"2024-09-13T16:51:13.131223+0000","last_clean":"2024-09-13T16:51:13.131223+0000","last_became_active":"2024-09-13T16:49:32.118856+0000","last_became_peered":"2024-09-13T16:49:32.118856+0000","last_unstale":"2024-09-13T16:51:13.131223+0000","last_undegraded":"2024-09-13T16:51:13.131223+0000","last_fullsized":"2024-09-13T16:51:13.131223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:13.078311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131362+0000","last_change":"2024-09-13T16:49:28.106290+0000","last_active":"2024-09-13T16:51:13.131362+0000","last_peered":"2024-09-13T16:51:13.131362+0000","last_clean":"2024-09-13T16:51:13.131362+0000","last_became_active":"2024-09-13T16:49:28.105608+0000","last_became_peered":"2024-09-13T16:49:28.105608+0000","last_unstale":"2024-09-13T16:51:13.131362+0000","last_undegraded":"2024-09-13T16:51:13.131362+0000","last_fullsized":"2024-09-13T16:51:13.131362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:57.711931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030201+0000","last_change":"2024-09-13T16:49:27.667242+0000","last_active":"2024-09-13T16:51:13.030201+0000","last_peered":"2024-09-13T16:51:13.030201+0000","last_clean":"2024-09-13T16:51:13.030201+0000","last_became_active":"2024-09-13T16:49:27.666939+0000","last_became_peered":"2024-09-13T16:49:27.666939+0000","last_unstale":"2024-09-13T16:51:13.030201+0000","last_undegraded":"2024-09-13T16:51:13.030201+0000","last_fullsized":"2024-09-13T16:51:13.030201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:10.558691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031135+0000","last_change":"2024-09-13T16:49:32.128832+0000","last_active":"2024-09-13T16:51:13.031135+0000","last_peered":"2024-09-13T16:51:13.031135+0000","last_clean":"2024-09-13T16:51:13.031135+0000","last_became_active":"2024-09-13T16:49:32.128369+0000","last_became_peered":"2024-09-13T16:49:32.128369+0000","last_unstale":"2024-09-13T16:51:13.031135+0000","last_undegraded":"2024-09-13T16:51:13.031135+0000","last_fullsized":"2024-09-13T16:51:13.031135+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:26.756858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131224+0000","last_change":"2024-09-13T16:49:28.115686+0000","last_active":"2024-09-13T16:51:13.131224+0000","last_peered":"2024-09-13T16:51:13.131224+0000","last_clean":"2024-09-13T16:51:13.131224+0000","last_became_active":"2024-09-13T16:49:28.115439+0000","last_became_peered":"2024-09-13T16:49:28.115439+0000","last_unstale":"2024-09-13T16:51:13.131224+0000","last_undegraded":"2024-09-13T16:51:13.131224+0000","last_fullsized":"2024-09-13T16:51:13.131224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:03.134657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031070+0000","last_change":"2024-09-13T16:49:27.653794+0000","last_active":"2024-09-13T16:51:13.031070+0000","last_peered":"2024-09-13T16:51:13.031070+0000","last_clean":"2024-09-13T16:51:13.031070+0000","last_became_active":"2024-09-13T16:49:27.653483+0000","last_became_peered":"2024-09-13T16:49:27.653483+0000","last_unstale":"2024-09-13T16:51:13.031070+0000","last_undegraded":"2024-09-13T16:51:13.031070+0000","last_fullsized":"2024-09-13T16:51:13.031070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:49.488599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029204+0000","last_change":"2024-09-13T16:49:32.124277+0000","last_active":"2024-09-13T16:51:13.029204+0000","last_peered":"2024-09-13T16:51:13.029204+0000","last_clean":"2024-09-13T16:51:13.029204+0000","last_became_active":"2024-09-13T16:49:32.123858+0000","last_became_peered":"2024-09-13T16:49:32.123858+0000","last_unstale":"2024-09-13T16:51:13.029204+0000","last_undegraded":"2024-09-13T16:51:13.029204+0000","last_fullsized":"2024-09-13T16:51:13.029204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:40.965149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131310+0000","last_change":"2024-09-13T16:49:28.107349+0000","last_active":"2024-09-13T16:51:13.131310+0000","last_peered":"2024-09-13T16:51:13.131310+0000","last_clean":"2024-09-13T16:51:13.131310+0000","last_became_active":"2024-09-13T16:49:28.107048+0000","last_became_peered":"2024-09-13T16:49:28.107048+0000","last_unstale":"2024-09-13T16:51:13.131310+0000","last_undegraded":"2024-09-13T16:51:13.131310+0000","last_fullsized":"2024-09-13T16:51:13.131310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:00.188460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030239+0000","last_change":"2024-09-13T16:49:27.662761+0000","last_active":"2024-09-13T16:51:13.030239+0000","last_peered":"2024-09-13T16:51:13.030239+0000","last_clean":"2024-09-13T16:51:13.030239+0000","last_became_active":"2024-09-13T16:49:27.662452+0000","last_became_peered":"2024-09-13T16:49:27.662452+0000","last_unstale":"2024-09-13T16:51:13.030239+0000","last_undegraded":"2024-09-13T16:51:13.030239+0000","last_fullsized":"2024-09-13T16:51:13.030239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:51:10.175720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029852+0000","last_change":"2024-09-13T16:49:32.118043+0000","last_active":"2024-09-13T16:51:13.029852+0000","last_peered":"2024-09-13T16:51:13.029852+0000","last_clean":"2024-09-13T16:51:13.029852+0000","last_became_active":"2024-09-13T16:49:32.117423+0000","last_became_peered":"2024-09-13T16:49:32.117423+0000","last_unstale":"2024-09-13T16:51:13.029852+0000","last_undegraded":"2024-09-13T16:51:13.029852+0000","last_fullsized":"2024-09-13T16:51:13.029852+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:13.791606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028583+0000","last_change":"2024-09-13T16:49:28.104554+0000","last_active":"2024-09-13T16:51:13.028583+0000","last_peered":"2024-09-13T16:51:13.028583+0000","last_clean":"2024-09-13T16:51:13.028583+0000","last_became_active":"2024-09-13T16:49:28.104158+0000","last_became_peered":"2024-09-13T16:49:28.104158+0000","last_unstale":"2024-09-13T16:51:13.028583+0000","last_undegraded":"2024-09-13T16:51:13.028583+0000","last_fullsized":"2024-09-13T16:51:13.028583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:08.723966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028885+0000","last_change":"2024-09-13T16:50:13.657308+0000","last_active":"2024-09-13T16:51:13.028885+0000","last_peered":"2024-09-13T16:51:13.028885+0000","last_clean":"2024-09-13T16:51:13.028885+0000","last_became_active":"2024-09-13T16:50:13.648491+0000","last_became_peered":"2024-09-13T16:50:13.648491+0000","last_unstale":"2024-09-13T16:51:13.028885+0000","last_undegraded":"2024-09-13T16:51:13.028885+0000","last_fullsized":"2024-09-13T16:51:13.028885+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:57.087680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029922+0000","last_change":"2024-09-13T16:49:32.123998+0000","last_active":"2024-09-13T16:51:13.029922+0000","last_peered":"2024-09-13T16:51:13.029922+0000","last_clean":"2024-09-13T16:51:13.029922+0000","last_became_active":"2024-09-13T16:49:32.123619+0000","last_became_peered":"2024-09-13T16:49:32.123619+0000","last_unstale":"2024-09-13T16:51:13.029922+0000","last_undegraded":"2024-09-13T16:51:13.029922+0000","last_fullsized":"2024-09-13T16:51:13.029922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:32.271957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030122+0000","last_change":"2024-09-13T16:49:28.101110+0000","last_active":"2024-09-13T16:51:13.030122+0000","last_peered":"2024-09-13T16:51:13.030122+0000","last_clean":"2024-09-13T16:51:13.030122+0000","last_became_active":"2024-09-13T16:49:28.099342+0000","last_became_peered":"2024-09-13T16:49:28.099342+0000","last_unstale":"2024-09-13T16:51:13.030122+0000","last_undegraded":"2024-09-13T16:51:13.030122+0000","last_fullsized":"2024-09-13T16:51:13.030122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:44.331289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028209+0000","last_change":"2024-09-13T16:50:13.668091+0000","last_active":"2024-09-13T16:51:13.028209+0000","last_peered":"2024-09-13T16:51:13.028209+0000","last_clean":"2024-09-13T16:51:13.028209+0000","last_became_active":"2024-09-13T16:50:13.650668+0000","last_became_peered":"2024-09-13T16:50:13.650668+0000","last_unstale":"2024-09-13T16:51:13.028209+0000","last_undegraded":"2024-09-13T16:51:13.028209+0000","last_fullsized":"2024-09-13T16:51:13.028209+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:40.047203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:14.584516+0000","last_change":"2024-09-13T16:51:14.584516+0000","last_active":"2024-09-13T16:51:14.584516+0000","last_peered":"2024-09-13T16:51:14.584516+0000","last_clean":"2024-09-13T16:51:14.584516+0000","last_became_active":"2024-09-13T16:51:14.584117+0000","last_became_peered":"2024-09-13T16:51:14.584117+0000","last_unstale":"2024-09-13T16:51:14.584516+0000","last_undegraded":"2024-09-13T16:51:14.584516+0000","last_fullsized":"2024-09-13T16:51:14.584516+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:57.135059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.130803+0000","last_change":"2024-09-13T16:49:28.103828+0000","last_active":"2024-09-13T16:51:13.130803+0000","last_peered":"2024-09-13T16:51:13.130803+0000","last_clean":"2024-09-13T16:51:13.130803+0000","last_became_active":"2024-09-13T16:49:28.103526+0000","last_became_peered":"2024-09-13T16:49:28.103526+0000","last_unstale":"2024-09-13T16:51:13.130803+0000","last_undegraded":"2024-09-13T16:51:13.130803+0000","last_fullsized":"2024-09-13T16:51:13.130803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:21.612371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":113,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:19.937081+0000","last_change":"2024-09-13T16:49:27.643734+0000","last_active":"2024-09-13T16:51:19.937081+0000","last_peered":"2024-09-13T16:51:19.937081+0000","last_clean":"2024-09-13T16:51:19.937081+0000","last_became_active":"2024-09-13T16:49:27.643129+0000","last_became_peered":"2024-09-13T16:49:27.643129+0000","last_unstale":"2024-09-13T16:51:19.937081+0000","last_undegraded":"2024-09-13T16:51:19.937081+0000","last_fullsized":"2024-09-13T16:51:19.937081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:01.756293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1073,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025692+0000","last_change":"2024-09-13T16:49:32.132105+0000","last_active":"2024-09-13T16:51:13.025692+0000","last_peered":"2024-09-13T16:51:13.025692+0000","last_clean":"2024-09-13T16:51:13.025692+0000","last_became_active":"2024-09-13T16:49:32.131379+0000","last_became_peered":"2024-09-13T16:49:32.131379+0000","last_unstale":"2024-09-13T16:51:13.025692+0000","last_undegraded":"2024-09-13T16:51:13.025692+0000","last_fullsized":"2024-09-13T16:51:13.025692+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:09.215195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131237+0000","last_change":"2024-09-13T16:49:28.099072+0000","last_active":"2024-09-13T16:51:13.131237+0000","last_peered":"2024-09-13T16:51:13.131237+0000","last_clean":"2024-09-13T16:51:13.131237+0000","last_became_active":"2024-09-13T16:49:28.098797+0000","last_became_peered":"2024-09-13T16:49:28.098797+0000","last_unstale":"2024-09-13T16:51:13.131237+0000","last_undegraded":"2024-09-13T16:51:13.131237+0000","last_fullsized":"2024-09-13T16:51:13.131237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:36.997019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031216+0000","last_change":"2024-09-13T16:49:27.653581+0000","last_active":"2024-09-13T16:51:13.031216+0000","last_peered":"2024-09-13T16:51:13.031216+0000","last_clean":"2024-09-13T16:51:13.031216+0000","last_became_active":"2024-09-13T16:49:27.653245+0000","last_became_peered":"2024-09-13T16:49:27.653245+0000","last_unstale":"2024-09-13T16:51:13.031216+0000","last_undegraded":"2024-09-13T16:51:13.031216+0000","last_fullsized":"2024-09-13T16:51:13.031216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:47.639020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028467+0000","last_change":"2024-09-13T16:49:32.128569+0000","last_active":"2024-09-13T16:51:13.028467+0000","last_peered":"2024-09-13T16:51:13.028467+0000","last_clean":"2024-09-13T16:51:13.028467+0000","last_became_active":"2024-09-13T16:49:32.128180+0000","last_became_peered":"2024-09-13T16:49:32.128180+0000","last_unstale":"2024-09-13T16:51:13.028467+0000","last_undegraded":"2024-09-13T16:51:13.028467+0000","last_fullsized":"2024-09-13T16:51:13.028467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.887518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028286+0000","last_change":"2024-09-13T16:49:28.111923+0000","last_active":"2024-09-13T16:51:13.028286+0000","last_peered":"2024-09-13T16:51:13.028286+0000","last_clean":"2024-09-13T16:51:13.028286+0000","last_became_active":"2024-09-13T16:49:28.108483+0000","last_became_peered":"2024-09-13T16:49:28.108483+0000","last_unstale":"2024-09-13T16:51:13.028286+0000","last_undegraded":"2024-09-13T16:51:13.028286+0000","last_fullsized":"2024-09-13T16:51:13.028286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:11.921967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029694+0000","last_change":"2024-09-13T16:49:27.653823+0000","last_active":"2024-09-13T16:51:13.029694+0000","last_peered":"2024-09-13T16:51:13.029694+0000","last_clean":"2024-09-13T16:51:13.029694+0000","last_became_active":"2024-09-13T16:49:27.653389+0000","last_became_peered":"2024-09-13T16:49:27.653389+0000","last_unstale":"2024-09-13T16:51:13.029694+0000","last_undegraded":"2024-09-13T16:51:13.029694+0000","last_fullsized":"2024-09-13T16:51:13.029694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:32.409712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030682+0000","last_change":"2024-09-13T16:49:32.128133+0000","last_active":"2024-09-13T16:51:13.030682+0000","last_peered":"2024-09-13T16:51:13.030682+0000","last_clean":"2024-09-13T16:51:13.030682+0000","last_became_active":"2024-09-13T16:49:32.127641+0000","last_became_peered":"2024-09-13T16:49:32.127641+0000","last_unstale":"2024-09-13T16:51:13.030682+0000","last_undegraded":"2024-09-13T16:51:13.030682+0000","last_fullsized":"2024-09-13T16:51:13.030682+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:18.349527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026576+0000","last_change":"2024-09-13T16:49:28.106264+0000","last_active":"2024-09-13T16:51:13.026576+0000","last_peered":"2024-09-13T16:51:13.026576+0000","last_clean":"2024-09-13T16:51:13.026576+0000","last_became_active":"2024-09-13T16:49:28.105901+0000","last_became_peered":"2024-09-13T16:49:28.105901+0000","last_unstale":"2024-09-13T16:51:13.026576+0000","last_undegraded":"2024-09-13T16:51:13.026576+0000","last_fullsized":"2024-09-13T16:51:13.026576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:46.516128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'35","reported_seq":258,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:24.762044+0000","last_change":"2024-09-13T16:50:13.661807+0000","last_active":"2024-09-13T16:51:24.762044+0000","last_peered":"2024-09-13T16:51:24.762044+0000","last_clean":"2024-09-13T16:51:24.762044+0000","last_became_active":"2024-09-13T16:50:13.648306+0000","last_became_peered":"2024-09-13T16:50:13.648306+0000","last_unstale":"2024-09-13T16:51:24.762044+0000","last_undegraded":"2024-09-13T16:51:24.762044+0000","last_fullsized":"2024-09-13T16:51:24.762044+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:56.390172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61978,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":133,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60591,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:14.584582+0000","last_change":"2024-09-13T16:51:14.584582+0000","last_active":"2024-09-13T16:51:14.584582+0000","last_peered":"2024-09-13T16:51:14.584582+0000","last_clean":"2024-09-13T16:51:14.584582+0000","last_became_active":"2024-09-13T16:51:14.584129+0000","last_became_peered":"2024-09-13T16:51:14.584129+0000","last_unstale":"2024-09-13T16:51:14.584582+0000","last_undegraded":"2024-09-13T16:51:14.584582+0000","last_fullsized":"2024-09-13T16:51:14.584582+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:20.321247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,10],"acting":[9,8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031841+0000","last_change":"2024-09-13T16:49:28.102549+0000","last_active":"2024-09-13T16:51:13.031841+0000","last_peered":"2024-09-13T16:51:13.031841+0000","last_clean":"2024-09-13T16:51:13.031841+0000","last_became_active":"2024-09-13T16:49:28.102109+0000","last_became_peered":"2024-09-13T16:49:28.102109+0000","last_unstale":"2024-09-13T16:51:13.031841+0000","last_undegraded":"2024-09-13T16:51:13.031841+0000","last_fullsized":"2024-09-13T16:51:13.031841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:04.410795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030881+0000","last_change":"2024-09-13T16:49:27.663189+0000","last_active":"2024-09-13T16:51:13.030881+0000","last_peered":"2024-09-13T16:51:13.030881+0000","last_clean":"2024-09-13T16:51:13.030881+0000","last_became_active":"2024-09-13T16:49:27.662852+0000","last_became_peered":"2024-09-13T16:49:27.662852+0000","last_unstale":"2024-09-13T16:51:13.030881+0000","last_undegraded":"2024-09-13T16:51:13.030881+0000","last_fullsized":"2024-09-13T16:51:13.030881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:32.862451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:14.585018+0000","last_change":"2024-09-13T16:51:14.585018+0000","last_active":"2024-09-13T16:51:14.585018+0000","last_peered":"2024-09-13T16:51:14.585018+0000","last_clean":"2024-09-13T16:51:14.585018+0000","last_became_active":"2024-09-13T16:51:14.584448+0000","last_became_peered":"2024-09-13T16:51:14.584448+0000","last_unstale":"2024-09-13T16:51:14.585018+0000","last_undegraded":"2024-09-13T16:51:14.585018+0000","last_fullsized":"2024-09-13T16:51:14.585018+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:25:56.983857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029690+0000","last_change":"2024-09-13T16:49:28.112762+0000","last_active":"2024-09-13T16:51:13.029690+0000","last_peered":"2024-09-13T16:51:13.029690+0000","last_clean":"2024-09-13T16:51:13.029690+0000","last_became_active":"2024-09-13T16:49:28.111865+0000","last_became_peered":"2024-09-13T16:49:28.111865+0000","last_unstale":"2024-09-13T16:51:13.029690+0000","last_undegraded":"2024-09-13T16:51:13.029690+0000","last_fullsized":"2024-09-13T16:51:13.029690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:36.633413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131264+0000","last_change":"2024-09-13T16:50:13.651587+0000","last_active":"2024-09-13T16:51:13.131264+0000","last_peered":"2024-09-13T16:51:13.131264+0000","last_clean":"2024-09-13T16:51:13.131264+0000","last_became_active":"2024-09-13T16:50:13.648491+0000","last_became_peered":"2024-09-13T16:50:13.648491+0000","last_unstale":"2024-09-13T16:51:13.131264+0000","last_undegraded":"2024-09-13T16:51:13.131264+0000","last_fullsized":"2024-09-13T16:51:13.131264+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:50:56.385359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:14.485250+0000","last_change":"2024-09-13T16:51:14.484868+0000","last_active":"2024-09-13T16:51:14.485250+0000","last_peered":"2024-09-13T16:51:14.485250+0000","last_clean":"2024-09-13T16:51:14.485250+0000","last_became_active":"2024-09-13T16:51:14.484327+0000","last_became_peered":"2024-09-13T16:51:14.484327+0000","last_unstale":"2024-09-13T16:51:14.485250+0000","last_undegraded":"2024-09-13T16:51:14.485250+0000","last_fullsized":"2024-09-13T16:51:14.485250+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:49.276979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031545+0000","last_change":"2024-09-13T16:49:28.102721+0000","last_active":"2024-09-13T16:51:13.031545+0000","last_peered":"2024-09-13T16:51:13.031545+0000","last_clean":"2024-09-13T16:51:13.031545+0000","last_became_active":"2024-09-13T16:49:28.102431+0000","last_became_peered":"2024-09-13T16:49:28.102431+0000","last_unstale":"2024-09-13T16:51:13.031545+0000","last_undegraded":"2024-09-13T16:51:13.031545+0000","last_fullsized":"2024-09-13T16:51:13.031545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:38.921527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":112,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:23.931049+0000","last_change":"2024-09-13T16:49:27.653616+0000","last_active":"2024-09-13T16:51:23.931049+0000","last_peered":"2024-09-13T16:51:23.931049+0000","last_clean":"2024-09-13T16:51:23.931049+0000","last_became_active":"2024-09-13T16:49:27.653312+0000","last_became_peered":"2024-09-13T16:49:27.653312+0000","last_unstale":"2024-09-13T16:51:23.931049+0000","last_undegraded":"2024-09-13T16:51:23.931049+0000","last_fullsized":"2024-09-13T16:51:23.931049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:37.536821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032496+0000","last_change":"2024-09-13T16:49:32.121500+0000","last_active":"2024-09-13T16:51:13.032496+0000","last_peered":"2024-09-13T16:51:13.032496+0000","last_clean":"2024-09-13T16:51:13.032496+0000","last_became_active":"2024-09-13T16:49:32.120434+0000","last_became_peered":"2024-09-13T16:49:32.120434+0000","last_unstale":"2024-09-13T16:51:13.032496+0000","last_undegraded":"2024-09-13T16:51:13.032496+0000","last_fullsized":"2024-09-13T16:51:13.032496+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:14.832079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029702+0000","last_change":"2024-09-13T16:49:32.129276+0000","last_active":"2024-09-13T16:51:13.029702+0000","last_peered":"2024-09-13T16:51:13.029702+0000","last_clean":"2024-09-13T16:51:13.029702+0000","last_became_active":"2024-09-13T16:49:32.128351+0000","last_became_peered":"2024-09-13T16:49:32.128351+0000","last_unstale":"2024-09-13T16:51:13.029702+0000","last_undegraded":"2024-09-13T16:51:13.029702+0000","last_fullsized":"2024-09-13T16:51:13.029702+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:30.287034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025182+0000","last_change":"2024-09-13T16:49:28.105330+0000","last_active":"2024-09-13T16:51:13.025182+0000","last_peered":"2024-09-13T16:51:13.025182+0000","last_clean":"2024-09-13T16:51:13.025182+0000","last_became_active":"2024-09-13T16:49:28.105048+0000","last_became_peered":"2024-09-13T16:49:28.105048+0000","last_unstale":"2024-09-13T16:51:13.025182+0000","last_undegraded":"2024-09-13T16:51:13.025182+0000","last_fullsized":"2024-09-13T16:51:13.025182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:50.302087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030998+0000","last_change":"2024-09-13T16:49:27.645811+0000","last_active":"2024-09-13T16:51:13.030998+0000","last_peered":"2024-09-13T16:51:13.030998+0000","last_clean":"2024-09-13T16:51:13.030998+0000","last_became_active":"2024-09-13T16:49:27.645239+0000","last_became_peered":"2024-09-13T16:49:27.645239+0000","last_unstale":"2024-09-13T16:51:13.030998+0000","last_undegraded":"2024-09-13T16:51:13.030998+0000","last_fullsized":"2024-09-13T16:51:13.030998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:14.960763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028755+0000","last_change":"2024-09-13T16:49:32.129619+0000","last_active":"2024-09-13T16:51:13.028755+0000","last_peered":"2024-09-13T16:51:13.028755+0000","last_clean":"2024-09-13T16:51:13.028755+0000","last_became_active":"2024-09-13T16:49:32.128897+0000","last_became_peered":"2024-09-13T16:49:32.128897+0000","last_unstale":"2024-09-13T16:51:13.028755+0000","last_undegraded":"2024-09-13T16:51:13.028755+0000","last_fullsized":"2024-09-13T16:51:13.028755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:47.343520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.033275+0000","last_change":"2024-09-13T16:49:28.100409+0000","last_active":"2024-09-13T16:51:13.033275+0000","last_peered":"2024-09-13T16:51:13.033275+0000","last_clean":"2024-09-13T16:51:13.033275+0000","last_became_active":"2024-09-13T16:49:28.096557+0000","last_became_peered":"2024-09-13T16:49:28.096557+0000","last_unstale":"2024-09-13T16:51:13.033275+0000","last_undegraded":"2024-09-13T16:51:13.033275+0000","last_fullsized":"2024-09-13T16:51:13.033275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:06.959079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028235+0000","last_change":"2024-09-13T16:49:27.658366+0000","last_active":"2024-09-13T16:51:13.028235+0000","last_peered":"2024-09-13T16:51:13.028235+0000","last_clean":"2024-09-13T16:51:13.028235+0000","last_became_active":"2024-09-13T16:49:27.657907+0000","last_became_peered":"2024-09-13T16:49:27.657907+0000","last_unstale":"2024-09-13T16:51:13.028235+0000","last_undegraded":"2024-09-13T16:51:13.028235+0000","last_fullsized":"2024-09-13T16:51:13.028235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:11.493555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026157+0000","last_change":"2024-09-13T16:49:27.656786+0000","last_active":"2024-09-13T16:51:13.026157+0000","last_peered":"2024-09-13T16:51:13.026157+0000","last_clean":"2024-09-13T16:51:13.026157+0000","last_became_active":"2024-09-13T16:49:27.656508+0000","last_became_peered":"2024-09-13T16:49:27.656508+0000","last_unstale":"2024-09-13T16:51:13.026157+0000","last_undegraded":"2024-09-13T16:51:13.026157+0000","last_fullsized":"2024-09-13T16:51:13.026157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:22.867530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030682+0000","last_change":"2024-09-13T16:50:13.652393+0000","last_active":"2024-09-13T16:51:13.030682+0000","last_peered":"2024-09-13T16:51:13.030682+0000","last_clean":"2024-09-13T16:51:13.030682+0000","last_became_active":"2024-09-13T16:50:13.652017+0000","last_became_peered":"2024-09-13T16:50:13.652017+0000","last_unstale":"2024-09-13T16:51:13.030682+0000","last_undegraded":"2024-09-13T16:51:13.030682+0000","last_fullsized":"2024-09-13T16:51:13.030682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:03.311574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,8],"acting":[5,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029014+0000","last_change":"2024-09-13T16:49:32.128808+0000","last_active":"2024-09-13T16:51:13.029014+0000","last_peered":"2024-09-13T16:51:13.029014+0000","last_clean":"2024-09-13T16:51:13.029014+0000","last_became_active":"2024-09-13T16:49:32.128333+0000","last_became_peered":"2024-09-13T16:49:32.128333+0000","last_unstale":"2024-09-13T16:51:13.029014+0000","last_undegraded":"2024-09-13T16:51:13.029014+0000","last_fullsized":"2024-09-13T16:51:13.029014+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:03.484456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":117,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T16:51:21.928393+0000","last_change":"2024-09-13T16:49:27.648863+0000","last_active":"2024-09-13T16:51:21.928393+0000","last_peered":"2024-09-13T16:51:21.928393+0000","last_clean":"2024-09-13T16:51:21.928393+0000","last_became_active":"2024-09-13T16:49:27.648572+0000","last_became_peered":"2024-09-13T16:49:27.648572+0000","last_unstale":"2024-09-13T16:51:21.928393+0000","last_undegraded":"2024-09-13T16:51:21.928393+0000","last_fullsized":"2024-09-13T16:51:21.928393+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:26.622912+0000","last_clean_scrub_stamp":"2024-09-13T16:49:26.622912+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026993+0000","last_change":"2024-09-13T16:49:28.114013+0000","last_active":"2024-09-13T16:51:13.026993+0000","last_peered":"2024-09-13T16:51:13.026993+0000","last_clean":"2024-09-13T16:51:13.026993+0000","last_became_active":"2024-09-13T16:49:28.113722+0000","last_became_peered":"2024-09-13T16:49:28.113722+0000","last_unstale":"2024-09-13T16:51:13.026993+0000","last_undegraded":"2024-09-13T16:51:13.026993+0000","last_fullsized":"2024-09-13T16:51:13.026993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:42.560038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030284+0000","last_change":"2024-09-13T16:49:32.118308+0000","last_active":"2024-09-13T16:51:13.030284+0000","last_peered":"2024-09-13T16:51:13.030284+0000","last_clean":"2024-09-13T16:51:13.030284+0000","last_became_active":"2024-09-13T16:49:32.117963+0000","last_became_peered":"2024-09-13T16:49:32.117963+0000","last_unstale":"2024-09-13T16:51:13.030284+0000","last_undegraded":"2024-09-13T16:51:13.030284+0000","last_fullsized":"2024-09-13T16:51:13.030284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:31.095523+0000","last_clean_scrub_stamp":"2024-09-13T16:49:31.095523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:26.939494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028324+0000","last_change":"2024-09-13T16:49:28.102325+0000","last_active":"2024-09-13T16:51:13.028324+0000","last_peered":"2024-09-13T16:51:13.028324+0000","last_clean":"2024-09-13T16:51:13.028324+0000","last_became_active":"2024-09-13T16:49:28.102007+0000","last_became_peered":"2024-09-13T16:49:28.102007+0000","last_unstale":"2024-09-13T16:51:13.028324+0000","last_undegraded":"2024-09-13T16:51:13.028324+0000","last_fullsized":"2024-09-13T16:51:13.028324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:10.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029624+0000","last_change":"2024-09-13T16:49:28.102964+0000","last_active":"2024-09-13T16:51:13.029624+0000","last_peered":"2024-09-13T16:51:13.029624+0000","last_clean":"2024-09-13T16:51:13.029624+0000","last_became_active":"2024-09-13T16:49:28.102678+0000","last_became_peered":"2024-09-13T16:49:28.102678+0000","last_unstale":"2024-09-13T16:51:13.029624+0000","last_undegraded":"2024-09-13T16:51:13.029624+0000","last_fullsized":"2024-09-13T16:51:13.029624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:10.255219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029009+0000","last_change":"2024-09-13T16:49:28.117353+0000","last_active":"2024-09-13T16:51:13.029009+0000","last_peered":"2024-09-13T16:51:13.029009+0000","last_clean":"2024-09-13T16:51:13.029009+0000","last_became_active":"2024-09-13T16:49:28.117020+0000","last_became_peered":"2024-09-13T16:49:28.117020+0000","last_unstale":"2024-09-13T16:51:13.029009+0000","last_undegraded":"2024-09-13T16:51:13.029009+0000","last_fullsized":"2024-09-13T16:51:13.029009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:46.896795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029306+0000","last_change":"2024-09-13T16:49:28.112090+0000","last_active":"2024-09-13T16:51:13.029306+0000","last_peered":"2024-09-13T16:51:13.029306+0000","last_clean":"2024-09-13T16:51:13.029306+0000","last_became_active":"2024-09-13T16:49:28.111793+0000","last_became_peered":"2024-09-13T16:49:28.111793+0000","last_unstale":"2024-09-13T16:51:13.029306+0000","last_undegraded":"2024-09-13T16:51:13.029306+0000","last_fullsized":"2024-09-13T16:51:13.029306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:45.462344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029301+0000","last_change":"2024-09-13T16:49:28.105186+0000","last_active":"2024-09-13T16:51:13.029301+0000","last_peered":"2024-09-13T16:51:13.029301+0000","last_clean":"2024-09-13T16:51:13.029301+0000","last_became_active":"2024-09-13T16:49:28.104827+0000","last_became_peered":"2024-09-13T16:49:28.104827+0000","last_unstale":"2024-09-13T16:51:13.029301+0000","last_undegraded":"2024-09-13T16:51:13.029301+0000","last_fullsized":"2024-09-13T16:51:13.029301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:07.872650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028693+0000","last_change":"2024-09-13T16:50:13.652095+0000","last_active":"2024-09-13T16:51:13.028693+0000","last_peered":"2024-09-13T16:51:13.028693+0000","last_clean":"2024-09-13T16:51:13.028693+0000","last_became_active":"2024-09-13T16:50:13.651745+0000","last_became_peered":"2024-09-13T16:50:13.651745+0000","last_unstale":"2024-09-13T16:51:13.028693+0000","last_undegraded":"2024-09-13T16:51:13.028693+0000","last_fullsized":"2024-09-13T16:51:13.028693+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:59.786923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030417+0000","last_change":"2024-09-13T16:49:28.101008+0000","last_active":"2024-09-13T16:51:13.030417+0000","last_peered":"2024-09-13T16:51:13.030417+0000","last_clean":"2024-09-13T16:51:13.030417+0000","last_became_active":"2024-09-13T16:49:28.100075+0000","last_became_peered":"2024-09-13T16:49:28.100075+0000","last_unstale":"2024-09-13T16:51:13.030417+0000","last_undegraded":"2024-09-13T16:51:13.030417+0000","last_fullsized":"2024-09-13T16:51:13.030417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:01.890674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032998+0000","last_change":"2024-09-13T16:49:28.108283+0000","last_active":"2024-09-13T16:51:13.032998+0000","last_peered":"2024-09-13T16:51:13.032998+0000","last_clean":"2024-09-13T16:51:13.032998+0000","last_became_active":"2024-09-13T16:49:28.107916+0000","last_became_peered":"2024-09-13T16:49:28.107916+0000","last_unstale":"2024-09-13T16:51:13.032998+0000","last_undegraded":"2024-09-13T16:51:13.032998+0000","last_fullsized":"2024-09-13T16:51:13.032998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:03.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030115+0000","last_change":"2024-09-13T16:49:28.106680+0000","last_active":"2024-09-13T16:51:13.030115+0000","last_peered":"2024-09-13T16:51:13.030115+0000","last_clean":"2024-09-13T16:51:13.030115+0000","last_became_active":"2024-09-13T16:49:28.105210+0000","last_became_peered":"2024-09-13T16:49:28.105210+0000","last_unstale":"2024-09-13T16:51:13.030115+0000","last_undegraded":"2024-09-13T16:51:13.030115+0000","last_fullsized":"2024-09-13T16:51:13.030115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:34.220082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.032672+0000","last_change":"2024-09-13T16:49:28.104596+0000","last_active":"2024-09-13T16:51:13.032672+0000","last_peered":"2024-09-13T16:51:13.032672+0000","last_clean":"2024-09-13T16:51:13.032672+0000","last_became_active":"2024-09-13T16:49:28.104306+0000","last_became_peered":"2024-09-13T16:49:28.104306+0000","last_unstale":"2024-09-13T16:51:13.032672+0000","last_undegraded":"2024-09-13T16:51:13.032672+0000","last_fullsized":"2024-09-13T16:51:13.032672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:02.248968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031326+0000","last_change":"2024-09-13T16:49:28.105229+0000","last_active":"2024-09-13T16:51:13.031326+0000","last_peered":"2024-09-13T16:51:13.031326+0000","last_clean":"2024-09-13T16:51:13.031326+0000","last_became_active":"2024-09-13T16:49:28.104832+0000","last_became_peered":"2024-09-13T16:49:28.104832+0000","last_unstale":"2024-09-13T16:51:13.031326+0000","last_undegraded":"2024-09-13T16:51:13.031326+0000","last_fullsized":"2024-09-13T16:51:13.031326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:36.637117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028349+0000","last_change":"2024-09-13T16:49:28.105370+0000","last_active":"2024-09-13T16:51:13.028349+0000","last_peered":"2024-09-13T16:51:13.028349+0000","last_clean":"2024-09-13T16:51:13.028349+0000","last_became_active":"2024-09-13T16:49:28.105024+0000","last_became_peered":"2024-09-13T16:49:28.105024+0000","last_unstale":"2024-09-13T16:51:13.028349+0000","last_undegraded":"2024-09-13T16:51:13.028349+0000","last_fullsized":"2024-09-13T16:51:13.028349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:32.056178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028390+0000","last_change":"2024-09-13T16:49:28.106106+0000","last_active":"2024-09-13T16:51:13.028390+0000","last_peered":"2024-09-13T16:51:13.028390+0000","last_clean":"2024-09-13T16:51:13.028390+0000","last_became_active":"2024-09-13T16:49:28.105034+0000","last_became_peered":"2024-09-13T16:49:28.105034+0000","last_unstale":"2024-09-13T16:51:13.028390+0000","last_undegraded":"2024-09-13T16:51:13.028390+0000","last_fullsized":"2024-09-13T16:51:13.028390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:08.126157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030108+0000","last_change":"2024-09-13T16:49:28.116862+0000","last_active":"2024-09-13T16:51:13.030108+0000","last_peered":"2024-09-13T16:51:13.030108+0000","last_clean":"2024-09-13T16:51:13.030108+0000","last_became_active":"2024-09-13T16:49:28.116535+0000","last_became_peered":"2024-09-13T16:49:28.116535+0000","last_unstale":"2024-09-13T16:51:13.030108+0000","last_undegraded":"2024-09-13T16:51:13.030108+0000","last_fullsized":"2024-09-13T16:51:13.030108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:07.216968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.025556+0000","last_change":"2024-09-13T16:49:28.096500+0000","last_active":"2024-09-13T16:51:13.025556+0000","last_peered":"2024-09-13T16:51:13.025556+0000","last_clean":"2024-09-13T16:51:13.025556+0000","last_became_active":"2024-09-13T16:49:28.096218+0000","last_became_peered":"2024-09-13T16:49:28.096218+0000","last_unstale":"2024-09-13T16:51:13.025556+0000","last_undegraded":"2024-09-13T16:51:13.025556+0000","last_fullsized":"2024-09-13T16:51:13.025556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:16.274941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029097+0000","last_change":"2024-09-13T16:49:28.114943+0000","last_active":"2024-09-13T16:51:13.029097+0000","last_peered":"2024-09-13T16:51:13.029097+0000","last_clean":"2024-09-13T16:51:13.029097+0000","last_became_active":"2024-09-13T16:49:28.114477+0000","last_became_peered":"2024-09-13T16:49:28.114477+0000","last_unstale":"2024-09-13T16:51:13.029097+0000","last_undegraded":"2024-09-13T16:51:13.029097+0000","last_fullsized":"2024-09-13T16:51:13.029097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:21.222638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.030893+0000","last_change":"2024-09-13T16:49:28.103795+0000","last_active":"2024-09-13T16:51:13.030893+0000","last_peered":"2024-09-13T16:51:13.030893+0000","last_clean":"2024-09-13T16:51:13.030893+0000","last_became_active":"2024-09-13T16:49:28.103531+0000","last_became_peered":"2024-09-13T16:49:28.103531+0000","last_unstale":"2024-09-13T16:51:13.030893+0000","last_undegraded":"2024-09-13T16:51:13.030893+0000","last_fullsized":"2024-09-13T16:51:13.030893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:17.886309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028891+0000","last_change":"2024-09-13T16:50:13.651345+0000","last_active":"2024-09-13T16:51:13.028891+0000","last_peered":"2024-09-13T16:51:13.028891+0000","last_clean":"2024-09-13T16:51:13.028891+0000","last_became_active":"2024-09-13T16:50:13.650909+0000","last_became_peered":"2024-09-13T16:50:13.650909+0000","last_unstale":"2024-09-13T16:51:13.028891+0000","last_undegraded":"2024-09-13T16:51:13.028891+0000","last_fullsized":"2024-09-13T16:51:13.028891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:51.776319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029124+0000","last_change":"2024-09-13T16:49:28.114265+0000","last_active":"2024-09-13T16:51:13.029124+0000","last_peered":"2024-09-13T16:51:13.029124+0000","last_clean":"2024-09-13T16:51:13.029124+0000","last_became_active":"2024-09-13T16:49:28.111350+0000","last_became_peered":"2024-09-13T16:49:28.111350+0000","last_unstale":"2024-09-13T16:51:13.029124+0000","last_undegraded":"2024-09-13T16:51:13.029124+0000","last_fullsized":"2024-09-13T16:51:13.029124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:11.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.028342+0000","last_change":"2024-09-13T16:49:28.088565+0000","last_active":"2024-09-13T16:51:13.028342+0000","last_peered":"2024-09-13T16:51:13.028342+0000","last_clean":"2024-09-13T16:51:13.028342+0000","last_became_active":"2024-09-13T16:49:28.088070+0000","last_became_peered":"2024-09-13T16:49:28.088070+0000","last_unstale":"2024-09-13T16:51:13.028342+0000","last_undegraded":"2024-09-13T16:51:13.028342+0000","last_fullsized":"2024-09-13T16:51:13.028342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:23.134281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029090+0000","last_change":"2024-09-13T16:49:28.107501+0000","last_active":"2024-09-13T16:51:13.029090+0000","last_peered":"2024-09-13T16:51:13.029090+0000","last_clean":"2024-09-13T16:51:13.029090+0000","last_became_active":"2024-09-13T16:49:28.107222+0000","last_became_peered":"2024-09-13T16:49:28.107222+0000","last_unstale":"2024-09-13T16:51:13.029090+0000","last_undegraded":"2024-09-13T16:51:13.029090+0000","last_fullsized":"2024-09-13T16:51:13.029090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:04:00.465540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.131341+0000","last_change":"2024-09-13T16:49:28.108274+0000","last_active":"2024-09-13T16:51:13.131341+0000","last_peered":"2024-09-13T16:51:13.131341+0000","last_clean":"2024-09-13T16:51:13.131341+0000","last_became_active":"2024-09-13T16:49:28.107977+0000","last_became_peered":"2024-09-13T16:49:28.107977+0000","last_unstale":"2024-09-13T16:51:13.131341+0000","last_undegraded":"2024-09-13T16:51:13.131341+0000","last_fullsized":"2024-09-13T16:51:13.131341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:31.398072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026404+0000","last_change":"2024-09-13T16:49:28.098428+0000","last_active":"2024-09-13T16:51:13.026404+0000","last_peered":"2024-09-13T16:51:13.026404+0000","last_clean":"2024-09-13T16:51:13.026404+0000","last_became_active":"2024-09-13T16:49:28.098139+0000","last_became_peered":"2024-09-13T16:49:28.098139+0000","last_unstale":"2024-09-13T16:51:13.026404+0000","last_undegraded":"2024-09-13T16:51:13.026404+0000","last_fullsized":"2024-09-13T16:51:13.026404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:36.977026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.031794+0000","last_change":"2024-09-13T16:49:28.103117+0000","last_active":"2024-09-13T16:51:13.031794+0000","last_peered":"2024-09-13T16:51:13.031794+0000","last_clean":"2024-09-13T16:51:13.031794+0000","last_became_active":"2024-09-13T16:49:28.102850+0000","last_became_peered":"2024-09-13T16:49:28.102850+0000","last_unstale":"2024-09-13T16:51:13.031794+0000","last_undegraded":"2024-09-13T16:51:13.031794+0000","last_fullsized":"2024-09-13T16:51:13.031794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:21.883563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.033401+0000","last_change":"2024-09-13T16:49:28.105876+0000","last_active":"2024-09-13T16:51:13.033401+0000","last_peered":"2024-09-13T16:51:13.033401+0000","last_clean":"2024-09-13T16:51:13.033401+0000","last_became_active":"2024-09-13T16:49:28.104340+0000","last_became_peered":"2024-09-13T16:49:28.104340+0000","last_unstale":"2024-09-13T16:51:13.033401+0000","last_undegraded":"2024-09-13T16:51:13.033401+0000","last_fullsized":"2024-09-13T16:51:13.033401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:06.385262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.130941+0000","last_change":"2024-09-13T16:49:28.104638+0000","last_active":"2024-09-13T16:51:13.130941+0000","last_peered":"2024-09-13T16:51:13.130941+0000","last_clean":"2024-09-13T16:51:13.130941+0000","last_became_active":"2024-09-13T16:49:28.104145+0000","last_became_peered":"2024-09-13T16:49:28.104145+0000","last_unstale":"2024-09-13T16:51:13.130941+0000","last_undegraded":"2024-09-13T16:51:13.130941+0000","last_fullsized":"2024-09-13T16:51:13.130941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:12.502634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026254+0000","last_change":"2024-09-13T16:50:13.645977+0000","last_active":"2024-09-13T16:51:13.026254+0000","last_peered":"2024-09-13T16:51:13.026254+0000","last_clean":"2024-09-13T16:51:13.026254+0000","last_became_active":"2024-09-13T16:50:13.645623+0000","last_became_peered":"2024-09-13T16:50:13.645623+0000","last_unstale":"2024-09-13T16:51:13.026254+0000","last_undegraded":"2024-09-13T16:51:13.026254+0000","last_fullsized":"2024-09-13T16:51:13.026254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:40.864700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.026132+0000","last_change":"2024-09-13T16:49:28.116644+0000","last_active":"2024-09-13T16:51:13.026132+0000","last_peered":"2024-09-13T16:51:13.026132+0000","last_clean":"2024-09-13T16:51:13.026132+0000","last_became_active":"2024-09-13T16:49:28.116350+0000","last_became_peered":"2024-09-13T16:49:28.116350+0000","last_unstale":"2024-09-13T16:51:13.026132+0000","last_undegraded":"2024-09-13T16:51:13.026132+0000","last_fullsized":"2024-09-13T16:51:13.026132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:07.922567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029006+0000","last_change":"2024-09-13T16:49:28.107528+0000","last_active":"2024-09-13T16:51:13.029006+0000","last_peered":"2024-09-13T16:51:13.029006+0000","last_clean":"2024-09-13T16:51:13.029006+0000","last_became_active":"2024-09-13T16:49:28.107260+0000","last_became_peered":"2024-09-13T16:49:28.107260+0000","last_unstale":"2024-09-13T16:51:13.029006+0000","last_undegraded":"2024-09-13T16:51:13.029006+0000","last_fullsized":"2024-09-13T16:51:13.029006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:23.482772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029569+0000","last_change":"2024-09-13T16:49:28.105396+0000","last_active":"2024-09-13T16:51:13.029569+0000","last_peered":"2024-09-13T16:51:13.029569+0000","last_clean":"2024-09-13T16:51:13.029569+0000","last_became_active":"2024-09-13T16:49:28.105050+0000","last_became_peered":"2024-09-13T16:49:28.105050+0000","last_unstale":"2024-09-13T16:51:13.029569+0000","last_undegraded":"2024-09-13T16:51:13.029569+0000","last_fullsized":"2024-09-13T16:51:13.029569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:51.533286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029866+0000","last_change":"2024-09-13T16:49:28.112680+0000","last_active":"2024-09-13T16:51:13.029866+0000","last_peered":"2024-09-13T16:51:13.029866+0000","last_clean":"2024-09-13T16:51:13.029866+0000","last_became_active":"2024-09-13T16:49:28.112389+0000","last_became_peered":"2024-09-13T16:49:28.112389+0000","last_unstale":"2024-09-13T16:51:13.029866+0000","last_undegraded":"2024-09-13T16:51:13.029866+0000","last_fullsized":"2024-09-13T16:51:13.029866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:05.464951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"91'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T16:51:13.029001+0000","last_change":"2024-09-13T16:49:28.105746+0000","last_active":"2024-09-13T16:51:13.029001+0000","last_peered":"2024-09-13T16:51:13.029001+0000","last_clean":"2024-09-13T16:51:13.029001+0000","last_became_active":"2024-09-13T16:49:28.105217+0000","last_became_peered":"2024-09-13T16:49:28.105217+0000","last_unstale":"2024-09-13T16:51:13.029001+0000","last_undegraded":"2024-09-13T16:51:13.029001+0000","last_fullsized":"2024-09-13T16:51:13.029001+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T16:49:27.624891+0000","last_clean_scrub_stamp":"2024-09-13T16:49:27.624891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:13.165993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66558,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":537,"num_read_kb":327,"num_write":164,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":60725,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":199674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383717,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":1064960,"data_stored":518981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.45500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.748,"5min":1.486,"15min":1.486},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.71699999999999997,"5min":0.749,"15min":0.749},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.752,"5min":0.755,"15min":0.755},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40400000000000003},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":1.363,"15min":1.363},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.72799999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51300000000000001,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80600000000000005,"5min":0.871,"15min":0.871},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83099999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.622,"15min":0.63500000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.69399999999999995,"15min":0.71099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82799999999999996,"5min":1.141,"15min":1.141},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.89900000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.627}]},{"osd":8,"last update":"Fri Sep 13 16:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.61599999999999999}]},{"osd":9,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90700000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.751},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98399999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.80600000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:50:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.55100000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.87,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95299999999999996,"5min":0.995,"15min":0.995},"last":0.77500000000000002}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1736704,"data_stored":1168297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.28899999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.54100000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41899999999999998,"15min":0.42299999999999999},"min":{"1min":0.318,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51200000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73299999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.629},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73599999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.74199999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63100000000000001,"15min":0.64500000000000002},"min":{"1min":0.42299999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.75700000000000001,"5min":1.196,"15min":1.196},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.499,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66600000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52800000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.62,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.754}]},{"osd":6,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65000000000000002,"15min":0.66600000000000004},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.80400000000000005,"5min":0.88,"15min":0.88},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.82399999999999995,"5min":1.115,"15min":1.115},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 16:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56100000000000005}]},{"osd":8,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.50700000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.67000000000000004,"15min":0.68600000000000005},"min":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.74299999999999999}]},{"osd":9,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.48799999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85299999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71299999999999997,"15min":0.73399999999999999},"min":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.80900000000000005}]},{"osd":11,"last update":"Fri Sep 13 16:50:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.76300000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.79700000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808879,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":1073152,"data_stored":523179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61599999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64500000000000002,"5min":1.177,"15min":1.177},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82299999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90900000000000003,"5min":1.621,"15min":1.621},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.54300000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81299999999999994,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82799999999999996,"5min":1.55,"15min":1.55},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.74199999999999999,"15min":0.78100000000000003},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92800000000000005,"5min":1.458,"15min":1.458},"last":0.621}]},{"osd":4,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89100000000000001,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.80300000000000005,"15min":0.84299999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95099999999999996,"5min":1.635,"15min":1.635},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.871,"15min":0.91700000000000004},"min":{"1min":0.53800000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93300000000000005,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.90500000000000003,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Sep 13 16:48:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.081},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.2589999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.76200000000000001,"15min":0.78600000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86699999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.92100000000000004,"15min":0.98399999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91300000000000003,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.72999999999999998}]},{"osd":8,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.81499999999999995,"15min":0.84699999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.83299999999999996,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.97599999999999998,"15min":1.036},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98999999999999999,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":0.69599999999999995}]},{"osd":10,"last update":"Fri Sep 13 16:51:16 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.91100000000000003,"15min":0.96899999999999997},"min":{"1min":0.61499999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0169999999999999,"5min":1.294,"15min":1.294},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.92500000000000004,"15min":0.98399999999999999},"min":{"1min":0.54700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":0.95799999999999996,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.751}]},{"osd":11,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.74399999999999999}]}]},{"osd":8,"up_from":59,"seq":253403070516,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":518538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.624},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.36499999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.52600000000000002,"15min":0.51500000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60799999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.29999999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":5.5099999999999998,"5min":5.5099999999999998,"15min":5.5099999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.749,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.49099999999999999,"15min":0.49199999999999999},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.36699999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.624,"15min":0.625},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.46100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.78200000000000003}]},{"osd":9,"last update":"Fri Sep 13 16:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69699999999999995,"15min":0.68300000000000005},"min":{"1min":0.53200000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.044,"5min":0.75900000000000001,"15min":0.70899999999999996},"min":{"1min":0.64500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":5.5339999999999998,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.754}]},{"osd":10,"last update":"Fri Sep 13 16:51:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.626},"min":{"1min":0.59399999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94799999999999995,"5min":1.008,"15min":1.008},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.627,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68400000000000005}]},{"osd":11,"last update":"Fri Sep 13 16:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.71399999999999997}]}]},{"osd":7,"up_from":51,"seq":219043332152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40936,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93704216,"statfs":{"total":95995035648,"available":95953117184,"internally_reserved":0,"allocated":1662976,"data_stored":1115491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38500000000000001,"15min":0.38600000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.57799999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.41599999999999998,"15min":0.41999999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.318}]},{"osd":2,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.498},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70899999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.627}]},{"osd":3,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71399999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.312,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.40999999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69499999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.61799999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.77400000000000002,"5min":0.88,"15min":0.88},"last":0.58599999999999997}]},{"osd":8,"last update":"Fri Sep 13 16:50:20 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.40899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64900000000000002,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.67700000000000005}]},{"osd":9,"last update":"Fri Sep 13 16:50:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84299999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.749}]},{"osd":10,"last update":"Fri Sep 13 16:51:15 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80900000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71199999999999997}]},{"osd":11,"last update":"Fri Sep 13 16:50:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.69799999999999995}]}]},{"osd":6,"up_from":46,"seq":197568495677,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":514259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.41699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":0.441},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54000000000000004,"15min":0.55700000000000005},"min":{"1min":0.32400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.48599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.73299999999999998,"15min":0.70899999999999996},"min":{"1min":0.49099999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72499999999999998,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"last":0.749},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.56599999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":0.499},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.749,"15min":0.747},"min":{"1min":0.47599999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.65500000000000003,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Sep 13 16:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81399999999999995,"15min":0.80000000000000004},"min":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.78600000000000003,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.71799999999999997}]},{"osd":8,"last update":"Fri Sep 13 16:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.78400000000000003,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.83799999999999997,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.7999999999999998,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":0.79800000000000004}]},{"osd":9,"last update":"Fri Sep 13 16:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.8719999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.871,"15min":0.877},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.86199999999999999}]},{"osd":10,"last update":"Fri Sep 13 16:51:12 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.91400000000000003,"15min":0.91300000000000003},"min":{"1min":0.70699999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.7589999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.875},{"interface":"front","average":{"1min":0.997,"5min":0.93200000000000005,"15min":0.92900000000000005},"min":{"1min":0.71999999999999997,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.90900000000000003}]},{"osd":11,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.93400000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28648,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716504,"statfs":{"total":95995035648,"available":95965700096,"internally_reserved":0,"allocated":1671168,"data_stored":1110594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57299999999999995,"15min":0.52400000000000002},"min":{"1min":0.34399999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":3.488,"15min":3.488},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83399999999999996,"5min":1.579,"15min":1.579},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66100000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.54400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39300000000000002,"15min":0.375},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.68300000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83399999999999996,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.79200000000000004,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59899999999999998,"15min":0.55500000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83799999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.622},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76200000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Sep 13 16:50:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.624,"15min":0.60999999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0580000000000001,"5min":1.881,"15min":1.881},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61199999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.495}]},{"osd":7,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68200000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.62,"15min":0.59399999999999997},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80900000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.745}]},{"osd":8,"last update":"Fri Sep 13 16:51:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.502,"15min":0.49299999999999999},"min":{"1min":0.40200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70599999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73499999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63500000000000001}]},{"osd":9,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.70599999999999996},"min":{"1min":0.47199999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.78800000000000003,"5min":3.5350000000000001,"15min":3.5350000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89500000000000002,"5min":1.111,"15min":1.111},"last":0.55500000000000005}]},{"osd":10,"last update":"Fri Sep 13 16:51:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69299999999999995,"15min":0.69199999999999995},"min":{"1min":0.47099999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81599999999999995,"5min":1.006,"15min":1.006},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.70199999999999996},"min":{"1min":0.51700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.83399999999999996,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.78100000000000003}]}]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1130496,"data_stored":581372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72499999999999998,"5min":0.879,"15min":0.879},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.37,"15min":0.34999999999999998},"min":{"1min":0.26700000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59699999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.437},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.52000000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.46500000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66800000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79200000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77900000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80300000000000005,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Sep 13 16:51:12 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58699999999999997,"15min":0.55300000000000005},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.53800000000000003},"min":{"1min":0.48499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66700000000000004,"5min":1.004,"15min":1.004},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Sep 13 16:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.623,"15min":0.628},"min":{"1min":0.40999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.75}]},{"osd":7,"last update":"Fri Sep 13 16:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49099999999999999,"15min":0.497},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.505},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.751,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.69899999999999995}]},{"osd":8,"last update":"Fri Sep 13 16:51:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.60999999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84399999999999997,"5min":0.872,"15min":0.872},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.53600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71899999999999997}]},{"osd":9,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.504,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85099999999999998,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.71999999999999997},"min":{"1min":0.57899999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.84999999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.81599999999999995}]},{"osd":10,"last update":"Fri Sep 13 16:51:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78100000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88800000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83699999999999997}]},{"osd":11,"last update":"Fri Sep 13 16:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.84899999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":1056768,"data_stored":514122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.42999999999999999,"15min":0.38200000000000001},"min":{"1min":0.29999999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.48199999999999998,"15min":0.44},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.61899999999999999,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64200000000000002,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65100000000000002,"15min":0.59099999999999997},"min":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.625},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.69899999999999995,"15min":0.63500000000000001},"min":{"1min":0.56100000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.048,"5min":3.048,"15min":3.048},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Sep 13 16:50:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.73099999999999998,"15min":0.65000000000000002},"min":{"1min":0.60599999999999998,"5min":0.371,"15min":0.371},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.66200000000000003,"15min":0.59599999999999997},"min":{"1min":0.47799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 16:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.58399999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.877,"15min":0.73299999999999998},"min":{"1min":0.55500000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":3.0169999999999999,"5min":8.7889999999999997,"15min":8.7889999999999997},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 16:50:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71299999999999997,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.089,"5min":3.089,"15min":3.089},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.61399999999999999,"15min":0.59399999999999997},"min":{"1min":0.48399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Sep 13 16:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.82199999999999995,"15min":0.79000000000000004},"min":{"1min":0.67700000000000005,"5min":0.497,"15min":0.497},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.73199999999999998,"15min":0.72199999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.645,"5min":2.645,"15min":2.645},"last":0.53500000000000003}]},{"osd":8,"last update":"Fri Sep 13 16:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93300000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0629999999999999,"5min":0.76700000000000002,"15min":0.71699999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":8.7639999999999993,"5min":8.7639999999999993,"15min":8.7639999999999993},"last":0.84399999999999997}]},{"osd":9,"last update":"Fri Sep 13 16:50:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.88900000000000001,"15min":0.875},"min":{"1min":0.66400000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.54700000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.89300000000000002}]},{"osd":10,"last update":"Fri Sep 13 16:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.76500000000000001,"15min":0.745},"min":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.026,"5min":0.90300000000000002,"15min":0.88500000000000001},"min":{"1min":0.76600000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.67800000000000005}]},{"osd":11,"last update":"Fri Sep 13 16:50:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.82199999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":515731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53600000000000003,"15min":0.55500000000000005},"min":{"1min":0.42199999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.78600000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.55400000000000005},"min":{"1min":0.41599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77800000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.72799999999999998}]},{"osd":1,"last update":"Fri Sep 13 16:50:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56200000000000006,"15min":0.53000000000000003},"min":{"1min":0.40600000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81899999999999995,"5min":0.873,"15min":0.873},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54100000000000004,"15min":0.50800000000000001},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69799999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Sep 13 16:51:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58099999999999996,"15min":0.56200000000000006},"min":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84699999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58999999999999997,"15min":0.57899999999999996},"min":{"1min":0.44,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82399999999999995,"5min":1.036,"15min":1.036},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:50:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.748}]},{"osd":5,"last update":"Fri Sep 13 16:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.44,"15min":0.40300000000000002},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.70599999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Sep 13 16:50:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80700000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.87},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.52200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83599999999999997,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":1.004}]},{"osd":8,"last update":"Fri Sep 13 16:51:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.876,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.35699999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81599999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.82399999999999995}]},{"osd":9,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.56899999999999995,"5min":0.502,"15min":0.502},"max":{"1min":0.89100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70399999999999996,"15min":0.69899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.88900000000000001,"5min":1.01,"15min":1.01},"last":0.88600000000000001}]},{"osd":10,"last update":"Fri Sep 13 16:51:20 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65100000000000002,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.82999999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.52600000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89600000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.98399999999999999}]},{"osd":11,"last update":"Fri Sep 13 16:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.95499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":576147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 16:50:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54900000000000004,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.82899999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56000000000000005,"15min":0.51600000000000001},"min":{"1min":0.373,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.57399999999999995,"15min":0.89800000000000002},"min":{"1min":0.44900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":10.377000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.51900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79500000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Sep 13 16:51:17 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44700000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79900000000000004,"5min":1.081,"15min":1.081},"last":0.502},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66200000000000003,"15min":0.90200000000000002},"min":{"1min":0.498,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":0.99199999999999999,"15min":10.347},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.41499999999999998,"15min":0.379},"min":{"1min":0.29899999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.372},"min":{"1min":0.33400000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.57799999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57099999999999995,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84599999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57699999999999996,"15min":0.51400000000000001},"min":{"1min":0.45100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.754,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Fri Sep 13 16:50:36 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59399999999999997,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.52800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89200000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Sep 13 16:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.45900000000000002},"min":{"1min":0.36299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67900000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.495,"15min":0.439},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.63300000000000001}]},{"osd":8,"last update":"Fri Sep 13 16:51:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64400000000000002,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85099999999999998,"5min":0.879,"15min":0.879},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67100000000000004,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96499999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72999999999999998}]},{"osd":9,"last update":"Fri Sep 13 16:50:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.53600000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.53700000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85899999999999999,"5min":1.115,"15min":1.115},"last":0.76300000000000001}]},{"osd":10,"last update":"Fri Sep 13 16:51:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85299999999999998,"5min":1.097,"15min":1.097},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41699999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73399999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65500000000000003}]},{"osd":11,"last update":"Fri Sep 13 16:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.75},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.77800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":515647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 16:50:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.60999999999999999,"15min":0.56000000000000005},"min":{"1min":0.42899999999999999,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.65100000000000002,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.34999999999999998,"15min":0.33800000000000002},"max":{"1min":1.236,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Sep 13 16:50:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67200000000000004,"15min":0.65700000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.194,"5min":1.194,"15min":2.0019999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.871},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Sep 13 16:50:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 16:50:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.60599999999999998},"min":{"1min":0.46999999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66400000000000003,"15min":0.63100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Sep 13 16:51:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.65700000000000003,"15min":0.622},"min":{"1min":0.53200000000000003,"5min":0.438,"15min":0.438},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.70999999999999996,"15min":0.67400000000000004},"min":{"1min":0.51200000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Sep 13 16:50:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66900000000000004,"15min":0.65100000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.64600000000000002,"15min":0.622},"min":{"1min":0.434,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.73499999999999999}]},{"osd":7,"last update":"Fri Sep 13 16:50:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.71799999999999997}]},{"osd":8,"last update":"Fri Sep 13 16:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.755,"15min":0.755},"min":{"1min":0.54200000000000004,"5min":0.505,"15min":0.505},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.879},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.82099999999999995,"15min":0.81499999999999995},"min":{"1min":0.61299999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.745}]},{"osd":9,"last update":"Fri Sep 13 16:50:55 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.84299999999999997},"min":{"1min":0.47299999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.79300000000000004,"15min":0.79600000000000004},"min":{"1min":0.52000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.83999999999999997}]},{"osd":10,"last update":"Fri Sep 13 16:51:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.629,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85799999999999998,"15min":0.87},"min":{"1min":0.66100000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.753}]},{"osd":11,"last update":"Fri Sep 13 16:50:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.85199999999999998,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.87,"5min":0.83599999999999997,"15min":0.82999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.82899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T16:51:27.150 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T16:51:27.150 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T16:51:27.150 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T16:51:27.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T16:51:27.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:26 smithi094 ceph-mon[35259]: from='client.25064 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:51:27.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:26 smithi144 ceph-mon[35328]: from='client.25064 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:51:27.474 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:28.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:27 smithi094 ceph-mon[35259]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T16:51:28.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:27 smithi018 ceph-mon[30981]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T16:51:28.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:27 smithi144 ceph-mon[35328]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T16:51:29.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.601+0000 7faeab200640 1 -- 172.21.15.18:0/3667535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faeac102010 msgr2=0x7faeac1023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.601+0000 7faeab200640 1 --2- 172.21.15.18:0/3667535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faeac102010 0x7faeac1023f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009930 tx=0x7fae9c02a420 comp rx=0 tx=0).stop 2024-09-13T16:51:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.601+0000 7faeab200640 1 -- 172.21.15.18:0/3667535860 shutdown_connections 2024-09-13T16:51:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.601+0000 7faeab200640 1 --2- 172.21.15.18:0/3667535860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeac107140 0x7faeac10ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.601+0000 7faeab200640 1 --2- 172.21.15.18:0/3667535860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeac1029c0 0x7faeac106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.601+0000 7faeab200640 1 --2- 172.21.15.18:0/3667535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faeac102010 0x7faeac1023f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.601+0000 7faeab200640 1 -- 172.21.15.18:0/3667535860 >> 172.21.15.18:0/3667535860 conn(0x7faeac0fda70 msgr2=0x7faeac0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.601+0000 7faeab200640 1 -- 172.21.15.18:0/3667535860 shutdown_connections 2024-09-13T16:51:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.601+0000 7faeab200640 1 -- 172.21.15.18:0/3667535860 wait complete. 2024-09-13T16:51:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeab200640 1 Processor -- start 2024-09-13T16:51:29.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeab200640 1 -- start start 2024-09-13T16:51:29.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeab200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeac102010 0x7faeac1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:29.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeab200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeac1029c0 0x7faeac198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:29.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeab200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faeac107140 0x7faeac19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:29.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeab200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac19d200 con 0x7faeac107140 2024-09-13T16:51:29.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeab200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac19d370 con 0x7faeac102010 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeab200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac19d4e0 con 0x7faeac1029c0 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeaa800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faeac107140 0x7faeac19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faea9e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeac102010 0x7faeac1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeaa800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faeac107140 0x7faeac19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45384/0 (socket says 172.21.15.18:45384) 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.602+0000 7faeaa800640 1 -- 172.21.15.18:0/3914988203 learned_addr learned my addr 172.21.15.18:0/3914988203 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.603+0000 7faea3e00640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeac1029c0 0x7faeac198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.603+0000 7faea9e00640 1 -- 172.21.15.18:0/3914988203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeac1029c0 msgr2=0x7faeac198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.603+0000 7faea9e00640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeac1029c0 0x7faeac198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.603+0000 7faea9e00640 1 -- 172.21.15.18:0/3914988203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faeac107140 msgr2=0x7faeac19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.603+0000 7faea9e00640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faeac107140 0x7faeac19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.603+0000 7faea9e00640 1 -- 172.21.15.18:0/3914988203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c009560 con 0x7faeac102010 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.603+0000 7faeaa800640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faeac107140 0x7faeac19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:29.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.603+0000 7faea9e00640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeac102010 0x7faeac1982c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae9c02a940 tx=0x7fae9c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.604+0000 7faea2a00640 1 -- 172.21.15.18:0/3914988203 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0316b0 con 0x7faeac102010 2024-09-13T16:51:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.604+0000 7faeab200640 1 -- 172.21.15.18:0/3914988203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac19d760 con 0x7faeac102010 2024-09-13T16:51:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.604+0000 7faea2a00640 1 -- 172.21.15.18:0/3914988203 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae9c031cd0 con 0x7faeac102010 2024-09-13T16:51:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.604+0000 7faea2a00640 1 -- 172.21.15.18:0/3914988203 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c03bd40 con 0x7faeac102010 2024-09-13T16:51:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.604+0000 7faeab200640 1 -- 172.21.15.18:0/3914988203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac1a4eb0 con 0x7faeac102010 2024-09-13T16:51:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.605+0000 7faeab200640 1 -- 172.21.15.18:0/3914988203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac1034f0 con 0x7faeac102010 2024-09-13T16:51:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.607+0000 7faea2a00640 1 -- 172.21.15.18:0/3914988203 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fae9c03b460 con 0x7faeac102010 2024-09-13T16:51:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.609+0000 7faea2a00640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fae900a1070 0x7fae900a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.609+0000 7faea2a00640 1 -- 172.21.15.18:0/3914988203 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fae9c0ed720 con 0x7faeac102010 2024-09-13T16:51:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.609+0000 7faea3e00640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fae900a1070 0x7fae900a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.609+0000 7faea3e00640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fae900a1070 0x7fae900a3530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faeac199870 tx=0x7fae9400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:29.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.611+0000 7faea2a00640 1 -- 172.21.15.18:0/3914988203 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fae9c0b6ba0 con 0x7faeac102010 2024-09-13T16:51:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.827+0000 7faeab200640 1 -- 172.21.15.18:0/3914988203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faeac199680 con 0x7faeac102010 2024-09-13T16:51:29.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.828+0000 7faea2a00640 1 -- 172.21.15.18:0/3914988203 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fae9c0ba1c0 con 0x7faeac102010 2024-09-13T16:51:29.830 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:29.830 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T16:51:29.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 -- 172.21.15.18:0/3914988203 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fae900a1070 msgr2=0x7fae900a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fae900a1070 0x7fae900a3530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faeac199870 tx=0x7fae9400b390 comp rx=0 tx=0).stop 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 -- 172.21.15.18:0/3914988203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeac102010 msgr2=0x7faeac1982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeac102010 0x7faeac1982c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae9c02a940 tx=0x7fae9c003c10 comp rx=0 tx=0).stop 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 -- 172.21.15.18:0/3914988203 shutdown_connections 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fae900a1070 0x7fae900a3530 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faeac107140 0x7faeac19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeac1029c0 0x7faeac198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 --2- 172.21.15.18:0/3914988203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faeac102010 0x7faeac1982c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 -- 172.21.15.18:0/3914988203 >> 172.21.15.18:0/3914988203 conn(0x7faeac0fda70 msgr2=0x7faeac0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 -- 172.21.15.18:0/3914988203 shutdown_connections 2024-09-13T16:51:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:29.831+0000 7faeab200640 1 -- 172.21.15.18:0/3914988203 wait complete. 2024-09-13T16:51:30.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:29 smithi094 ceph-mon[35259]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:30.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:29 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3914988203' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T16:51:30.208 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:29 smithi018 ceph-mon[30981]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:30.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:29 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3914988203' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T16:51:30.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:29 smithi144 ceph-mon[35328]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:30.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:29 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3914988203' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T16:51:30.591 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T16:51:30.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:51:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.750+0000 7ffafb200640 1 -- 172.21.15.18:0/125638123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc102fb0 msgr2=0x7ffafc103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.750+0000 7ffafb200640 1 --2- 172.21.15.18:0/125638123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc102fb0 0x7ffafc103430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009860 tx=0x7ffae402a340 comp rx=0 tx=0).stop 2024-09-13T16:51:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.750+0000 7ffafb200640 1 -- 172.21.15.18:0/125638123 shutdown_connections 2024-09-13T16:51:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.750+0000 7ffafb200640 1 --2- 172.21.15.18:0/125638123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffafc103970 0x7ffafc10a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.750+0000 7ffafb200640 1 --2- 172.21.15.18:0/125638123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc102fb0 0x7ffafc103430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.750+0000 7ffafb200640 1 --2- 172.21.15.18:0/125638123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffafc101dc0 0x7ffafc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.750+0000 7ffafb200640 1 -- 172.21.15.18:0/125638123 >> 172.21.15.18:0/125638123 conn(0x7ffafc0fd540 msgr2=0x7ffafc0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.750+0000 7ffafb200640 1 -- 172.21.15.18:0/125638123 shutdown_connections 2024-09-13T16:51:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.750+0000 7ffafb200640 1 -- 172.21.15.18:0/125638123 wait complete. 2024-09-13T16:51:30.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.751+0000 7ffafb200640 1 Processor -- start 2024-09-13T16:51:30.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.751+0000 7ffafb200640 1 -- start start 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafb200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffafc101dc0 0x7ffafc197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafb200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffafc102fb0 0x7ffafc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc103970 0x7ffafc19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafb200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc19f910 con 0x7ffafc101dc0 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafb200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc19fa80 con 0x7ffafc102fb0 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc19fc40 con 0x7ffafc103970 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffaf9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffafc101dc0 0x7ffafc197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffaf9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffafc101dc0 0x7ffafc197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45416/0 (socket says 172.21.15.18:45416) 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffaf9e00640 1 -- 172.21.15.18:0/3551484616 learned_addr learned my addr 172.21.15.18:0/3551484616 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffaf3e00640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffafc102fb0 0x7ffafc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafa800640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc103970 0x7ffafc19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafa800640 1 -- 172.21.15.18:0/3551484616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffafc102fb0 msgr2=0x7ffafc198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafa800640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffafc102fb0 0x7ffafc198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafa800640 1 -- 172.21.15.18:0/3551484616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffafc101dc0 msgr2=0x7ffafc197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafa800640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffafc101dc0 0x7ffafc197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffafa800640 1 -- 172.21.15.18:0/3551484616 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf4009900 con 0x7ffafc103970 2024-09-13T16:51:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.752+0000 7ffaf9e00640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffafc101dc0 0x7ffafc197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.753+0000 7ffafa800640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc103970 0x7ffafc19f3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400efc0 tx=0x7ffaf400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.753+0000 7ffaf2a00640 1 -- 172.21.15.18:0/3551484616 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4003970 con 0x7ffafc103970 2024-09-13T16:51:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.753+0000 7ffaf2a00640 1 -- 172.21.15.18:0/3551484616 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffaf4004020 con 0x7ffafc103970 2024-09-13T16:51:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.753+0000 7ffafb200640 1 -- 172.21.15.18:0/3551484616 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae4009490 con 0x7ffafc103970 2024-09-13T16:51:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.753+0000 7ffaf2a00640 1 -- 172.21.15.18:0/3551484616 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400b850 con 0x7ffafc103970 2024-09-13T16:51:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.753+0000 7ffafb200640 1 -- 172.21.15.18:0/3551484616 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffafc1a0210 con 0x7ffafc103970 2024-09-13T16:51:30.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.754+0000 7ffafb200640 1 -- 172.21.15.18:0/3551484616 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffafc109340 con 0x7ffafc103970 2024-09-13T16:51:30.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.756+0000 7ffaf2a00640 1 -- 172.21.15.18:0/3551484616 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ffaf400a040 con 0x7ffafc103970 2024-09-13T16:51:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.757+0000 7ffaf2a00640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffae00a1110 0x7ffae00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.758+0000 7ffaf2a00640 1 -- 172.21.15.18:0/3551484616 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7ffaf40ccfd0 con 0x7ffafc103970 2024-09-13T16:51:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.758+0000 7ffaf9e00640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffae00a1110 0x7ffae00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.758+0000 7ffaf9e00640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffae00a1110 0x7ffae00a35d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0058c0 tx=0x7ffaec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.760+0000 7ffaf2a00640 1 -- 172.21.15.18:0/3551484616 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffaf40963a0 con 0x7ffafc103970 2024-09-13T16:51:30.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.957+0000 7ffafb200640 1 -- 172.21.15.18:0/3551484616 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffafc10d660 con 0x7ffafc103970 2024-09-13T16:51:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.959+0000 7ffaf2a00640 1 -- 172.21.15.18:0/3551484616 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24592 (secure 0 0 0) 0x7ffaf40999c0 con 0x7ffafc103970 2024-09-13T16:51:30.961 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:30.961 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":93,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:51:14.023061+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:51:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 -- 172.21.15.18:0/3551484616 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffae00a1110 msgr2=0x7ffae00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffae00a1110 0x7ffae00a35d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0058c0 tx=0x7ffaec005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 -- 172.21.15.18:0/3551484616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc103970 msgr2=0x7ffafc19f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc103970 0x7ffafc19f3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400efc0 tx=0x7ffaf400c800 comp rx=0 tx=0).stop 2024-09-13T16:51:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 -- 172.21.15.18:0/3551484616 shutdown_connections 2024-09-13T16:51:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc103970 0x7ffafc19f3d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffafc102fb0 0x7ffafc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffae00a1110 0x7ffae00a35d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 --2- 172.21.15.18:0/3551484616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffafc101dc0 0x7ffafc197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 -- 172.21.15.18:0/3551484616 >> 172.21.15.18:0/3551484616 conn(0x7ffafc0fd540 msgr2=0x7ffafc106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 -- 172.21.15.18:0/3551484616 shutdown_connections 2024-09-13T16:51:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:30.961+0000 7ffafb200640 1 -- 172.21.15.18:0/3551484616 wait complete. 2024-09-13T16:51:30.980 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:49:26.572697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:49:27.624038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:49:30.629093+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:51:30.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:51:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.141+0000 7fd5dda00640 1 -- 172.21.15.18:0/3799869717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5d8101920 msgr2=0x7fd5d81081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.141+0000 7fd5dda00640 1 --2- 172.21.15.18:0/3799869717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5d8101920 0x7fd5d81081b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009ca0 tx=0x7fd5d002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.141+0000 7fd5dda00640 1 -- 172.21.15.18:0/3799869717 shutdown_connections 2024-09-13T16:51:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.141+0000 7fd5dda00640 1 --2- 172.21.15.18:0/3799869717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5d8101920 0x7fd5d81081b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.141+0000 7fd5dda00640 1 --2- 172.21.15.18:0/3799869717 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d8100f60 0x7fd5d81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.141+0000 7fd5dda00640 1 --2- 172.21.15.18:0/3799869717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5d80ffd70 0x7fd5d8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.141+0000 7fd5dda00640 1 -- 172.21.15.18:0/3799869717 >> 172.21.15.18:0/3799869717 conn(0x7fd5d80fb4d0 msgr2=0x7fd5d80fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:31.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.141+0000 7fd5dda00640 1 -- 172.21.15.18:0/3799869717 shutdown_connections 2024-09-13T16:51:31.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.141+0000 7fd5dda00640 1 -- 172.21.15.18:0/3799869717 wait complete. 2024-09-13T16:51:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.142+0000 7fd5dda00640 1 Processor -- start 2024-09-13T16:51:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.142+0000 7fd5dda00640 1 -- start start 2024-09-13T16:51:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5dda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5d80ffd70 0x7fd5d8197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5dda00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d8100f60 0x7fd5d81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5dda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5d8101920 0x7fd5d819f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5dda00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d819fa50 con 0x7fd5d80ffd70 2024-09-13T16:51:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5dda00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d819fbc0 con 0x7fd5d8100f60 2024-09-13T16:51:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5dda00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d819fd80 con 0x7fd5d8101920 2024-09-13T16:51:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5d80ffd70 0x7fd5d8197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5d80ffd70 0x7fd5d8197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59348/0 (socket says 172.21.15.18:59348) 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d6a00640 1 -- 172.21.15.18:0/3272115419 learned_addr learned my addr 172.21.15.18:0/3272115419 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d7400640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5d8101920 0x7fd5d819f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d6000640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d8100f60 0x7fd5d81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d6000640 1 -- 172.21.15.18:0/3272115419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5d8101920 msgr2=0x7fd5d819f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d6000640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5d8101920 0x7fd5d819f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d6000640 1 -- 172.21.15.18:0/3272115419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5d80ffd70 msgr2=0x7fd5d8197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d6000640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5d80ffd70 0x7fd5d8197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d6000640 1 -- 172.21.15.18:0/3272115419 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4009490 con 0x7fd5d8100f60 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.143+0000 7fd5d6a00640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5d80ffd70 0x7fd5d8197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.144+0000 7fd5d6000640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d8100f60 0x7fd5d81984a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e9f0 tx=0x7fd5c400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.144+0000 7fd5cf400640 1 -- 172.21.15.18:0/3272115419 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400cd80 con 0x7fd5d8100f60 2024-09-13T16:51:31.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.144+0000 7fd5cf400640 1 -- 172.21.15.18:0/3272115419 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5c40035f0 con 0x7fd5d8100f60 2024-09-13T16:51:31.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.144+0000 7fd5dda00640 1 -- 172.21.15.18:0/3272115419 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d0009900 con 0x7fd5d8100f60 2024-09-13T16:51:31.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.144+0000 7fd5cf400640 1 -- 172.21.15.18:0/3272115419 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c40044e0 con 0x7fd5d8100f60 2024-09-13T16:51:31.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.144+0000 7fd5dda00640 1 -- 172.21.15.18:0/3272115419 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d81a03e0 con 0x7fd5d8100f60 2024-09-13T16:51:31.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.145+0000 7fd5dda00640 1 -- 172.21.15.18:0/3272115419 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d810b680 con 0x7fd5d8100f60 2024-09-13T16:51:31.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.147+0000 7fd5cf400640 1 -- 172.21.15.18:0/3272115419 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd5c4003a60 con 0x7fd5d8100f60 2024-09-13T16:51:31.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.148+0000 7fd5cf400640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5bc0a1090 0x7fd5bc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.148+0000 7fd5cf400640 1 -- 172.21.15.18:0/3272115419 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fd5c4014070 con 0x7fd5d8100f60 2024-09-13T16:51:31.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.148+0000 7fd5d6a00640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5bc0a1090 0x7fd5bc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.149+0000 7fd5d6a00640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5bc0a1090 0x7fd5bc0a3550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80058c0 tx=0x7fd5c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:31.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.152+0000 7fd5cf400640 1 -- 172.21.15.18:0/3272115419 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd5c4096490 con 0x7fd5d8100f60 2024-09-13T16:51:31.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:31 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3551484616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:51:31.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.331+0000 7fd5dda00640 1 -- 172.21.15.18:0/3272115419 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5d81a0840 con 0x7fd5d8100f60 2024-09-13T16:51:31.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.332+0000 7fd5cf400640 1 -- 172.21.15.18:0/3272115419 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5c4099ab0 con 0x7fd5d8100f60 2024-09-13T16:51:31.333 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T16:51:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 -- 172.21.15.18:0/3272115419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5bc0a1090 msgr2=0x7fd5bc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5bc0a1090 0x7fd5bc0a3550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80058c0 tx=0x7fd5c8005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 -- 172.21.15.18:0/3272115419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d8100f60 msgr2=0x7fd5d81984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d8100f60 0x7fd5d81984a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e9f0 tx=0x7fd5c400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 -- 172.21.15.18:0/3272115419 shutdown_connections 2024-09-13T16:51:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5d8101920 0x7fd5d819f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5d8100f60 0x7fd5d81984a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd5bc0a1090 0x7fd5bc0a3550 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 --2- 172.21.15.18:0/3272115419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5d80ffd70 0x7fd5d8197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 -- 172.21.15.18:0/3272115419 >> 172.21.15.18:0/3272115419 conn(0x7fd5d80fb4d0 msgr2=0x7fd5d8106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:31.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 -- 172.21.15.18:0/3272115419 shutdown_connections 2024-09-13T16:51:31.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.334+0000 7fd5dda00640 1 -- 172.21.15.18:0/3272115419 wait complete. 2024-09-13T16:51:31.349 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:31 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3551484616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:51:31.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:51:31.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:31 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3551484616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:51:31.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.514+0000 7f8343c00640 1 -- 172.21.15.18:0/1014391393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f833c072f10 msgr2=0x7f833c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.514+0000 7f8343c00640 1 --2- 172.21.15.18:0/1014391393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f833c072f10 0x7f833c073370 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8328009900 tx=0x7f832802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.514+0000 7f8343c00640 1 -- 172.21.15.18:0/1014391393 shutdown_connections 2024-09-13T16:51:31.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.514+0000 7f8343c00640 1 --2- 172.21.15.18:0/1014391393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f833c072f10 0x7f833c073370 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.514+0000 7f8343c00640 1 --2- 172.21.15.18:0/1014391393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f833c10c340 0x7f833c10e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.514+0000 7f8343c00640 1 --2- 172.21.15.18:0/1014391393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f833c0744f0 0x7f833c072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.514+0000 7f8343c00640 1 -- 172.21.15.18:0/1014391393 >> 172.21.15.18:0/1014391393 conn(0x7f833c0fb4d0 msgr2=0x7f833c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:31.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.514+0000 7f8343c00640 1 -- 172.21.15.18:0/1014391393 shutdown_connections 2024-09-13T16:51:31.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.514+0000 7f8343c00640 1 -- 172.21.15.18:0/1014391393 wait complete. 2024-09-13T16:51:31.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.515+0000 7f8343c00640 1 Processor -- start 2024-09-13T16:51:31.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.515+0000 7f8343c00640 1 -- start start 2024-09-13T16:51:31.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.515+0000 7f8343c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f833c072f10 0x7f833c19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f8343c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f833c0744f0 0x7f833c19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f8343c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f833c10c340 0x7f833c1a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f8343c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c1a3eb0 con 0x7f833c0744f0 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f8343c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c1a4020 con 0x7f833c10c340 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f8343c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c1a41e0 con 0x7f833c072f10 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f833be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f833c0744f0 0x7f833c19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f833be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f833c0744f0 0x7f833c19c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59374/0 (socket says 172.21.15.18:59374) 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f833be00640 1 -- 172.21.15.18:0/1157892427 learned_addr learned my addr 172.21.15.18:0/1157892427 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f8341200640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f833c072f10 0x7f833c19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f8341c00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f833c10c340 0x7f833c1a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f833be00640 1 -- 172.21.15.18:0/1157892427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f833c072f10 msgr2=0x7f833c19c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f833be00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f833c072f10 0x7f833c19c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f833be00640 1 -- 172.21.15.18:0/1157892427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f833c10c340 msgr2=0x7f833c1a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f833be00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f833c10c340 0x7f833c1a3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f833be00640 1 -- 172.21.15.18:0/1157892427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8328009560 con 0x7f833c0744f0 2024-09-13T16:51:31.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.516+0000 7f8341c00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f833c10c340 0x7f833c1a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:31.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.517+0000 7f833be00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f833c0744f0 0x7f833c19c900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f83280057c0 tx=0x7f83280055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:31.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.517+0000 7f8339600640 1 -- 172.21.15.18:0/1157892427 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328004b50 con 0x7f833c0744f0 2024-09-13T16:51:31.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.517+0000 7f8339600640 1 -- 172.21.15.18:0/1157892427 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8328004cb0 con 0x7f833c0744f0 2024-09-13T16:51:31.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.517+0000 7f8343c00640 1 -- 172.21.15.18:0/1157892427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833c1a4460 con 0x7f833c0744f0 2024-09-13T16:51:31.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.517+0000 7f8339600640 1 -- 172.21.15.18:0/1157892427 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328031a60 con 0x7f833c0744f0 2024-09-13T16:51:31.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.517+0000 7f8343c00640 1 -- 172.21.15.18:0/1157892427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c1a4960 con 0x7f833c0744f0 2024-09-13T16:51:31.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.518+0000 7f8343c00640 1 -- 172.21.15.18:0/1157892427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c102510 con 0x7f833c0744f0 2024-09-13T16:51:31.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.520+0000 7f8339600640 1 -- 172.21.15.18:0/1157892427 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8328031bc0 con 0x7f833c0744f0 2024-09-13T16:51:31.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.521+0000 7f8339600640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f83240a1110 0x7f83240a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.521+0000 7f8339600640 1 -- 172.21.15.18:0/1157892427 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f83280edad0 con 0x7f833c0744f0 2024-09-13T16:51:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.521+0000 7f8341200640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f83240a1110 0x7f83240a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.522+0000 7f8341200640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f83240a1110 0x7f83240a35d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8330009bd0 tx=0x7f8330005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:31.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.525+0000 7f8339600640 1 -- 172.21.15.18:0/1157892427 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83280b6f50 con 0x7f833c0744f0 2024-09-13T16:51:31.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.705+0000 7f8343c00640 1 -- 172.21.15.18:0/1157892427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f833c101f80 con 0x7f833c0744f0 2024-09-13T16:51:31.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.706+0000 7f8339600640 1 -- 172.21.15.18:0/1157892427 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f83280ba570 con 0x7f833c0744f0 2024-09-13T16:51:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:51:31.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 -- 172.21.15.18:0/1157892427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f83240a1110 msgr2=0x7f83240a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f83240a1110 0x7f83240a35d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8330009bd0 tx=0x7f8330005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:31.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 -- 172.21.15.18:0/1157892427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f833c0744f0 msgr2=0x7f833c19c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f833c0744f0 0x7f833c19c900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f83280057c0 tx=0x7f83280055a0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 -- 172.21.15.18:0/1157892427 shutdown_connections 2024-09-13T16:51:31.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f83240a1110 0x7f83240a35d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f833c0744f0 0x7f833c19c900 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f833c10c340 0x7f833c1a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 --2- 172.21.15.18:0/1157892427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f833c072f10 0x7f833c19c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 -- 172.21.15.18:0/1157892427 >> 172.21.15.18:0/1157892427 conn(0x7f833c0fb4d0 msgr2=0x7f833c0ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:31.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 -- 172.21.15.18:0/1157892427 shutdown_connections 2024-09-13T16:51:31.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.709+0000 7f8343c00640 1 -- 172.21.15.18:0/1157892427 wait complete. 2024-09-13T16:51:31.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:51:31.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.886+0000 7f5188600640 1 -- 172.21.15.18:0/3623947664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5180103b30 msgr2=0x7f518010a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.886+0000 7f5188600640 1 --2- 172.21.15.18:0/3623947664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5180103b30 0x7f518010a3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5178009ca0 tx=0x7f517802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.886+0000 7f5188600640 1 -- 172.21.15.18:0/3623947664 shutdown_connections 2024-09-13T16:51:31.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.886+0000 7f5188600640 1 --2- 172.21.15.18:0/3623947664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5180103b30 0x7f518010a3c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.886+0000 7f5188600640 1 --2- 172.21.15.18:0/3623947664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5180103170 0x7f51801035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.886+0000 7f5188600640 1 --2- 172.21.15.18:0/3623947664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5180101f80 0x7f5180102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.886+0000 7f5188600640 1 -- 172.21.15.18:0/3623947664 >> 172.21.15.18:0/3623947664 conn(0x7f51800fd700 msgr2=0x7f51800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:31.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.886+0000 7f5188600640 1 -- 172.21.15.18:0/3623947664 shutdown_connections 2024-09-13T16:51:31.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.886+0000 7f5188600640 1 -- 172.21.15.18:0/3623947664 wait complete. 2024-09-13T16:51:31.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.887+0000 7f5188600640 1 Processor -- start 2024-09-13T16:51:31.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.887+0000 7f5188600640 1 -- start start 2024-09-13T16:51:31.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5188600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5180101f80 0x7f5180197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5188600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5180103170 0x7f51801984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5188600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5180103b30 0x7f518019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5188600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518019fa40 con 0x7f5180101f80 2024-09-13T16:51:31.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5188600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518019fbb0 con 0x7f5180103b30 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5188600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518019fd70 con 0x7f5180103170 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5185c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5180101f80 0x7f5180197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5185200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5180103170 0x7f51801984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5185c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5180101f80 0x7f5180197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59404/0 (socket says 172.21.15.18:59404) 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5185c00640 1 -- 172.21.15.18:0/2689157897 learned_addr learned my addr 172.21.15.18:0/2689157897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5186600640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5180103b30 0x7f518019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5185c00640 1 -- 172.21.15.18:0/2689157897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5180103170 msgr2=0x7f51801984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5185c00640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5180103170 0x7f51801984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5185c00640 1 -- 172.21.15.18:0/2689157897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5180103b30 msgr2=0x7f518019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5185c00640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5180103b30 0x7f518019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.888+0000 7f5185c00640 1 -- 172.21.15.18:0/2689157897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5178009900 con 0x7f5180101f80 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.889+0000 7f5185c00640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5180101f80 0x7f5180197fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f517400e9c0 tx=0x7f517400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.889+0000 7f517e000640 1 -- 172.21.15.18:0/2689157897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51740096e0 con 0x7f5180101f80 2024-09-13T16:51:31.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.889+0000 7f517e000640 1 -- 172.21.15.18:0/2689157897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51740044f0 con 0x7f5180101f80 2024-09-13T16:51:31.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.889+0000 7f5188600640 1 -- 172.21.15.18:0/2689157897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518019fff0 con 0x7f5180101f80 2024-09-13T16:51:31.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.889+0000 7f517e000640 1 -- 172.21.15.18:0/2689157897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174010430 con 0x7f5180101f80 2024-09-13T16:51:31.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.889+0000 7f5188600640 1 -- 172.21.15.18:0/2689157897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51801a0470 con 0x7f5180101f80 2024-09-13T16:51:31.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.890+0000 7f5188600640 1 -- 172.21.15.18:0/2689157897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51801093c0 con 0x7f5180101f80 2024-09-13T16:51:31.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.892+0000 7f517e000640 1 -- 172.21.15.18:0/2689157897 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f51740035f0 con 0x7f5180101f80 2024-09-13T16:51:31.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.893+0000 7f517e000640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51680a1110 0x7f51680a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:31.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.893+0000 7f517e000640 1 -- 172.21.15.18:0/2689157897 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f5174014070 con 0x7f5180101f80 2024-09-13T16:51:31.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.893+0000 7f5185200640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51680a1110 0x7f51680a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:31.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.894+0000 7f5185200640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51680a1110 0x7f51680a35d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5180199460 tx=0x7f516c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:31.897+0000 7f517e000640 1 -- 172.21.15.18:0/2689157897 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f51740d0030 con 0x7f5180101f80 2024-09-13T16:51:32.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.081+0000 7f5188600640 1 -- 172.21.15.18:0/2689157897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f518002c4e0 con 0x7f5180101f80 2024-09-13T16:51:32.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.081+0000 7f517e000640 1 -- 172.21.15.18:0/2689157897 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5174099e30 con 0x7f5180101f80 2024-09-13T16:51:32.083 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-13T16:51:32.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.083+0000 7f5188600640 1 -- 172.21.15.18:0/2689157897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51680a1110 msgr2=0x7f51680a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.083+0000 7f5188600640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51680a1110 0x7f51680a35d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5180199460 tx=0x7f516c005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:32.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.083+0000 7f5188600640 1 -- 172.21.15.18:0/2689157897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5180101f80 msgr2=0x7f5180197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.083+0000 7f5188600640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5180101f80 0x7f5180197fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f517400e9c0 tx=0x7f517400ee80 comp rx=0 tx=0).stop 2024-09-13T16:51:32.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.084+0000 7f5188600640 1 -- 172.21.15.18:0/2689157897 shutdown_connections 2024-09-13T16:51:32.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.084+0000 7f5188600640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5180103b30 0x7f518019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.084+0000 7f5188600640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5180103170 0x7f51801984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.084+0000 7f5188600640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f51680a1110 0x7f51680a35d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.084+0000 7f5188600640 1 --2- 172.21.15.18:0/2689157897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5180101f80 0x7f5180197fa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.084+0000 7f5188600640 1 -- 172.21.15.18:0/2689157897 >> 172.21.15.18:0/2689157897 conn(0x7f51800fd700 msgr2=0x7f5180106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:32.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.084+0000 7f5188600640 1 -- 172.21.15.18:0/2689157897 shutdown_connections 2024-09-13T16:51:32.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.084+0000 7f5188600640 1 -- 172.21.15.18:0/2689157897 wait complete. 2024-09-13T16:51:32.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:51:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.262+0000 7f6240a00640 1 -- 172.21.15.18:0/2714309993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f623c103170 msgr2=0x7f623c1035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.262+0000 7f6240a00640 1 --2- 172.21.15.18:0/2714309993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f623c103170 0x7f623c1035f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6224009900 tx=0x7f622402a410 comp rx=0 tx=0).stop 2024-09-13T16:51:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.262+0000 7f6240a00640 1 -- 172.21.15.18:0/2714309993 shutdown_connections 2024-09-13T16:51:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.262+0000 7f6240a00640 1 --2- 172.21.15.18:0/2714309993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f623c103170 0x7f623c1035f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.262+0000 7f6240a00640 1 --2- 172.21.15.18:0/2714309993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f623c103b30 0x7f623c10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.262+0000 7f6240a00640 1 --2- 172.21.15.18:0/2714309993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f623c101f80 0x7f623c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.262+0000 7f6240a00640 1 -- 172.21.15.18:0/2714309993 >> 172.21.15.18:0/2714309993 conn(0x7f623c0fd700 msgr2=0x7f623c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.262+0000 7f6240a00640 1 -- 172.21.15.18:0/2714309993 shutdown_connections 2024-09-13T16:51:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.262+0000 7f6240a00640 1 -- 172.21.15.18:0/2714309993 wait complete. 2024-09-13T16:51:32.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.263+0000 7f6240a00640 1 Processor -- start 2024-09-13T16:51:32.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.263+0000 7f6240a00640 1 -- start start 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.263+0000 7f6240a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f623c101f80 0x7f623c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.263+0000 7f6240a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f623c103170 0x7f623c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.263+0000 7f6240a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f623c103b30 0x7f623c19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6240a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c19fa30 con 0x7f623c103170 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6240a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c19fba0 con 0x7f623c103b30 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6240a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c19fd60 con 0x7f623c101f80 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6231400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f623c103170 0x7f623c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6231400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f623c103170 0x7f623c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59420/0 (socket says 172.21.15.18:59420) 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6231400640 1 -- 172.21.15.18:0/2693483412 learned_addr learned my addr 172.21.15.18:0/2693483412 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f623a800640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f623c103b30 0x7f623c19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6239e00640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f623c101f80 0x7f623c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6231400640 1 -- 172.21.15.18:0/2693483412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f623c101f80 msgr2=0x7f623c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6231400640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f623c101f80 0x7f623c197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6231400640 1 -- 172.21.15.18:0/2693483412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f623c103b30 msgr2=0x7f623c19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6231400640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f623c103b30 0x7f623c19f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6231400640 1 -- 172.21.15.18:0/2693483412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6224009560 con 0x7f623c103170 2024-09-13T16:51:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.264+0000 7f6231400640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f623c103170 0x7f623c198480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6224009a20 tx=0x7f6224005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.265+0000 7f6233400640 1 -- 172.21.15.18:0/2693483412 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224004c10 con 0x7f623c103170 2024-09-13T16:51:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.265+0000 7f6233400640 1 -- 172.21.15.18:0/2693483412 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6224004d70 con 0x7f623c103170 2024-09-13T16:51:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.265+0000 7f6240a00640 1 -- 172.21.15.18:0/2693483412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c19ffe0 con 0x7f623c103170 2024-09-13T16:51:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.265+0000 7f6233400640 1 -- 172.21.15.18:0/2693483412 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224031ae0 con 0x7f623c103170 2024-09-13T16:51:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.265+0000 7f6240a00640 1 -- 172.21.15.18:0/2693483412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c1a0410 con 0x7f623c103170 2024-09-13T16:51:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.266+0000 7f6240a00640 1 -- 172.21.15.18:0/2693483412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c1093e0 con 0x7f623c103170 2024-09-13T16:51:32.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.268+0000 7f6233400640 1 -- 172.21.15.18:0/2693483412 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6224031c40 con 0x7f623c103170 2024-09-13T16:51:32.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.269+0000 7f6233400640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f62200a1110 0x7f62200a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:32.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.269+0000 7f6233400640 1 -- 172.21.15.18:0/2693483412 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f62240ede90 con 0x7f623c103170 2024-09-13T16:51:32.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.269+0000 7f6239e00640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f62200a1110 0x7f62200a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:32.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.270+0000 7f6239e00640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f62200a1110 0x7f62200a35d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f623c102fd0 tx=0x7f622c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:32.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:32 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3272115419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:51:32.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:32 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1157892427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:51:32.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:32 smithi144 ceph-mon[35328]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:32.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.271+0000 7f6233400640 1 -- 172.21.15.18:0/2693483412 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f62240b7310 con 0x7f623c103170 2024-09-13T16:51:32.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:32 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3272115419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:51:32.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:32 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1157892427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:51:32.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:32 smithi094 ceph-mon[35259]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:32.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:32 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3272115419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:51:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:32 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1157892427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:51:32.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:32 smithi018 ceph-mon[30981]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:32.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.465+0000 7f6240a00640 1 -- 172.21.15.18:0/2693483412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f623c02c3e0 con 0x7f623c103170 2024-09-13T16:51:32.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.466+0000 7f6233400640 1 -- 172.21.15.18:0/2693483412 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f62240400a0 con 0x7f623c103170 2024-09-13T16:51:32.467 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:51:32.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 -- 172.21.15.18:0/2693483412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f62200a1110 msgr2=0x7f62200a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f62200a1110 0x7f62200a35d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f623c102fd0 tx=0x7f622c005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:32.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 -- 172.21.15.18:0/2693483412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f623c103170 msgr2=0x7f623c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f623c103170 0x7f623c198480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6224009a20 tx=0x7f6224005620 comp rx=0 tx=0).stop 2024-09-13T16:51:32.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 -- 172.21.15.18:0/2693483412 shutdown_connections 2024-09-13T16:51:32.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f62200a1110 0x7f62200a35d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f623c103170 0x7f623c198480 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f623c103b30 0x7f623c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 --2- 172.21.15.18:0/2693483412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f623c101f80 0x7f623c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 -- 172.21.15.18:0/2693483412 >> 172.21.15.18:0/2693483412 conn(0x7f623c0fd700 msgr2=0x7f623c1065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:32.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 -- 172.21.15.18:0/2693483412 shutdown_connections 2024-09-13T16:51:32.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.468+0000 7f6240a00640 1 -- 172.21.15.18:0/2693483412 wait complete. 2024-09-13T16:51:32.486 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:51:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.641+0000 7fbd2e000640 1 -- 172.21.15.18:0/1999909589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd28102fa0 msgr2=0x7fbd28103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.641+0000 7fbd2e000640 1 --2- 172.21.15.18:0/1999909589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd28102fa0 0x7fbd28103420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009900 tx=0x7fbd1402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.641+0000 7fbd2e000640 1 -- 172.21.15.18:0/1999909589 shutdown_connections 2024-09-13T16:51:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.641+0000 7fbd2e000640 1 --2- 172.21.15.18:0/1999909589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd28102fa0 0x7fbd28103420 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.641+0000 7fbd2e000640 1 --2- 172.21.15.18:0/1999909589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd28103960 0x7fbd2810a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.641+0000 7fbd2e000640 1 --2- 172.21.15.18:0/1999909589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd28101db0 0x7fbd281021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.641+0000 7fbd2e000640 1 -- 172.21.15.18:0/1999909589 >> 172.21.15.18:0/1999909589 conn(0x7fbd280fd530 msgr2=0x7fbd280ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.641+0000 7fbd2e000640 1 -- 172.21.15.18:0/1999909589 shutdown_connections 2024-09-13T16:51:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.641+0000 7fbd2e000640 1 -- 172.21.15.18:0/1999909589 wait complete. 2024-09-13T16:51:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd2e000640 1 Processor -- start 2024-09-13T16:51:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd2e000640 1 -- start start 2024-09-13T16:51:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd2e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd28101db0 0x7fbd28197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd2e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd28102fa0 0x7fbd281982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd2e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd28103960 0x7fbd2819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd2e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2819f880 con 0x7fbd28102fa0 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd2e000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2819f9f0 con 0x7fbd28101db0 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd2e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2819fbb0 con 0x7fbd28103960 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd27e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd28102fa0 0x7fbd281982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd27e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd28102fa0 0x7fbd281982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59432/0 (socket says 172.21.15.18:59432) 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd27e00640 1 -- 172.21.15.18:0/1889061238 learned_addr learned my addr 172.21.15.18:0/1889061238 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd2cc00640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd28101db0 0x7fbd28197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.642+0000 7fbd2d600640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd28103960 0x7fbd2819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd27e00640 1 -- 172.21.15.18:0/1889061238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd28103960 msgr2=0x7fbd2819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd27e00640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd28103960 0x7fbd2819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd27e00640 1 -- 172.21.15.18:0/1889061238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd28101db0 msgr2=0x7fbd28197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd27e00640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd28101db0 0x7fbd28197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd27e00640 1 -- 172.21.15.18:0/1889061238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd20009840 con 0x7fbd28102fa0 2024-09-13T16:51:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd27e00640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd28102fa0 0x7fbd281982e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009a20 tx=0x7fbd14005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd25600640 1 -- 172.21.15.18:0/1889061238 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14004b50 con 0x7fbd28102fa0 2024-09-13T16:51:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd25600640 1 -- 172.21.15.18:0/1889061238 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd14004cb0 con 0x7fbd28102fa0 2024-09-13T16:51:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd25600640 1 -- 172.21.15.18:0/1889061238 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd140319c0 con 0x7fbd28102fa0 2024-09-13T16:51:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd2e000640 1 -- 172.21.15.18:0/1889061238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd14009560 con 0x7fbd28102fa0 2024-09-13T16:51:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.643+0000 7fbd2e000640 1 -- 172.21.15.18:0/1889061238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd281a0100 con 0x7fbd28102fa0 2024-09-13T16:51:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.644+0000 7fbd2e000640 1 -- 172.21.15.18:0/1889061238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd281092e0 con 0x7fbd28102fa0 2024-09-13T16:51:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.646+0000 7fbd25600640 1 -- 172.21.15.18:0/1889061238 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbd14031b20 con 0x7fbd28102fa0 2024-09-13T16:51:32.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.648+0000 7fbd25600640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbd100a1090 0x7fbd100a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:32.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.648+0000 7fbd25600640 1 -- 172.21.15.18:0/1889061238 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fbd140edff0 con 0x7fbd28102fa0 2024-09-13T16:51:32.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.648+0000 7fbd2cc00640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbd100a1090 0x7fbd100a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:32.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.649+0000 7fbd2cc00640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbd100a1090 0x7fbd100a3550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd28199270 tx=0x7fbd1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.650+0000 7fbd25600640 1 -- 172.21.15.18:0/1889061238 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbd140b7350 con 0x7fbd28102fa0 2024-09-13T16:51:32.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.867+0000 7fbd2e000640 1 -- 172.21.15.18:0/1889061238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd2810d670 con 0x7fbd28102fa0 2024-09-13T16:51:32.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.868+0000 7fbd25600640 1 -- 172.21.15.18:0/1889061238 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10852 (secure 0 0 0) 0x7fbd140b9280 con 0x7fbd28102fa0 2024-09-13T16:51:32.869 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:32.870 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:49:28.080578+0000","modified":"2024-09-13T16:49:57.790808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24590,"mds_1":24566,"mds_2":24539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24539":{"gid":24539,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:51:32.870 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 24 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.870+0000 7fbd2e000640 1 -- 172.21.15.18:0/1889061238 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbd100a1090 msgr2=0x7fbd100a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.870+0000 7fbd2e000640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbd100a1090 0x7fbd100a3550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd28199270 tx=0x7fbd1c005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.870+0000 7fbd2e000640 1 -- 172.21.15.18:0/1889061238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd28102fa0 msgr2=0x7fbd281982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.870+0000 7fbd2e000640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd28102fa0 0x7fbd281982e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009a20 tx=0x7fbd14005620 comp rx=0 tx=0).stop 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.870+0000 7fbd2e000640 1 -- 172.21.15.18:0/1889061238 shutdown_connections 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.870+0000 7fbd2e000640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fbd100a1090 0x7fbd100a3550 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.870+0000 7fbd2e000640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd28102fa0 0x7fbd281982e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.870+0000 7fbd2e000640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd28103960 0x7fbd2819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.870+0000 7fbd2e000640 1 --2- 172.21.15.18:0/1889061238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd28101db0 0x7fbd28197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.870+0000 7fbd2e000640 1 -- 172.21.15.18:0/1889061238 >> 172.21.15.18:0/1889061238 conn(0x7fbd280fd530 msgr2=0x7fbd281064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.871+0000 7fbd2e000640 1 -- 172.21.15.18:0/1889061238 shutdown_connections 2024-09-13T16:51:32.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:32.871+0000 7fbd2e000640 1 -- 172.21.15.18:0/1889061238 wait complete. 2024-09-13T16:51:32.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:51:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.045+0000 7f5622200640 1 -- 172.21.15.18:0/1589659945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f561c100180 msgr2=0x7f561c107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.045+0000 7f5622200640 1 --2- 172.21.15.18:0/1589659945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f561c100180 0x7f561c107ff0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5614009ca0 tx=0x7f561402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.045+0000 7f5622200640 1 -- 172.21.15.18:0/1589659945 shutdown_connections 2024-09-13T16:51:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.045+0000 7f5622200640 1 --2- 172.21.15.18:0/1589659945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f561c100180 0x7f561c107ff0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.045+0000 7f5622200640 1 --2- 172.21.15.18:0/1589659945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c0ff7c0 0x7f561c0ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.045+0000 7f5622200640 1 --2- 172.21.15.18:0/1589659945 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f561c101290 0x7f561c101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.045+0000 7f5622200640 1 -- 172.21.15.18:0/1589659945 >> 172.21.15.18:0/1589659945 conn(0x7f561c0fb310 msgr2=0x7f561c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.045+0000 7f5622200640 1 -- 172.21.15.18:0/1589659945 shutdown_connections 2024-09-13T16:51:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.045+0000 7f5622200640 1 -- 172.21.15.18:0/1589659945 wait complete. 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.046+0000 7f5622200640 1 Processor -- start 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.046+0000 7f5622200640 1 -- start start 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f5622200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f561c0ff7c0 0x7f561c195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f5622200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f561c100180 0x7f561c196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f5622200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c101290 0x7f561c19d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f5622200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c19d700 con 0x7f561c100180 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f5622200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c19d870 con 0x7f561c0ff7c0 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f5622200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c19da30 con 0x7f561c101290 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f561be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f561c100180 0x7f561c196160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f561be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f561c100180 0x7f561c196160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59452/0 (socket says 172.21.15.18:59452) 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f561be00640 1 -- 172.21.15.18:0/3030213581 learned_addr learned my addr 172.21.15.18:0/3030213581 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f5620e00640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f561c0ff7c0 0x7f561c195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f5621800640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c101290 0x7f561c19d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f561be00640 1 -- 172.21.15.18:0/3030213581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c101290 msgr2=0x7f561c19d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f561be00640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c101290 0x7f561c19d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f561be00640 1 -- 172.21.15.18:0/3030213581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f561c0ff7c0 msgr2=0x7f561c195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f561be00640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f561c0ff7c0 0x7f561c195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f561be00640 1 -- 172.21.15.18:0/3030213581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610009490 con 0x7f561c100180 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f5621800640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c101290 0x7f561c19d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.047+0000 7f5620e00640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f561c0ff7c0 0x7f561c195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.048+0000 7f561be00640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f561c100180 0x7f561c196160 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f560800e9f0 tx=0x7f560800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.048+0000 7f5619600640 1 -- 172.21.15.18:0/3030213581 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608009720 con 0x7f561c100180 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.048+0000 7f5619600640 1 -- 172.21.15.18:0/3030213581 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f560800cd80 con 0x7f561c100180 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.048+0000 7f5619600640 1 -- 172.21.15.18:0/3030213581 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608010430 con 0x7f561c100180 2024-09-13T16:51:33.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.048+0000 7f5622200640 1 -- 172.21.15.18:0/3030213581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5614009900 con 0x7f561c100180 2024-09-13T16:51:33.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.048+0000 7f5622200640 1 -- 172.21.15.18:0/3030213581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c19e040 con 0x7f561c100180 2024-09-13T16:51:33.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.049+0000 7f5622200640 1 -- 172.21.15.18:0/3030213581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561c0ffc40 con 0x7f561c100180 2024-09-13T16:51:33.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.051+0000 7f5619600640 1 -- 172.21.15.18:0/3030213581 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5608005020 con 0x7f561c100180 2024-09-13T16:51:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.053+0000 7f5619600640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56040a1090 0x7f56040a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.053+0000 7f5619600640 1 -- 172.21.15.18:0/3030213581 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f5608014070 con 0x7f561c100180 2024-09-13T16:51:33.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.054+0000 7f5620e00640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56040a1090 0x7f56040a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.054+0000 7f5620e00640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56040a1090 0x7f56040a3550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f561c1970f0 tx=0x7f5610005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:33.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.057+0000 7f5619600640 1 -- 172.21.15.18:0/3030213581 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f56080964a0 con 0x7f561c100180 2024-09-13T16:51:33.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2689157897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:51:33.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2693483412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:51:33.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1889061238' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:51:33.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.241+0000 7f5622200640 1 -- 172.21.15.18:0/3030213581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f561c106fe0 con 0x7f561c100180 2024-09-13T16:51:33.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.242+0000 7f5619600640 1 -- 172.21.15.18:0/3030213581 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24592 (secure 0 0 0) 0x7f56080983d0 con 0x7f561c100180 2024-09-13T16:51:33.244 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:33.244 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":93,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:51:14.023061+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:51:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.244+0000 7f5622200640 1 -- 172.21.15.18:0/3030213581 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56040a1090 msgr2=0x7f56040a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.244+0000 7f5622200640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56040a1090 0x7f56040a3550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f561c1970f0 tx=0x7f5610005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.244+0000 7f5622200640 1 -- 172.21.15.18:0/3030213581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f561c100180 msgr2=0x7f561c196160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.244+0000 7f5622200640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f561c100180 0x7f561c196160 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f560800e9f0 tx=0x7f560800edf0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.245+0000 7f5622200640 1 -- 172.21.15.18:0/3030213581 shutdown_connections 2024-09-13T16:51:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.245+0000 7f5622200640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56040a1090 0x7f56040a3550 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.245+0000 7f5622200640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f561c100180 0x7f561c196160 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.245+0000 7f5622200640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c101290 0x7f561c19d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.245+0000 7f5622200640 1 --2- 172.21.15.18:0/3030213581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f561c0ff7c0 0x7f561c195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.245+0000 7f5622200640 1 -- 172.21.15.18:0/3030213581 >> 172.21.15.18:0/3030213581 conn(0x7f561c0fb310 msgr2=0x7f561c1041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.245+0000 7f5622200640 1 -- 172.21.15.18:0/3030213581 shutdown_connections 2024-09-13T16:51:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.245+0000 7f5622200640 1 -- 172.21.15.18:0/3030213581 wait complete. 2024-09-13T16:51:33.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:49:26.572697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:49:27.624038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:49:30.629093+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:51:33.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:51:33.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2689157897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:51:33.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2693483412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:51:33.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1889061238' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:51:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2689157897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:51:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2693483412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:51:33.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1889061238' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:51:33.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.421+0000 7f8239a00640 1 -- 172.21.15.18:0/2149699336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8234103170 msgr2=0x7f82341035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.421+0000 7f8239a00640 1 --2- 172.21.15.18:0/2149699336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8234103170 0x7f82341035f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8220009900 tx=0x7f822002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.421+0000 7f8239a00640 1 -- 172.21.15.18:0/2149699336 shutdown_connections 2024-09-13T16:51:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.421+0000 7f8239a00640 1 --2- 172.21.15.18:0/2149699336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8234103b30 0x7f823410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.421+0000 7f8239a00640 1 --2- 172.21.15.18:0/2149699336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8234103170 0x7f82341035f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.421+0000 7f8239a00640 1 --2- 172.21.15.18:0/2149699336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8234101f80 0x7f8234102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.421+0000 7f8239a00640 1 -- 172.21.15.18:0/2149699336 >> 172.21.15.18:0/2149699336 conn(0x7f82340fd700 msgr2=0x7f82340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.421+0000 7f8239a00640 1 -- 172.21.15.18:0/2149699336 shutdown_connections 2024-09-13T16:51:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.421+0000 7f8239a00640 1 -- 172.21.15.18:0/2149699336 wait complete. 2024-09-13T16:51:33.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.422+0000 7f8239a00640 1 Processor -- start 2024-09-13T16:51:33.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.422+0000 7f8239a00640 1 -- start start 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8239a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8234101f80 0x7f8234197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8239a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8234103170 0x7f8234198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8239a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8234103b30 0x7f823419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8239a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823419f9f0 con 0x7f8234103b30 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8239a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823419fb60 con 0x7f8234101f80 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8239a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823419fd20 con 0x7f8234103170 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8232a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8234101f80 0x7f8234197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8232a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8234101f80 0x7f8234197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:59520/0 (socket says 172.21.15.18:59520) 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8232a00640 1 -- 172.21.15.18:0/191277342 learned_addr learned my addr 172.21.15.18:0/191277342 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8233400640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8234103b30 0x7f823419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8232000640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8234103170 0x7f8234198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8232a00640 1 -- 172.21.15.18:0/191277342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8234103170 msgr2=0x7f8234198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8232a00640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8234103170 0x7f8234198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8232a00640 1 -- 172.21.15.18:0/191277342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8234103b30 msgr2=0x7f823419f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8232a00640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8234103b30 0x7f823419f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.423+0000 7f8232a00640 1 -- 172.21.15.18:0/191277342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8224009490 con 0x7f8234101f80 2024-09-13T16:51:33.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.424+0000 7f8232a00640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8234101f80 0x7f8234197f50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f822400e9c0 tx=0x7f822400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:33.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.424+0000 7f822b400640 1 -- 172.21.15.18:0/191277342 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400cde0 con 0x7f8234101f80 2024-09-13T16:51:33.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.424+0000 7f822b400640 1 -- 172.21.15.18:0/191277342 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82240108f0 con 0x7f8234101f80 2024-09-13T16:51:33.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.424+0000 7f8239a00640 1 -- 172.21.15.18:0/191277342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8220009560 con 0x7f8234101f80 2024-09-13T16:51:33.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.424+0000 7f822b400640 1 -- 172.21.15.18:0/191277342 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82240188c0 con 0x7f8234101f80 2024-09-13T16:51:33.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.424+0000 7f8239a00640 1 -- 172.21.15.18:0/191277342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82341a0290 con 0x7f8234101f80 2024-09-13T16:51:33.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.425+0000 7f8239a00640 1 -- 172.21.15.18:0/191277342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82341093c0 con 0x7f8234101f80 2024-09-13T16:51:33.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.427+0000 7f822b400640 1 -- 172.21.15.18:0/191277342 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8224010a60 con 0x7f8234101f80 2024-09-13T16:51:33.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.428+0000 7f822b400640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82180a1090 0x7f82180a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.429+0000 7f822b400640 1 -- 172.21.15.18:0/191277342 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f8224014070 con 0x7f8234101f80 2024-09-13T16:51:33.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.429+0000 7f8232000640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82180a1090 0x7f82180a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.429+0000 7f8232000640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82180a1090 0x7f82180a3550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8220000c00 tx=0x7f82200314c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:33.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.430+0000 7f822b400640 1 -- 172.21.15.18:0/191277342 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8224096840 con 0x7f8234101f80 2024-09-13T16:51:33.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.608+0000 7f8239a00640 1 -- 172.21.15.18:0/191277342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f823410d9f0 con 0x7f8234101f80 2024-09-13T16:51:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.609+0000 7f822b400640 1 -- 172.21.15.18:0/191277342 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8224099e60 con 0x7f8234101f80 2024-09-13T16:51:33.610 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T16:51:33.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 -- 172.21.15.18:0/191277342 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82180a1090 msgr2=0x7f82180a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82180a1090 0x7f82180a3550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8220000c00 tx=0x7f82200314c0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 -- 172.21.15.18:0/191277342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8234101f80 msgr2=0x7f8234197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8234101f80 0x7f8234197f50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f822400e9c0 tx=0x7f822400ee80 comp rx=0 tx=0).stop 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 -- 172.21.15.18:0/191277342 shutdown_connections 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f82180a1090 0x7f82180a3550 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8234103b30 0x7f823419f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8234103170 0x7f8234198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 --2- 172.21.15.18:0/191277342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8234101f80 0x7f8234197f50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 -- 172.21.15.18:0/191277342 >> 172.21.15.18:0/191277342 conn(0x7f82340fd700 msgr2=0x7f8234106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 -- 172.21.15.18:0/191277342 shutdown_connections 2024-09-13T16:51:33.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.611+0000 7f8239a00640 1 -- 172.21.15.18:0/191277342 wait complete. 2024-09-13T16:51:33.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:51:33.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.788+0000 7f9ae3200640 1 -- 172.21.15.18:0/2661292584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ae4101ea0 msgr2=0x7f9ae41022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.788+0000 7f9ae3200640 1 --2- 172.21.15.18:0/2661292584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ae4101ea0 0x7f9ae41022a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4009ca0 tx=0x7f9ad402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.788+0000 7f9ae3200640 1 -- 172.21.15.18:0/2661292584 shutdown_connections 2024-09-13T16:51:33.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.788+0000 7f9ae3200640 1 --2- 172.21.15.18:0/2661292584 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ae4103a40 0x7f9ae410a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.788+0000 7f9ae3200640 1 --2- 172.21.15.18:0/2661292584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae4103080 0x7f9ae4103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.788+0000 7f9ae3200640 1 --2- 172.21.15.18:0/2661292584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ae4101ea0 0x7f9ae41022a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.788+0000 7f9ae3200640 1 -- 172.21.15.18:0/2661292584 >> 172.21.15.18:0/2661292584 conn(0x7f9ae40fd670 msgr2=0x7f9ae40ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:33.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.788+0000 7f9ae3200640 1 -- 172.21.15.18:0/2661292584 shutdown_connections 2024-09-13T16:51:33.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.788+0000 7f9ae3200640 1 -- 172.21.15.18:0/2661292584 wait complete. 2024-09-13T16:51:33.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ae3200640 1 Processor -- start 2024-09-13T16:51:33.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ae3200640 1 -- start start 2024-09-13T16:51:33.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ae3200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ae4101ea0 0x7f9ae4197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ae3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ae4103080 0x7f9ae4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ae3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae4103a40 0x7f9ae419f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ae3200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae419fa40 con 0x7f9ae4103080 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ae3200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae419fbb0 con 0x7f9ae4101ea0 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ae3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae419fd70 con 0x7f9ae4103a40 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ad9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ae4103080 0x7f9ae4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ad9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ae4103080 0x7f9ae4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59490/0 (socket says 172.21.15.18:59490) 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ad9400640 1 -- 172.21.15.18:0/3426312151 learned_addr learned my addr 172.21.15.18:0/3426312151 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ae1e00640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ae4101ea0 0x7f9ae4197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.789+0000 7f9ae2800640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae4103a40 0x7f9ae419f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9ad9400640 1 -- 172.21.15.18:0/3426312151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae4103a40 msgr2=0x7f9ae419f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9ad9400640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae4103a40 0x7f9ae419f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9ad9400640 1 -- 172.21.15.18:0/3426312151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ae4101ea0 msgr2=0x7f9ae4197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9ad9400640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ae4101ea0 0x7f9ae4197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9ad9400640 1 -- 172.21.15.18:0/3426312151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc009490 con 0x7f9ae4103080 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9ae1e00640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ae4101ea0 0x7f9ae4197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:51:33.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9ad9400640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ae4103080 0x7f9ae4198490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00e9f0 tx=0x7f9acc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:33.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9adb400640 1 -- 172.21.15.18:0/3426312151 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc009720 con 0x7f9ae4103080 2024-09-13T16:51:33.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9adb400640 1 -- 172.21.15.18:0/3426312151 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9acc0054e0 con 0x7f9ae4103080 2024-09-13T16:51:33.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9ae3200640 1 -- 172.21.15.18:0/3426312151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad4009900 con 0x7f9ae4103080 2024-09-13T16:51:33.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9adb400640 1 -- 172.21.15.18:0/3426312151 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc010430 con 0x7f9ae4103080 2024-09-13T16:51:33.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.790+0000 7f9ae3200640 1 -- 172.21.15.18:0/3426312151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae41a0340 con 0x7f9ae4103080 2024-09-13T16:51:33.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.791+0000 7f9ae3200640 1 -- 172.21.15.18:0/3426312151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae4109420 con 0x7f9ae4103080 2024-09-13T16:51:33.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.794+0000 7f9adb400640 1 -- 172.21.15.18:0/3426312151 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9acc004ff0 con 0x7f9ae4103080 2024-09-13T16:51:33.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.795+0000 7f9adb400640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ac80a1110 0x7f9ac80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:33.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.795+0000 7f9adb400640 1 -- 172.21.15.18:0/3426312151 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9acc014070 con 0x7f9ae4103080 2024-09-13T16:51:33.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.795+0000 7f9ae1e00640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ac80a1110 0x7f9ac80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:33.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.796+0000 7f9ae1e00640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ac80a1110 0x7f9ac80a35d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4006010 tx=0x7f9ad40093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.799+0000 7f9adb400640 1 -- 172.21.15.18:0/3426312151 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9acc096460 con 0x7f9ae4103080 2024-09-13T16:51:33.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.982+0000 7f9ae3200640 1 -- 172.21.15.18:0/3426312151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ae4108e90 con 0x7f9ae4103080 2024-09-13T16:51:33.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.983+0000 7f9adb400640 1 -- 172.21.15.18:0/3426312151 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9acc099a80 con 0x7f9ae4103080 2024-09-13T16:51:33.984 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:51:33.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 -- 172.21.15.18:0/3426312151 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ac80a1110 msgr2=0x7f9ac80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ac80a1110 0x7f9ac80a35d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4006010 tx=0x7f9ad40093f0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 -- 172.21.15.18:0/3426312151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ae4103080 msgr2=0x7f9ae4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:33.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ae4103080 0x7f9ae4198490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00e9f0 tx=0x7f9acc00edf0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 -- 172.21.15.18:0/3426312151 shutdown_connections 2024-09-13T16:51:33.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ac80a1110 0x7f9ac80a35d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ae4103080 0x7f9ae4198490 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae4103a40 0x7f9ae419f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 --2- 172.21.15.18:0/3426312151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ae4101ea0 0x7f9ae4197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:33.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 -- 172.21.15.18:0/3426312151 >> 172.21.15.18:0/3426312151 conn(0x7f9ae40fd670 msgr2=0x7f9ae41065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:33.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 -- 172.21.15.18:0/3426312151 shutdown_connections 2024-09-13T16:51:33.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:33.985+0000 7f9ae3200640 1 -- 172.21.15.18:0/3426312151 wait complete. 2024-09-13T16:51:34.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:51:34.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.161+0000 7f6897200640 1 -- 172.21.15.18:0/3549495105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6890100f60 msgr2=0x7f68901013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.161+0000 7f6897200640 1 --2- 172.21.15.18:0/3549495105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6890100f60 0x7f68901013e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6878009900 tx=0x7f687802a410 comp rx=0 tx=0).stop 2024-09-13T16:51:34.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.161+0000 7f6897200640 1 -- 172.21.15.18:0/3549495105 shutdown_connections 2024-09-13T16:51:34.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.161+0000 7f6897200640 1 --2- 172.21.15.18:0/3549495105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6890100f60 0x7f68901013e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.161+0000 7f6897200640 1 --2- 172.21.15.18:0/3549495105 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6890101920 0x7f68901081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.161+0000 7f6897200640 1 --2- 172.21.15.18:0/3549495105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68900ffd70 0x7f6890100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.161+0000 7f6897200640 1 -- 172.21.15.18:0/3549495105 >> 172.21.15.18:0/3549495105 conn(0x7f68900fb4d0 msgr2=0x7f68900fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.162+0000 7f6897200640 1 -- 172.21.15.18:0/3549495105 shutdown_connections 2024-09-13T16:51:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.162+0000 7f6897200640 1 -- 172.21.15.18:0/3549495105 wait complete. 2024-09-13T16:51:34.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.162+0000 7f6897200640 1 Processor -- start 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f6897200640 1 -- start start 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f6897200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68900ffd70 0x7f6890074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f6897200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890100f60 0x7f68900728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f6897200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6890101920 0x7f6890072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f6897200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890073540 con 0x7f68900ffd70 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f6897200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900736b0 con 0x7f6890101920 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f6897200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689019fd70 con 0x7f6890100f60 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f688fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68900ffd70 0x7f6890074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f688fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68900ffd70 0x7f6890074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59500/0 (socket says 172.21.15.18:59500) 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f688fe00640 1 -- 172.21.15.18:0/759206646 learned_addr learned my addr 172.21.15.18:0/759206646 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f6887e00640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890100f60 0x7f68900728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f6895200640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6890101920 0x7f6890072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.163+0000 7f688fe00640 1 -- 172.21.15.18:0/759206646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890100f60 msgr2=0x7f68900728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.164+0000 7f688fe00640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890100f60 0x7f68900728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.164+0000 7f688fe00640 1 -- 172.21.15.18:0/759206646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6890101920 msgr2=0x7f6890072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.164+0000 7f688fe00640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6890101920 0x7f6890072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.164+0000 7f688fe00640 1 -- 172.21.15.18:0/759206646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6888009840 con 0x7f68900ffd70 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.164+0000 7f688fe00640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68900ffd70 0x7f6890074260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f688000d7a0 tx=0x7f688000dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.164+0000 7f688d600640 1 -- 172.21.15.18:0/759206646 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880004220 con 0x7f68900ffd70 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.164+0000 7f6897200640 1 -- 172.21.15.18:0/759206646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6878009560 con 0x7f68900ffd70 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.164+0000 7f688d600640 1 -- 172.21.15.18:0/759206646 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6880004380 con 0x7f68900ffd70 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.164+0000 7f688d600640 1 -- 172.21.15.18:0/759206646 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880003d60 con 0x7f68900ffd70 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.164+0000 7f6897200640 1 -- 172.21.15.18:0/759206646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68901a02b0 con 0x7f68900ffd70 2024-09-13T16:51:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.165+0000 7f6897200640 1 -- 172.21.15.18:0/759206646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68901071f0 con 0x7f68900ffd70 2024-09-13T16:51:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.167+0000 7f688d600640 1 -- 172.21.15.18:0/759206646 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6880009820 con 0x7f68900ffd70 2024-09-13T16:51:34.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.169+0000 7f688d600640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68740a1090 0x7f68740a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.170+0000 7f688d600640 1 -- 172.21.15.18:0/759206646 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f68800cc5b0 con 0x7f68900ffd70 2024-09-13T16:51:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.170+0000 7f6887e00640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68740a1090 0x7f68740a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.170+0000 7f6887e00640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68740a1090 0x7f68740a3550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f687802aa00 tx=0x7f68780314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:34.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.174+0000 7f688d600640 1 -- 172.21.15.18:0/759206646 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6880095980 con 0x7f68900ffd70 2024-09-13T16:51:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.353+0000 7f6897200640 1 -- 172.21.15.18:0/759206646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f689002c410 con 0x7f68900ffd70 2024-09-13T16:51:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.353+0000 7f688d600640 1 -- 172.21.15.18:0/759206646 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6880098fa0 con 0x7f68900ffd70 2024-09-13T16:51:34.355 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-13T16:51:34.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.355+0000 7f6897200640 1 -- 172.21.15.18:0/759206646 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68740a1090 msgr2=0x7f68740a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.355+0000 7f6897200640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68740a1090 0x7f68740a3550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f687802aa00 tx=0x7f68780314a0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.355+0000 7f6897200640 1 -- 172.21.15.18:0/759206646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68900ffd70 msgr2=0x7f6890074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.355+0000 7f6897200640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68900ffd70 0x7f6890074260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f688000d7a0 tx=0x7f688000dba0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.356+0000 7f6897200640 1 -- 172.21.15.18:0/759206646 shutdown_connections 2024-09-13T16:51:34.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.356+0000 7f6897200640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6890101920 0x7f6890072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.356+0000 7f6897200640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890100f60 0x7f68900728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.356+0000 7f6897200640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f68740a1090 0x7f68740a3550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.356+0000 7f6897200640 1 --2- 172.21.15.18:0/759206646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68900ffd70 0x7f6890074260 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.356+0000 7f6897200640 1 -- 172.21.15.18:0/759206646 >> 172.21.15.18:0/759206646 conn(0x7f68900fb4d0 msgr2=0x7f68901043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:34.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.356+0000 7f6897200640 1 -- 172.21.15.18:0/759206646 shutdown_connections 2024-09-13T16:51:34.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.356+0000 7f6897200640 1 -- 172.21.15.18:0/759206646 wait complete. 2024-09-13T16:51:34.371 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:34 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3030213581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:51:34.372 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:34 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/191277342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:51:34.372 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:34 smithi018 ceph-mon[30981]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:34.372 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:34 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3426312151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:51:34.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:51:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:34 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3030213581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:51:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:34 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/191277342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:51:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:34 smithi094 ceph-mon[35259]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:34 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3426312151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:51:34.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:34 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3030213581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:51:34.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:34 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/191277342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:51:34.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:34 smithi144 ceph-mon[35328]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:34.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:34 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3426312151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:51:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.532+0000 7fe801c00640 1 -- 172.21.15.18:0/336783566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7fc101f80 msgr2=0x7fe7fc102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.532+0000 7fe801c00640 1 --2- 172.21.15.18:0/336783566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7fc101f80 0x7fe7fc102380 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009900 tx=0x7fe7ec02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.532+0000 7fe801c00640 1 -- 172.21.15.18:0/336783566 shutdown_connections 2024-09-13T16:51:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.532+0000 7fe801c00640 1 --2- 172.21.15.18:0/336783566 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7fc103b30 0x7fe7fc10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.532+0000 7fe801c00640 1 --2- 172.21.15.18:0/336783566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7fc103170 0x7fe7fc1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.532+0000 7fe801c00640 1 --2- 172.21.15.18:0/336783566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7fc101f80 0x7fe7fc102380 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.532+0000 7fe801c00640 1 -- 172.21.15.18:0/336783566 >> 172.21.15.18:0/336783566 conn(0x7fe7fc0fd700 msgr2=0x7fe7fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.532+0000 7fe801c00640 1 -- 172.21.15.18:0/336783566 shutdown_connections 2024-09-13T16:51:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.532+0000 7fe801c00640 1 -- 172.21.15.18:0/336783566 wait complete. 2024-09-13T16:51:34.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.533+0000 7fe801c00640 1 Processor -- start 2024-09-13T16:51:34.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.533+0000 7fe801c00640 1 -- start start 2024-09-13T16:51:34.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe801c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7fc101f80 0x7fe7fc197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe801c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7fc103170 0x7fe7fc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe801c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7fc103b30 0x7fe7fc19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe801c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc19fab0 con 0x7fe7fc103b30 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe801c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc19fc20 con 0x7fe7fc101f80 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe801c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc19fde0 con 0x7fe7fc103170 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7fb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7fc103b30 0x7fe7fc19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7faa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7fc101f80 0x7fe7fc197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7faa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7fc101f80 0x7fe7fc197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:59556/0 (socket says 172.21.15.18:59556) 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7faa00640 1 -- 172.21.15.18:0/304549516 learned_addr learned my addr 172.21.15.18:0/304549516 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7f3e00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7fc103170 0x7fe7fc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7faa00640 1 -- 172.21.15.18:0/304549516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7fc103170 msgr2=0x7fe7fc198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7faa00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7fc103170 0x7fe7fc198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7faa00640 1 -- 172.21.15.18:0/304549516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7fc103b30 msgr2=0x7fe7fc19f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7faa00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7fc103b30 0x7fe7fc19f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7faa00640 1 -- 172.21.15.18:0/304549516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec009560 con 0x7fe7fc101f80 2024-09-13T16:51:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.534+0000 7fe7fb400640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7fc103b30 0x7fe7fc19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.535+0000 7fe7faa00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7fc101f80 0x7fe7fc197fc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec031500 tx=0x7fe7ec003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.535+0000 7fe7f3400640 1 -- 172.21.15.18:0/304549516 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec003e00 con 0x7fe7fc101f80 2024-09-13T16:51:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.535+0000 7fe801c00640 1 -- 172.21.15.18:0/304549516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc1a0060 con 0x7fe7fc101f80 2024-09-13T16:51:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.535+0000 7fe7f3400640 1 -- 172.21.15.18:0/304549516 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7ec031c70 con 0x7fe7fc101f80 2024-09-13T16:51:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.535+0000 7fe7f3400640 1 -- 172.21.15.18:0/304549516 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec03bc50 con 0x7fe7fc101f80 2024-09-13T16:51:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.535+0000 7fe801c00640 1 -- 172.21.15.18:0/304549516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc1a0510 con 0x7fe7fc101f80 2024-09-13T16:51:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.536+0000 7fe801c00640 1 -- 172.21.15.18:0/304549516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc109480 con 0x7fe7fc101f80 2024-09-13T16:51:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.538+0000 7fe7f3400640 1 -- 172.21.15.18:0/304549516 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe7ec0317b0 con 0x7fe7fc101f80 2024-09-13T16:51:34.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.539+0000 7fe7f3400640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7e00a1090 0x7fe7e00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.540+0000 7fe7f3400640 1 -- 172.21.15.18:0/304549516 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fe7ec0ed8b0 con 0x7fe7fc101f80 2024-09-13T16:51:34.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.540+0000 7fe7f3e00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7e00a1090 0x7fe7e00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.540+0000 7fe7f3e00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7e00a1090 0x7fe7e00a3550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc1994d0 tx=0x7fe7e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:34.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.542+0000 7fe7f3400640 1 -- 172.21.15.18:0/304549516 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe7ec0b6d30 con 0x7fe7fc101f80 2024-09-13T16:51:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.720+0000 7fe801c00640 1 -- 172.21.15.18:0/304549516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe7fc108ef0 con 0x7fe7fc101f80 2024-09-13T16:51:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.720+0000 7fe7f3400640 1 -- 172.21.15.18:0/304549516 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe7ec049020 con 0x7fe7fc101f80 2024-09-13T16:51:34.722 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:51:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.722+0000 7fe801c00640 1 -- 172.21.15.18:0/304549516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7e00a1090 msgr2=0x7fe7e00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.722+0000 7fe801c00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7e00a1090 0x7fe7e00a3550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc1994d0 tx=0x7fe7e4005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.722+0000 7fe801c00640 1 -- 172.21.15.18:0/304549516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7fc101f80 msgr2=0x7fe7fc197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.722+0000 7fe801c00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7fc101f80 0x7fe7fc197fc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec031500 tx=0x7fe7ec003c10 comp rx=0 tx=0).stop 2024-09-13T16:51:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.723+0000 7fe801c00640 1 -- 172.21.15.18:0/304549516 shutdown_connections 2024-09-13T16:51:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.723+0000 7fe801c00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe7e00a1090 0x7fe7e00a3550 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.723+0000 7fe801c00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7fc103b30 0x7fe7fc19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.723+0000 7fe801c00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7fc103170 0x7fe7fc198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.723+0000 7fe801c00640 1 --2- 172.21.15.18:0/304549516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7fc101f80 0x7fe7fc197fc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.723+0000 7fe801c00640 1 -- 172.21.15.18:0/304549516 >> 172.21.15.18:0/304549516 conn(0x7fe7fc0fd700 msgr2=0x7fe7fc106650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.723+0000 7fe801c00640 1 -- 172.21.15.18:0/304549516 shutdown_connections 2024-09-13T16:51:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.723+0000 7fe801c00640 1 -- 172.21.15.18:0/304549516 wait complete. 2024-09-13T16:51:34.742 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:51:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.897+0000 7f6437800640 1 -- 172.21.15.18:0/31764282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6430103190 msgr2=0x7f6430103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.897+0000 7f6437800640 1 --2- 172.21.15.18:0/31764282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6430103190 0x7f6430103610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6418009900 tx=0x7f641802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.898+0000 7f6437800640 1 -- 172.21.15.18:0/31764282 shutdown_connections 2024-09-13T16:51:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.898+0000 7f6437800640 1 --2- 172.21.15.18:0/31764282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6430103b50 0x7f643010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.898+0000 7f6437800640 1 --2- 172.21.15.18:0/31764282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6430103190 0x7f6430103610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.898+0000 7f6437800640 1 --2- 172.21.15.18:0/31764282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6430101fa0 0x7f64301023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.898+0000 7f6437800640 1 -- 172.21.15.18:0/31764282 >> 172.21.15.18:0/31764282 conn(0x7f64300fd700 msgr2=0x7f64300ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.898+0000 7f6437800640 1 -- 172.21.15.18:0/31764282 shutdown_connections 2024-09-13T16:51:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.898+0000 7f6437800640 1 -- 172.21.15.18:0/31764282 wait complete. 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6437800640 1 Processor -- start 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6437800640 1 -- start start 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6437800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6430101fa0 0x7f6430197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6437800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6430103190 0x7f64301984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6437800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6430103b50 0x7f643019f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6437800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643019fa90 con 0x7f6430103190 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6437800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643019fc00 con 0x7f6430103b50 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6437800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643019fdc0 con 0x7f6430101fa0 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6427e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6430103190 0x7f64301984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6435800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6430103b50 0x7f643019f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6427e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6430103190 0x7f64301984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59532/0 (socket says 172.21.15.18:59532) 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6427e00640 1 -- 172.21.15.18:0/667394479 learned_addr learned my addr 172.21.15.18:0/667394479 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.899+0000 7f6434e00640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6430101fa0 0x7f6430197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.900+0000 7f6427e00640 1 -- 172.21.15.18:0/667394479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6430101fa0 msgr2=0x7f6430197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.900+0000 7f6427e00640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6430101fa0 0x7f6430197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.900+0000 7f6427e00640 1 -- 172.21.15.18:0/667394479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6430103b50 msgr2=0x7f643019f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.900+0000 7f6427e00640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6430103b50 0x7f643019f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.900+0000 7f6427e00640 1 -- 172.21.15.18:0/667394479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418009560 con 0x7f6430103190 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.900+0000 7f6427e00640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6430103190 0x7f64301984e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6418031500 tx=0x7f6418003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.900+0000 7f642e000640 1 -- 172.21.15.18:0/667394479 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418003e00 con 0x7f6430103190 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.900+0000 7f6437800640 1 -- 172.21.15.18:0/667394479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64301a0040 con 0x7f6430103190 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.900+0000 7f642e000640 1 -- 172.21.15.18:0/667394479 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6418031c70 con 0x7f6430103190 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.901+0000 7f6437800640 1 -- 172.21.15.18:0/667394479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64301a0540 con 0x7f6430103190 2024-09-13T16:51:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.901+0000 7f642e000640 1 -- 172.21.15.18:0/667394479 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641803bd20 con 0x7f6430103190 2024-09-13T16:51:34.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.902+0000 7f6437800640 1 -- 172.21.15.18:0/667394479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6430109450 con 0x7f6430103190 2024-09-13T16:51:34.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.903+0000 7f642e000640 1 -- 172.21.15.18:0/667394479 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f641803b460 con 0x7f6430103190 2024-09-13T16:51:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.905+0000 7f642e000640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f64140a1090 0x7f64140a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.906+0000 7f642e000640 1 -- 172.21.15.18:0/667394479 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f64180ed5a0 con 0x7f6430103190 2024-09-13T16:51:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.906+0000 7f6434e00640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f64140a1090 0x7f64140a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.906+0000 7f6434e00640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f64140a1090 0x7f64140a3550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6420005fd0 tx=0x7f642000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:34.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:34.910+0000 7f642e000640 1 -- 172.21.15.18:0/667394479 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f64180b6a20 con 0x7f6430103190 2024-09-13T16:51:35.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.129+0000 7f6437800640 1 -- 172.21.15.18:0/667394479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f643010d8b0 con 0x7f6430103190 2024-09-13T16:51:35.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.129+0000 7f642e000640 1 -- 172.21.15.18:0/667394479 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10852 (secure 0 0 0) 0x7f64180ba040 con 0x7f6430103190 2024-09-13T16:51:35.131 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:35.131 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:49:28.080578+0000","modified":"2024-09-13T16:49:57.790808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24590,"mds_1":24566,"mds_2":24539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24539":{"gid":24539,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:51:35.131 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 24 2024-09-13T16:51:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.131+0000 7f6437800640 1 -- 172.21.15.18:0/667394479 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f64140a1090 msgr2=0x7f64140a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.131+0000 7f6437800640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f64140a1090 0x7f64140a3550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6420005fd0 tx=0x7f642000b410 comp rx=0 tx=0).stop 2024-09-13T16:51:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.131+0000 7f6437800640 1 -- 172.21.15.18:0/667394479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6430103190 msgr2=0x7f64301984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.131+0000 7f6437800640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6430103190 0x7f64301984e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6418031500 tx=0x7f6418003c10 comp rx=0 tx=0).stop 2024-09-13T16:51:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.132+0000 7f6437800640 1 -- 172.21.15.18:0/667394479 shutdown_connections 2024-09-13T16:51:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.132+0000 7f6437800640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f64140a1090 0x7f64140a3550 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.132+0000 7f6437800640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6430103190 0x7f64301984e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.132+0000 7f6437800640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6430103b50 0x7f643019f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.132+0000 7f6437800640 1 --2- 172.21.15.18:0/667394479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6430101fa0 0x7f6430197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.132+0000 7f6437800640 1 -- 172.21.15.18:0/667394479 >> 172.21.15.18:0/667394479 conn(0x7f64300fd700 msgr2=0x7f6430106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.132+0000 7f6437800640 1 -- 172.21.15.18:0/667394479 shutdown_connections 2024-09-13T16:51:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.132+0000 7f6437800640 1 -- 172.21.15.18:0/667394479 wait complete. 2024-09-13T16:51:35.151 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:51:35.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.306+0000 7f480aa00640 1 -- 172.21.15.18:0/2380809048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4804101f90 msgr2=0x7f4804102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.306+0000 7f480aa00640 1 --2- 172.21.15.18:0/2380809048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4804101f90 0x7f4804102390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009900 tx=0x7f47f402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.306+0000 7f480aa00640 1 -- 172.21.15.18:0/2380809048 shutdown_connections 2024-09-13T16:51:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.306+0000 7f480aa00640 1 --2- 172.21.15.18:0/2380809048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4804103180 0x7f4804103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.306+0000 7f480aa00640 1 --2- 172.21.15.18:0/2380809048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4804103b40 0x7f480410a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.306+0000 7f480aa00640 1 --2- 172.21.15.18:0/2380809048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4804101f90 0x7f4804102390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.306+0000 7f480aa00640 1 -- 172.21.15.18:0/2380809048 >> 172.21.15.18:0/2380809048 conn(0x7f48040fd730 msgr2=0x7f48040ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.306+0000 7f480aa00640 1 -- 172.21.15.18:0/2380809048 shutdown_connections 2024-09-13T16:51:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.306+0000 7f480aa00640 1 -- 172.21.15.18:0/2380809048 wait complete. 2024-09-13T16:51:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.307+0000 7f480aa00640 1 Processor -- start 2024-09-13T16:51:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.307+0000 7f480aa00640 1 -- start start 2024-09-13T16:51:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.307+0000 7f480aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4804101f90 0x7f4804197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.307+0000 7f480aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4804103180 0x7f4804198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:35.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.307+0000 7f480aa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4804103b40 0x7f480419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:35.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.307+0000 7f480aa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480419fac0 con 0x7f4804101f90 2024-09-13T16:51:35.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f480aa00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480419fc30 con 0x7f4804103b40 2024-09-13T16:51:35.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f480aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480419fdf0 con 0x7f4804103180 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4803e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4804101f90 0x7f4804197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4803e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4804101f90 0x7f4804197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59548/0 (socket says 172.21.15.18:59548) 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4803e00640 1 -- 172.21.15.18:0/1046322298 learned_addr learned my addr 172.21.15.18:0/1046322298 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4808a00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4804103b40 0x7f480419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4803400640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4804103180 0x7f4804198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4803e00640 1 -- 172.21.15.18:0/1046322298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4804103180 msgr2=0x7f4804198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4803e00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4804103180 0x7f4804198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4803e00640 1 -- 172.21.15.18:0/1046322298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4804103b40 msgr2=0x7f480419f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4803e00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4804103b40 0x7f480419f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4803e00640 1 -- 172.21.15.18:0/1046322298 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f4009560 con 0x7f4804101f90 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.308+0000 7f4803e00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4804101f90 0x7f4804197fd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47f4031500 tx=0x7f47f4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:35.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.309+0000 7f4800c00640 1 -- 172.21.15.18:0/1046322298 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4003e00 con 0x7f4804101f90 2024-09-13T16:51:35.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.309+0000 7f4800c00640 1 -- 172.21.15.18:0/1046322298 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47f4031c70 con 0x7f4804101f90 2024-09-13T16:51:35.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.309+0000 7f480aa00640 1 -- 172.21.15.18:0/1046322298 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48041a0070 con 0x7f4804101f90 2024-09-13T16:51:35.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.309+0000 7f4800c00640 1 -- 172.21.15.18:0/1046322298 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f403bc20 con 0x7f4804101f90 2024-09-13T16:51:35.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.309+0000 7f480aa00640 1 -- 172.21.15.18:0/1046322298 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48041a0520 con 0x7f4804101f90 2024-09-13T16:51:35.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.310+0000 7f480aa00640 1 -- 172.21.15.18:0/1046322298 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480410d8a0 con 0x7f4804101f90 2024-09-13T16:51:35.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.312+0000 7f4800c00640 1 -- 172.21.15.18:0/1046322298 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f47f40317b0 con 0x7f4804101f90 2024-09-13T16:51:35.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.313+0000 7f4800c00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47e80a1090 0x7f47e80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:35.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.313+0000 7f4800c00640 1 -- 172.21.15.18:0/1046322298 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f47f40ed480 con 0x7f4804101f90 2024-09-13T16:51:35.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.313+0000 7f4803400640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47e80a1090 0x7f47e80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.314+0000 7f4803400640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47e80a1090 0x7f47e80a3550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f48041994e0 tx=0x7f47f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:35.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.316+0000 7f4800c00640 1 -- 172.21.15.18:0/1046322298 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f47f40b6940 con 0x7f4804101f90 2024-09-13T16:51:35.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:35 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/759206646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:51:35.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:35 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/304549516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:51:35.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:35 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/759206646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:51:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:35 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/304549516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:51:35.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.498+0000 7f480aa00640 1 -- 172.21.15.18:0/1046322298 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f480410da80 con 0x7f4804101f90 2024-09-13T16:51:35.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.499+0000 7f4800c00640 1 -- 172.21.15.18:0/1046322298 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24592 (secure 0 0 0) 0x7f47f40b9f60 con 0x7f4804101f90 2024-09-13T16:51:35.501 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:35.501 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":93,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:51:14.023061+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:51:35.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 -- 172.21.15.18:0/1046322298 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47e80a1090 msgr2=0x7f47e80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47e80a1090 0x7f47e80a3550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f48041994e0 tx=0x7f47f0005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:35.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 -- 172.21.15.18:0/1046322298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4804101f90 msgr2=0x7f4804197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4804101f90 0x7f4804197fd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47f4031500 tx=0x7f47f4003c10 comp rx=0 tx=0).stop 2024-09-13T16:51:35.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 -- 172.21.15.18:0/1046322298 shutdown_connections 2024-09-13T16:51:35.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4804103b40 0x7f480419f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4804103180 0x7f4804198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47e80a1090 0x7f47e80a3550 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 --2- 172.21.15.18:0/1046322298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4804101f90 0x7f4804197fd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 -- 172.21.15.18:0/1046322298 >> 172.21.15.18:0/1046322298 conn(0x7f48040fd730 msgr2=0x7f48040ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:35.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 -- 172.21.15.18:0/1046322298 shutdown_connections 2024-09-13T16:51:35.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.502+0000 7f480aa00640 1 -- 172.21.15.18:0/1046322298 wait complete. 2024-09-13T16:51:35.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:51:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:35 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/759206646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:51:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:35 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/304549516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:51:35.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.677+0000 7f6c03e00640 1 -- 172.21.15.18:0/2024454457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c04100180 msgr2=0x7f6c04107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.677+0000 7f6c03e00640 1 --2- 172.21.15.18:0/2024454457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c04100180 0x7f6c04107ff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009ca0 tx=0x7f6bfc02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.677+0000 7f6c03e00640 1 -- 172.21.15.18:0/2024454457 shutdown_connections 2024-09-13T16:51:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.677+0000 7f6c03e00640 1 --2- 172.21.15.18:0/2024454457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c04100180 0x7f6c04107ff0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.677+0000 7f6c03e00640 1 --2- 172.21.15.18:0/2024454457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c040ff7c0 0x7f6c040ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.677+0000 7f6c03e00640 1 --2- 172.21.15.18:0/2024454457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c04101290 0x7f6c04101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.677+0000 7f6c03e00640 1 -- 172.21.15.18:0/2024454457 >> 172.21.15.18:0/2024454457 conn(0x7f6c040fb310 msgr2=0x7f6c040fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.677+0000 7f6c03e00640 1 -- 172.21.15.18:0/2024454457 shutdown_connections 2024-09-13T16:51:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.677+0000 7f6c03e00640 1 -- 172.21.15.18:0/2024454457 wait complete. 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c03e00640 1 Processor -- start 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c03e00640 1 -- start start 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c040ff7c0 0x7f6c04074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c03e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c04100180 0x7f6c040728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c03e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c04101290 0x7f6c04072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c03e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04073540 con 0x7f6c040ff7c0 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c03e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040736b0 con 0x7f6c04101290 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c03e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0419fcd0 con 0x7f6c04100180 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c02a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c040ff7c0 0x7f6c04074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c02a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c040ff7c0 0x7f6c04074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59556/0 (socket says 172.21.15.18:59556) 2024-09-13T16:51:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c02a00640 1 -- 172.21.15.18:0/2112780483 learned_addr learned my addr 172.21.15.18:0/2112780483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.678+0000 7f6c02000640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c04100180 0x7f6c040728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.679+0000 7f6c03400640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c04101290 0x7f6c04072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.679+0000 7f6c02a00640 1 -- 172.21.15.18:0/2112780483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c04100180 msgr2=0x7f6c040728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.679+0000 7f6c02a00640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c04100180 0x7f6c040728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.679+0000 7f6c02a00640 1 -- 172.21.15.18:0/2112780483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c04101290 msgr2=0x7f6c04072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.679+0000 7f6c02a00640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c04101290 0x7f6c04072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.679+0000 7f6c02a00640 1 -- 172.21.15.18:0/2112780483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc009900 con 0x7f6c040ff7c0 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.679+0000 7f6c02a00640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c040ff7c0 0x7f6c04074260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400e9f0 tx=0x7f6bf400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.679+0000 7f6bfb400640 1 -- 172.21.15.18:0/2112780483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf40096e0 con 0x7f6c040ff7c0 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.679+0000 7f6bfb400640 1 -- 172.21.15.18:0/2112780483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bf40044f0 con 0x7f6c040ff7c0 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.679+0000 7f6c03e00640 1 -- 172.21.15.18:0/2112780483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0419ff80 con 0x7f6c040ff7c0 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.680+0000 7f6bfb400640 1 -- 172.21.15.18:0/2112780483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4010430 con 0x7f6c040ff7c0 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.680+0000 7f6c03e00640 1 -- 172.21.15.18:0/2112780483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c041a0350 con 0x7f6c040ff7c0 2024-09-13T16:51:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.681+0000 7f6c03e00640 1 -- 172.21.15.18:0/2112780483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c040ffc40 con 0x7f6c040ff7c0 2024-09-13T16:51:35.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.682+0000 7f6bfb400640 1 -- 172.21.15.18:0/2112780483 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6bf4003fa0 con 0x7f6c040ff7c0 2024-09-13T16:51:35.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.684+0000 7f6bfb400640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6be80a1090 0x7f6be80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:35.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.684+0000 7f6bfb400640 1 -- 172.21.15.18:0/2112780483 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f6bf4014070 con 0x7f6c040ff7c0 2024-09-13T16:51:35.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.684+0000 7f6c02000640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6be80a1090 0x7f6be80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:35.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.685+0000 7f6c02000640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6be80a1090 0x7f6be80a3550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6c04073fd0 tx=0x7f6bf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:35.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.687+0000 7f6bfb400640 1 -- 172.21.15.18:0/2112780483 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6bf40d0030 con 0x7f6c040ff7c0 2024-09-13T16:51:35.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.907+0000 7f6c03e00640 1 -- 172.21.15.18:0/2112780483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c04106fe0 con 0x7f6c040ff7c0 2024-09-13T16:51:35.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.908+0000 7f6bfb400640 1 -- 172.21.15.18:0/2112780483 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10852 (secure 0 0 0) 0x7f6bf4096400 con 0x7f6c040ff7c0 2024-09-13T16:51:35.910 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:35.910 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:49:28.080578+0000","modified":"2024-09-13T16:49:57.790808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24590,"mds_1":24566,"mds_2":24539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24539":{"gid":24539,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:51:35.910 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 24 2024-09-13T16:51:35.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.910+0000 7f6c03e00640 1 -- 172.21.15.18:0/2112780483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6be80a1090 msgr2=0x7f6be80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.910+0000 7f6c03e00640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6be80a1090 0x7f6be80a3550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6c04073fd0 tx=0x7f6bf0005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:35.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.910+0000 7f6c03e00640 1 -- 172.21.15.18:0/2112780483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c040ff7c0 msgr2=0x7f6c04074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:35.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.910+0000 7f6c03e00640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c040ff7c0 0x7f6c04074260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400e9f0 tx=0x7f6bf400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.911+0000 7f6c03e00640 1 -- 172.21.15.18:0/2112780483 shutdown_connections 2024-09-13T16:51:35.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.911+0000 7f6c03e00640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c04101290 0x7f6c04072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.911+0000 7f6c03e00640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c04100180 0x7f6c040728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.911+0000 7f6c03e00640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6be80a1090 0x7f6be80a3550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.911+0000 7f6c03e00640 1 --2- 172.21.15.18:0/2112780483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c040ff7c0 0x7f6c04074260 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:35.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.911+0000 7f6c03e00640 1 -- 172.21.15.18:0/2112780483 >> 172.21.15.18:0/2112780483 conn(0x7f6c040fb310 msgr2=0x7f6c041041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:35.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.911+0000 7f6c03e00640 1 -- 172.21.15.18:0/2112780483 shutdown_connections 2024-09-13T16:51:35.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:35.911+0000 7f6c03e00640 1 -- 172.21.15.18:0/2112780483 wait complete. 2024-09-13T16:51:35.928 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T16:49:28.080578+0000', 'modified': '2024-09-13T16:49:57.790808+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24590, 'mds_1': 24566, 'mds_2': 24539}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24508': {'gid': 24508, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6835/81449437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 81449437}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 81449437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24520': {'gid': 24520, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6837/443543812', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 443543812}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 443543812}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24538': {'gid': 24538, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6839/506298733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 506298733}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 506298733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.94:6837/2839586927', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6836', 'nonce': 2839586927}, {'type': 'v1', 'addr': '172.21.15.94:6837', 'nonce': 2839586927}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24566': {'gid': 24566, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.18:6839/152668011', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6838', 'nonce': 152668011}, {'type': 'v1', 'addr': '172.21.15.18:6839', 'nonce': 152668011}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24590': {'gid': 24590, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6839/1508206800', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6838', 'nonce': 1508206800}, {'type': 'v1', 'addr': '172.21.15.94:6839', 'nonce': 1508206800}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T16:51:35.929 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T16:51:35.929 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-09-13T16:51:36.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.089+0000 7f41a0200640 1 -- 172.21.15.18:0/2552840996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41980744f0 msgr2=0x7f4198072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.089+0000 7f41a0200640 1 --2- 172.21.15.18:0/2552840996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41980744f0 0x7f4198072940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f418c009900 tx=0x7f418c02a410 comp rx=0 tx=0).stop 2024-09-13T16:51:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.089+0000 7f41a0200640 1 -- 172.21.15.18:0/2552840996 shutdown_connections 2024-09-13T16:51:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.089+0000 7f41a0200640 1 --2- 172.21.15.18:0/2552840996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4198107be0 0x7f419810a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.089+0000 7f41a0200640 1 --2- 172.21.15.18:0/2552840996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4198072f10 0x7f4198073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.089+0000 7f41a0200640 1 --2- 172.21.15.18:0/2552840996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41980744f0 0x7f4198072940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.089+0000 7f41a0200640 1 -- 172.21.15.18:0/2552840996 >> 172.21.15.18:0/2552840996 conn(0x7f41980fb4d0 msgr2=0x7f41980fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.089+0000 7f41a0200640 1 -- 172.21.15.18:0/2552840996 shutdown_connections 2024-09-13T16:51:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.090+0000 7f41a0200640 1 -- 172.21.15.18:0/2552840996 wait complete. 2024-09-13T16:51:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.090+0000 7f41a0200640 1 Processor -- start 2024-09-13T16:51:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.090+0000 7f41a0200640 1 -- start start 2024-09-13T16:51:36.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f41a0200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4198072f10 0x7f4198197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f41a0200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41980744f0 0x7f41981984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f41a0200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4198107be0 0x7f419819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f41a0200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419819fa90 con 0x7f41980744f0 2024-09-13T16:51:36.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f41a0200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419819fc00 con 0x7f4198107be0 2024-09-13T16:51:36.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f41a0200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419819fdc0 con 0x7f4198072f10 2024-09-13T16:51:36.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f419ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41980744f0 0x7f41981984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f419ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41980744f0 0x7f41981984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59574/0 (socket says 172.21.15.18:59574) 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f419ce00640 1 -- 172.21.15.18:0/3831237284 learned_addr learned my addr 172.21.15.18:0/3831237284 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f419d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4198072f10 0x7f4198197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f419e200640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4198107be0 0x7f419819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f419ce00640 1 -- 172.21.15.18:0/3831237284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4198072f10 msgr2=0x7f4198197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f419ce00640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4198072f10 0x7f4198197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f419ce00640 1 -- 172.21.15.18:0/3831237284 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4198107be0 msgr2=0x7f419819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f419ce00640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4198107be0 0x7f419819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.091+0000 7f419ce00640 1 -- 172.21.15.18:0/3831237284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c009560 con 0x7f41980744f0 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.092+0000 7f419ce00640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41980744f0 0x7f41981984e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f418400e9f0 tx=0x7f418400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.092+0000 7f4196000640 1 -- 172.21.15.18:0/3831237284 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184009700 con 0x7f41980744f0 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.092+0000 7f4196000640 1 -- 172.21.15.18:0/3831237284 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f418400cd80 con 0x7f41980744f0 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.092+0000 7f4196000640 1 -- 172.21.15.18:0/3831237284 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184018860 con 0x7f41980744f0 2024-09-13T16:51:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.092+0000 7f41a0200640 1 -- 172.21.15.18:0/3831237284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41981a00a0 con 0x7f41980744f0 2024-09-13T16:51:36.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.092+0000 7f41a0200640 1 -- 172.21.15.18:0/3831237284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41981a05b0 con 0x7f41980744f0 2024-09-13T16:51:36.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.095+0000 7f4196000640 1 -- 172.21.15.18:0/3831237284 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f41840189c0 con 0x7f41980744f0 2024-09-13T16:51:36.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.095+0000 7f41a2ff3740 1 Processor -- start 2024-09-13T16:51:36.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.095+0000 7f41a2ff3740 1 -- start start 2024-09-13T16:51:36.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b0b30 0x56488c7b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 0x56488c7b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c71aab0 con 0x56488c7b1470 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c718240 con 0x56488c7b0b30 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c713b30 con 0x56488c7b6500 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f419d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f419e200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b0b30 0x56488c7b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f419d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59586/0 (socket says 172.21.15.18:59586) 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f419d800640 1 -- 172.21.15.18:0/4134844946 learned_addr learned my addr 172.21.15.18:0/4134844946 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f419ce00640 1 --2- 172.21.15.18:0/4134844946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 0x56488c7b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f419e200640 1 -- 172.21.15.18:0/4134844946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 msgr2=0x56488c7b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f419e200640 1 --2- 172.21.15.18:0/4134844946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 0x56488c7b89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f419e200640 1 -- 172.21.15.18:0/4134844946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 msgr2=0x56488c7b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f419e200640 1 --2- 172.21.15.18:0/4134844946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.096+0000 7f419e200640 1 -- 172.21.15.18:0/4134844946 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56488c6debd0 con 0x56488c7b0b30 2024-09-13T16:51:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.097+0000 7f419e200640 1 --2- 172.21.15.18:0/4134844946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b0b30 0x56488c7b0f30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4190009f50 tx=0x7f4190003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3efe440fd254a08a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.097+0000 7f4196000640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f41800a1110 0x7f41800a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.097+0000 7f418aa00640 1 -- 172.21.15.18:0/4134844946 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190011440 con 0x56488c7b0b30 2024-09-13T16:51:36.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.097+0000 7f418aa00640 1 -- 172.21.15.18:0/4134844946 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4190011a60 con 0x56488c7b0b30 2024-09-13T16:51:36.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.097+0000 7f418aa00640 1 -- 172.21.15.18:0/4134844946 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900109e0 con 0x56488c7b0b30 2024-09-13T16:51:36.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.097+0000 7f4196000640 1 -- 172.21.15.18:0/3831237284 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f4184014070 con 0x7f41980744f0 2024-09-13T16:51:36.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.097+0000 7f419d800640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f41800a1110 0x7f41800a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f41a2ff3740 1 -- 172.21.15.18:0/4134844946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b0b30 msgr2=0x56488c7b0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/4134844946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b0b30 0x56488c7b0f30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4190009f50 tx=0x7f4190003e00 comp rx=0 tx=0).stop 2024-09-13T16:51:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f41a2ff3740 1 -- 172.21.15.18:0/4134844946 shutdown_connections 2024-09-13T16:51:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/4134844946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/4134844946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 0x56488c7b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/4134844946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b0b30 0x56488c7b0f30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f41a2ff3740 1 -- 172.21.15.18:0/4134844946 >> 172.21.15.18:0/4134844946 conn(0x56488c7ac1a0 msgr2=0x56488c7ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f419d800640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f41800a1110 0x7f41800a35d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f418c006010 tx=0x7f418c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f41a2ff3740 1 -- 172.21.15.18:0/4134844946 shutdown_connections 2024-09-13T16:51:36.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f41a2ff3740 1 -- 172.21.15.18:0/4134844946 wait complete. 2024-09-13T16:51:36.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.098+0000 7f41a2ff3740 1 -- start start 2024-09-13T16:51:36.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f41a2ff3740 1 Processor -- start 2024-09-13T16:51:36.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b0b30 0x56488c7ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7bad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 0x56488c7c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c6b5260 con 0x56488c7b0b30 2024-09-13T16:51:36.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c6b4f00 con 0x56488c7b1470 2024-09-13T16:51:36.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c47af20 con 0x56488c7b6500 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f41a2ff3740 10 client.0 _ll_register_callbacks cb 0x56488c70d1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f419d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b0b30 0x56488c7ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f419d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b0b30 0x56488c7ba7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59588/0 (socket says 172.21.15.18:59588) 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.099+0000 7f419d800640 1 -- 172.21.15.18:0/1297063350 learned_addr learned my addr 172.21.15.18:0/1297063350 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.100+0000 7f419e200640 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 0x56488c7c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.100+0000 7f419ce00640 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7bad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.100+0000 7f419e200640 1 -- 172.21.15.18:0/1297063350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 msgr2=0x56488c7bad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.100+0000 7f419e200640 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7bad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.100+0000 7f419e200640 1 -- 172.21.15.18:0/1297063350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b0b30 msgr2=0x56488c7ba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.100+0000 7f419e200640 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b0b30 0x56488c7ba7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.100+0000 7f419e200640 1 -- 172.21.15.18:0/1297063350 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4190009bb0 con 0x56488c7b6500 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.100+0000 7f419d800640 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b0b30 0x56488c7ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:36.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.100+0000 7f419ce00640 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.101+0000 7f417f400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.101+0000 7f419e200640 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 0x56488c7c1d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4190010480 tx=0x7f4190011ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fecca5badffa708d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.101+0000 7f417f400640 1 -- 172.21.15.18:0/1297063350 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190011640 con 0x56488c7b6500 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.101+0000 7f41a2ff3740 1 -- 172.21.15.18:0/1297063350 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56488c73dcd0 con 0x56488c7b6500 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.101+0000 7f417f400640 1 -- 172.21.15.18:0/1297063350 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f41900117a0 con 0x56488c7b6500 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.101+0000 7f417f400640 1 -- 172.21.15.18:0/1297063350 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4190010700 con 0x56488c7b6500 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.101+0000 7f41a2ff3740 10 client.25147 fetch_fsmap learned FSMap version 24 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.101+0000 7f41a2ff3740 1 -- 172.21.15.18:0/1297063350 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56488c7121b0 con 0x56488c7b6500 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.102+0000 7f417f400640 1 -- 172.21.15.18:0/1297063350 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56488c73dcd0 con 0x56488c7b6500 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.102+0000 7f417f400640 1 -- 172.21.15.18:0/1297063350 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f419001a8d0 con 0x56488c7b6500 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.102+0000 7f41a2ff3740 10 client.25147 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.102+0000 7f41a2ff3740 10 client.25147 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.102+0000 7f41a2ff3740 20 client.25147 populate_metadata read hostname 'smithi018' 2024-09-13T16:51:36.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.102+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x56488c7c6bd0 0x56488c7cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.102+0000 7f41a2ff3740 4 client.25147 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:51:36.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.102+0000 7f41a2ff3740 1 -- 172.21.15.18:0/1297063350 --> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56488c4073c0 con 0x56488c7c6bd0 2024-09-13T16:51:36.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.102+0000 7f419d800640 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x56488c7c6bd0 0x56488c7cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.103+0000 7f419d800640 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x56488c7c6bd0 0x56488c7cad50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6376cf128c518b1 server_cookie=d47cb6413d539de2 in_seq=0 out_seq=0 2024-09-13T16:51:36.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.103+0000 7f417f400640 10 client.25147 ms_handle_connect on v2:172.21.15.94:6836/2839586927 2024-09-13T16:51:36.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f417f400640 1 -- 172.21.15.18:0/1297063350 <== mds.2 v2:172.21.15.94:6836/2839586927 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56488c4073c0 con 0x56488c7c6bd0 2024-09-13T16:51:36.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f417f400640 10 client.25147 handle_command_reply: tid=0 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 client.25147 shutdown 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 -- 172.21.15.18:0/1297063350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 msgr2=0x56488c7c1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 0x56488c7c1d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4190010480 tx=0x7f4190011ec0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 -- 172.21.15.18:0/1297063350 shutdown_connections 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x56488c7c6bd0 0x56488c7cad50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b6500 0x56488c7c1d70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f417f400640 0 client.25147 ms_handle_reset on v2:172.21.15.94:6836/2839586927 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/1297063350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b0b30 0x56488c7ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 -- 172.21.15.18:0/1297063350 >> 172.21.15.18:0/1297063350 conn(0x56488c7ac1a0 msgr2=0x56488c7ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 -- 172.21.15.18:0/1297063350 shutdown_connections 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.104+0000 7f41a2ff3740 1 -- 172.21.15.18:0/1297063350 wait complete. 2024-09-13T16:51:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.105+0000 7f41a2ff3740 20 client.25147 trim_cache size 0 max 16384 2024-09-13T16:51:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f41a2ff3740 1 Processor -- start 2024-09-13T16:51:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f41a2ff3740 1 -- start start 2024-09-13T16:51:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b0b30 0x56488c7ba5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b6500 0x56488c7baae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c7c8660 con 0x56488c7b6500 2024-09-13T16:51:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c7b1bc0 con 0x56488c7b1470 2024-09-13T16:51:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c7b1d30 con 0x56488c7b0b30 2024-09-13T16:51:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f419ce00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f419e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b6500 0x56488c7baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f419ce00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:59658/0 (socket says 172.21.15.18:59658) 2024-09-13T16:51:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f419ce00640 1 -- 172.21.15.18:0/2426166532 learned_addr learned my addr 172.21.15.18:0/2426166532 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.123+0000 7f419d800640 1 --2- 172.21.15.18:0/2426166532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b0b30 0x56488c7ba5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.124+0000 7f419ce00640 1 -- 172.21.15.18:0/2426166532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b0b30 msgr2=0x56488c7ba5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.124+0000 7f419ce00640 1 --2- 172.21.15.18:0/2426166532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b0b30 0x56488c7ba5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.124+0000 7f419ce00640 1 -- 172.21.15.18:0/2426166532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b6500 msgr2=0x56488c7baae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.124+0000 7f419ce00640 1 --2- 172.21.15.18:0/2426166532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b6500 0x56488c7baae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.124+0000 7f419ce00640 1 -- 172.21.15.18:0/2426166532 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56488c6b4470 con 0x56488c7b1470 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.124+0000 7f419e200640 1 --2- 172.21.15.18:0/2426166532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b6500 0x56488c7baae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.124+0000 7f419ce00640 1 --2- 172.21.15.18:0/2426166532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7c1c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f41840965d0 tx=0x7f418401f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=331a41eeb55513ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.124+0000 7f418b400640 1 -- 172.21.15.18:0/2426166532 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418409de50 con 0x56488c7b1470 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.124+0000 7f418b400640 1 -- 172.21.15.18:0/2426166532 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f41840a24a0 con 0x56488c7b1470 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.124+0000 7f418b400640 1 -- 172.21.15.18:0/2426166532 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840a22e0 con 0x56488c7b1470 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 -- 172.21.15.18:0/2426166532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 msgr2=0x56488c7c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/2426166532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7c1c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f41840965d0 tx=0x7f418401f000 comp rx=0 tx=0).stop 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 -- 172.21.15.18:0/2426166532 shutdown_connections 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/2426166532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b6500 0x56488c7baae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/2426166532 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b1470 0x56488c7c1c90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/2426166532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b0b30 0x56488c7ba5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 -- 172.21.15.18:0/2426166532 >> 172.21.15.18:0/2426166532 conn(0x56488c7ac1a0 msgr2=0x56488c7b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 -- 172.21.15.18:0/2426166532 shutdown_connections 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 -- 172.21.15.18:0/2426166532 wait complete. 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 -- start start 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.125+0000 7f41a2ff3740 1 Processor -- start 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b0b30 0x56488c7bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f41a2ff3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b6500 0x56488c7bcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c81ca10 con 0x56488c7b1470 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c81cb50 con 0x56488c7b6500 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f41a2ff3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56488c81cc90 con 0x56488c7b0b30 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f41a2ff3740 10 client.0 _ll_register_callbacks cb 0x7f418c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f419ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f419ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59602/0 (socket says 172.21.15.18:59602) 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f419ce00640 1 -- 172.21.15.18:0/56119312 learned_addr learned my addr 172.21.15.18:0/56119312 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f419e200640 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b6500 0x56488c7bcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f419d800640 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b0b30 0x56488c7bc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f419ce00640 1 -- 172.21.15.18:0/56119312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b0b30 msgr2=0x56488c7bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f419ce00640 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b0b30 0x56488c7bc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f419ce00640 1 -- 172.21.15.18:0/56119312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b6500 msgr2=0x56488c7bcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f419ce00640 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b6500 0x56488c7bcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.126+0000 7f419ce00640 1 -- 172.21.15.18:0/56119312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56488c7121b0 con 0x56488c7b1470 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.127+0000 7f419ce00640 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7c1c60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f418409a060 tx=0x7f4184099b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57179d924278af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.127+0000 7f417f400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.127+0000 7f417f400640 1 -- 172.21.15.18:0/56119312 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840b8410 con 0x56488c7b1470 2024-09-13T16:51:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.127+0000 7f417f400640 1 -- 172.21.15.18:0/56119312 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f418409de50 con 0x56488c7b1470 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.127+0000 7f41a2ff3740 1 -- 172.21.15.18:0/56119312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4190011a60 con 0x56488c7b1470 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.127+0000 7f417f400640 1 -- 172.21.15.18:0/56119312 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41840b2bd0 con 0x56488c7b1470 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.127+0000 7f41a2ff3740 10 client.15129 fetch_fsmap learned FSMap version 24 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.127+0000 7f41a2ff3740 1 -- 172.21.15.18:0/56119312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f41981a05b0 con 0x56488c7b1470 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.127+0000 7f417f400640 1 -- 172.21.15.18:0/56119312 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4190011a60 con 0x56488c7b1470 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.128+0000 7f417f400640 1 -- 172.21.15.18:0/56119312 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f41840aa070 con 0x56488c7b1470 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.128+0000 7f41a2ff3740 10 client.15129 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.128+0000 7f41a2ff3740 10 client.15129 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.128+0000 7f41a2ff3740 20 client.15129 populate_metadata read hostname 'smithi018' 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.128+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x56488c821770 0x56488c81e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.128+0000 7f41a2ff3740 4 client.15129 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.128+0000 7f41a2ff3740 1 -- 172.21.15.18:0/56119312 --> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56488c4186c0 con 0x56488c821770 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.128+0000 7f419d800640 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x56488c821770 0x56488c81e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f419d800640 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x56488c821770 0x56488c81e190 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=723b6404e95b35dd server_cookie=c521d1aeca1642a3 in_seq=0 out_seq=0 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f417f400640 10 client.15129 ms_handle_connect on v2:172.21.15.94:6836/2839586927 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f417f400640 1 -- 172.21.15.18:0/56119312 <== mds.2 v2:172.21.15.94:6836/2839586927 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56488c4186c0 con 0x56488c821770 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f417f400640 10 client.15129 handle_command_reply: tid=0 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 client.15129 shutdown 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 -- 172.21.15.18:0/56119312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 msgr2=0x56488c7c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7c1c60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f418409a060 tx=0x7f4184099b30 comp rx=0 tx=0).stop 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 -- 172.21.15.18:0/56119312 shutdown_connections 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56488c7b1470 0x56488c7c1c60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x56488c821770 0x56488c81e190 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56488c7b6500 0x56488c7bcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 --2- 172.21.15.18:0/56119312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56488c7b0b30 0x56488c7bc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 -- 172.21.15.18:0/56119312 >> 172.21.15.18:0/56119312 conn(0x56488c7ac1a0 msgr2=0x56488c7b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f417f400640 0 client.15129 ms_handle_reset on v2:172.21.15.94:6836/2839586927 2024-09-13T16:51:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 -- 172.21.15.18:0/56119312 shutdown_connections 2024-09-13T16:51:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 1 -- 172.21.15.18:0/56119312 wait complete. 2024-09-13T16:51:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.129+0000 7f41a2ff3740 20 client.15129 trim_cache size 0 max 16384 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "d8ff35a0-71ee-11ef-bceb-c7b262605968", 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 2, 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24539, 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 99.350290362999999, 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 24, 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 93, 2024-09-13T16:51:36.140 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T16:51:36.141 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 145.32451649500001 2024-09-13T16:51:36.141 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T16:51:36.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 -- 172.21.15.18:0/3831237284 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f41800a1110 msgr2=0x7f41800a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f41800a1110 0x7f41800a35d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f418c006010 tx=0x7f418c0314a0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 -- 172.21.15.18:0/3831237284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41980744f0 msgr2=0x7f41981984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41980744f0 0x7f41981984e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f418400e9f0 tx=0x7f418400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 -- 172.21.15.18:0/3831237284 shutdown_connections 2024-09-13T16:51:36.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f41800a1110 0x7f41800a35d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41980744f0 0x7f41981984e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4198107be0 0x7f419819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 --2- 172.21.15.18:0/3831237284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4198072f10 0x7f4198197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 -- 172.21.15.18:0/3831237284 >> 172.21.15.18:0/3831237284 conn(0x7f41980fb4d0 msgr2=0x7f4198103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 -- 172.21.15.18:0/3831237284 shutdown_connections 2024-09-13T16:51:36.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.130+0000 7f41a0200640 1 -- 172.21.15.18:0/3831237284 wait complete. 2024-09-13T16:51:36.148 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2024-09-13T16:51:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:36 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/667394479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:51:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:36 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1046322298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:51:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:36 smithi018 ceph-mon[30981]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:36.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:36 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2112780483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:51:36.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.306+0000 7fa481e00640 1 -- 172.21.15.18:0/840929038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47c101f90 msgr2=0x7fa47c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.306+0000 7fa481e00640 1 --2- 172.21.15.18:0/840929038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47c101f90 0x7fa47c102390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009ca0 tx=0x7fa46c02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.306+0000 7fa481e00640 1 -- 172.21.15.18:0/840929038 shutdown_connections 2024-09-13T16:51:36.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.306+0000 7fa481e00640 1 --2- 172.21.15.18:0/840929038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa47c103b40 0x7fa47c10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.306+0000 7fa481e00640 1 --2- 172.21.15.18:0/840929038 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa47c103180 0x7fa47c103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.306+0000 7fa481e00640 1 --2- 172.21.15.18:0/840929038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47c101f90 0x7fa47c102390 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.306+0000 7fa481e00640 1 -- 172.21.15.18:0/840929038 >> 172.21.15.18:0/840929038 conn(0x7fa47c0fd6d0 msgr2=0x7fa47c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.306+0000 7fa481e00640 1 -- 172.21.15.18:0/840929038 shutdown_connections 2024-09-13T16:51:36.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.306+0000 7fa481e00640 1 -- 172.21.15.18:0/840929038 wait complete. 2024-09-13T16:51:36.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.307+0000 7fa481e00640 1 Processor -- start 2024-09-13T16:51:36.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.307+0000 7fa481e00640 1 -- start start 2024-09-13T16:51:36.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.307+0000 7fa481e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa47c101f90 0x7fa47c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.307+0000 7fa481e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47c103180 0x7fa47c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.307+0000 7fa481e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa47c103b40 0x7fa47c19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.307+0000 7fa481e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c19fa30 con 0x7fa47c103180 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.307+0000 7fa481e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c19fba0 con 0x7fa47c101f90 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.307+0000 7fa481e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c19fd60 con 0x7fa47c103b40 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa472000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47c103180 0x7fa47c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa472000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47c103180 0x7fa47c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59630/0 (socket says 172.21.15.18:59630) 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa472000640 1 -- 172.21.15.18:0/359740897 learned_addr learned my addr 172.21.15.18:0/359740897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa47aa00640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa47c101f90 0x7fa47c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa47b400640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa47c103b40 0x7fa47c19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa472000640 1 -- 172.21.15.18:0/359740897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa47c103b40 msgr2=0x7fa47c19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa472000640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa47c103b40 0x7fa47c19f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa472000640 1 -- 172.21.15.18:0/359740897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa47c101f90 msgr2=0x7fa47c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa472000640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa47c101f90 0x7fa47c197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa472000640 1 -- 172.21.15.18:0/359740897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c009900 con 0x7fa47c103180 2024-09-13T16:51:36.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa47b400640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa47c103b40 0x7fa47c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:51:36.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa472000640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47c103180 0x7fa47c198480 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa46400e9f0 tx=0x7fa46400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.308+0000 7fa480a00640 1 -- 172.21.15.18:0/359740897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464009700 con 0x7fa47c103180 2024-09-13T16:51:36.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.309+0000 7fa480a00640 1 -- 172.21.15.18:0/359740897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa46400cd80 con 0x7fa47c103180 2024-09-13T16:51:36.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.309+0000 7fa481e00640 1 -- 172.21.15.18:0/359740897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47c19ffe0 con 0x7fa47c103180 2024-09-13T16:51:36.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.309+0000 7fa480a00640 1 -- 172.21.15.18:0/359740897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464018860 con 0x7fa47c103180 2024-09-13T16:51:36.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.309+0000 7fa481e00640 1 -- 172.21.15.18:0/359740897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47c1a04c0 con 0x7fa47c103180 2024-09-13T16:51:36.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.312+0000 7fa484c0b740 1 Processor -- start 2024-09-13T16:51:36.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.312+0000 7fa480a00640 1 -- 172.21.15.18:0/359740897 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa4640189c0 con 0x7fa47c103180 2024-09-13T16:51:36.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.312+0000 7fa484c0b740 1 -- start start 2024-09-13T16:51:36.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.312+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 0x5555d0c01f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.312+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c06f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.312+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c07500 0x5555d0c099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.312+0000 7fa484c0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0b6bab0 con 0x5555d0c07500 2024-09-13T16:51:36.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.312+0000 7fa484c0b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0b69240 con 0x5555d0c02470 2024-09-13T16:51:36.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.312+0000 7fa484c0b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0b64b30 con 0x5555d0c01b30 2024-09-13T16:51:36.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 0x5555d0c01f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47aa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c06f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 0x5555d0c01f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:50438/0 (socket says 172.21.15.18:50438) 2024-09-13T16:51:36.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47b400640 1 -- 172.21.15.18:0/2580126654 learned_addr learned my addr 172.21.15.18:0/2580126654 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa472000640 1 --2- 172.21.15.18:0/2580126654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c07500 0x5555d0c099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47b400640 1 -- 172.21.15.18:0/2580126654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 msgr2=0x5555d0c06f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47b400640 1 --2- 172.21.15.18:0/2580126654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c06f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47b400640 1 -- 172.21.15.18:0/2580126654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c07500 msgr2=0x5555d0c099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47b400640 1 --2- 172.21.15.18:0/2580126654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c07500 0x5555d0c099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47b400640 1 -- 172.21.15.18:0/2580126654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555d0b2fbd0 con 0x5555d0c01b30 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47aa00640 1 --2- 172.21.15.18:0/2580126654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c06f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa47b400640 1 --2- 172.21.15.18:0/2580126654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 0x5555d0c01f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa474009cc0 tx=0x7fa4740117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f2cc2f38ab3a893 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.313+0000 7fa480a00640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4600a1090 0x7fa4600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa470c00640 1 -- 172.21.15.18:0/2580126654 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474009790 con 0x5555d0c01b30 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa470c00640 1 -- 172.21.15.18:0/2580126654 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa474012910 con 0x5555d0c01b30 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa470c00640 1 -- 172.21.15.18:0/2580126654 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47400fb40 con 0x5555d0c01b30 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa480a00640 1 -- 172.21.15.18:0/359740897 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa464014070 con 0x7fa47c103180 2024-09-13T16:51:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa47aa00640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4600a1090 0x7fa4600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa484c0b740 1 -- 172.21.15.18:0/2580126654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 msgr2=0x5555d0c01f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa484c0b740 1 --2- 172.21.15.18:0/2580126654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 0x5555d0c01f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa474009cc0 tx=0x7fa4740117b0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa47aa00640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4600a1090 0x7fa4600a3550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa46c005e30 tx=0x7fa46c009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa484c0b740 1 -- 172.21.15.18:0/2580126654 shutdown_connections 2024-09-13T16:51:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa484c0b740 1 --2- 172.21.15.18:0/2580126654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c07500 0x5555d0c099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa484c0b740 1 --2- 172.21.15.18:0/2580126654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c06f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa484c0b740 1 --2- 172.21.15.18:0/2580126654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 0x5555d0c01f30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.314+0000 7fa484c0b740 1 -- 172.21.15.18:0/2580126654 >> 172.21.15.18:0/2580126654 conn(0x5555d0bfd1a0 msgr2=0x5555d0bfd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.315+0000 7fa484c0b740 1 -- 172.21.15.18:0/2580126654 shutdown_connections 2024-09-13T16:51:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.315+0000 7fa484c0b740 1 -- 172.21.15.18:0/2580126654 wait complete. 2024-09-13T16:51:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.315+0000 7fa484c0b740 1 -- start start 2024-09-13T16:51:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.315+0000 7fa484c0b740 1 Processor -- start 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c07500 0x5555d0c12ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa484c0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0b06260 con 0x5555d0c01b30 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa484c0b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0b05f00 con 0x5555d0c02470 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa484c0b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d08cbf20 con 0x5555d0c07500 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa484c0b740 10 client.0 _ll_register_callbacks cb 0x5555d0b5e1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa47aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa47aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59660/0 (socket says 172.21.15.18:59660) 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa47aa00640 1 -- 172.21.15.18:0/3349106654 learned_addr learned my addr 172.21.15.18:0/3349106654 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa472000640 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa47b400640 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c07500 0x5555d0c12ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa47aa00640 1 -- 172.21.15.18:0/3349106654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c07500 msgr2=0x5555d0c12ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa47aa00640 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c07500 0x5555d0c12ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa47aa00640 1 -- 172.21.15.18:0/3349106654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 msgr2=0x5555d0c0bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa47aa00640 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa47aa00640 1 -- 172.21.15.18:0/3349106654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4740098f0 con 0x5555d0c01b30 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.316+0000 7fa472000640 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.317+0000 7fa47aa00640 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0b760 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa46c02aeb0 tx=0x7fa46c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218c11f5dfae772c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.317+0000 7fa469600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.317+0000 7fa469600640 1 -- 172.21.15.18:0/3349106654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c042070 con 0x5555d0c01b30 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.317+0000 7fa469600640 1 -- 172.21.15.18:0/3349106654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa46c0307d0 con 0x5555d0c01b30 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.317+0000 7fa484c0b740 1 -- 172.21.15.18:0/3349106654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555d0b8ecd0 con 0x5555d0c01b30 2024-09-13T16:51:36.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.317+0000 7fa469600640 1 -- 172.21.15.18:0/3349106654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa46c030990 con 0x5555d0c01b30 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.317+0000 7fa484c0b740 10 client.15141 fetch_fsmap learned FSMap version 24 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.317+0000 7fa484c0b740 1 -- 172.21.15.18:0/3349106654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5555d0b631b0 con 0x5555d0c01b30 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.317+0000 7fa469600640 1 -- 172.21.15.18:0/3349106654 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5555d0b8ecd0 con 0x5555d0c01b30 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.318+0000 7fa469600640 1 -- 172.21.15.18:0/3349106654 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa46c02f720 con 0x5555d0c01b30 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.318+0000 7fa484c0b740 10 client.15141 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.318+0000 7fa484c0b740 10 client.15141 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.318+0000 7fa484c0b740 20 client.15141 populate_metadata read hostname 'smithi018' 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.318+0000 7fa484c0b740 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5555d0c17200 0x5555d0c1bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.318+0000 7fa484c0b740 4 client.15141 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.318+0000 7fa484c0b740 1 -- 172.21.15.18:0/3349106654 --> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555d08583c0 con 0x5555d0c17200 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.318+0000 7fa472000640 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5555d0c17200 0x5555d0c1bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.319+0000 7fa472000640 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5555d0c17200 0x5555d0c1bea0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a7bb92ff7887b49 server_cookie=6d7a88de5977245c in_seq=0 out_seq=0 2024-09-13T16:51:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.319+0000 7fa469600640 10 client.15141 ms_handle_connect on v2:172.21.15.18:6838/152668011 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.319+0000 7fa469600640 1 -- 172.21.15.18:0/3349106654 <== mds.1 v2:172.21.15.18:6838/152668011 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5555d08583c0 con 0x5555d0c17200 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.319+0000 7fa469600640 10 client.15141 handle_command_reply: tid=0 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.319+0000 7fa484c0b740 1 client.15141 shutdown 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 1 -- 172.21.15.18:0/3349106654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 msgr2=0x5555d0c0b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0b760 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa46c02aeb0 tx=0x7fa46c02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 1 -- 172.21.15.18:0/3349106654 shutdown_connections 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5555d0c17200 0x5555d0c1bea0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c07500 0x5555d0c12ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa469600640 0 client.15141 ms_handle_reset on v2:172.21.15.18:6838/152668011 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 1 --2- 172.21.15.18:0/3349106654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0b760 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 1 -- 172.21.15.18:0/3349106654 >> 172.21.15.18:0/3349106654 conn(0x5555d0bfd1a0 msgr2=0x5555d0bfe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 1 -- 172.21.15.18:0/3349106654 shutdown_connections 2024-09-13T16:51:36.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 1 -- 172.21.15.18:0/3349106654 wait complete. 2024-09-13T16:51:36.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.320+0000 7fa484c0b740 20 client.15141 trim_cache size 0 max 16384 2024-09-13T16:51:36.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.335+0000 7fa484c0b740 1 Processor -- start 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa484c0b740 1 -- start start 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0bfd1a0 0x5555d0c13750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 0x5555d0c12c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa484c0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0c0a720 con 0x5555d0bfd1a0 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa484c0b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0c0c950 con 0x5555d0c02470 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa484c0b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0b5d8d0 con 0x5555d0c01b30 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa47aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0bfd1a0 0x5555d0c13750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa47aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0bfd1a0 0x5555d0c13750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59664/0 (socket says 172.21.15.18:59664) 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa47aa00640 1 -- 172.21.15.18:0/2350171102 learned_addr learned my addr 172.21.15.18:0/2350171102 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa47b400640 1 --2- 172.21.15.18:0/2350171102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa472000640 1 --2- 172.21.15.18:0/2350171102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 0x5555d0c12c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa47aa00640 1 -- 172.21.15.18:0/2350171102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 msgr2=0x5555d0c12c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa47aa00640 1 --2- 172.21.15.18:0/2350171102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 0x5555d0c12c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa47aa00640 1 -- 172.21.15.18:0/2350171102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 msgr2=0x5555d0c0b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa47aa00640 1 --2- 172.21.15.18:0/2350171102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa47aa00640 1 -- 172.21.15.18:0/2350171102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555d0b05470 con 0x5555d0bfd1a0 2024-09-13T16:51:36.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.336+0000 7fa47b400640 1 --2- 172.21.15.18:0/2350171102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.337+0000 7fa47aa00640 1 --2- 172.21.15.18:0/2350171102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0bfd1a0 0x5555d0c13750 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa46c02fa50 tx=0x7fa46c009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d96164adaf4bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.337+0000 7fa471600640 1 -- 172.21.15.18:0/2350171102 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c02fcf0 con 0x5555d0bfd1a0 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.337+0000 7fa471600640 1 -- 172.21.15.18:0/2350171102 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa46c02fe50 con 0x5555d0bfd1a0 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.337+0000 7fa471600640 1 -- 172.21.15.18:0/2350171102 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c004600 con 0x5555d0bfd1a0 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 -- 172.21.15.18:0/2350171102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0bfd1a0 msgr2=0x5555d0c13750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 --2- 172.21.15.18:0/2350171102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0bfd1a0 0x5555d0c13750 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa46c02fa50 tx=0x7fa46c009890 comp rx=0 tx=0).stop 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 -- 172.21.15.18:0/2350171102 shutdown_connections 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 --2- 172.21.15.18:0/2350171102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 --2- 172.21.15.18:0/2350171102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0c01b30 0x5555d0c12c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 --2- 172.21.15.18:0/2350171102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0bfd1a0 0x5555d0c13750 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 -- 172.21.15.18:0/2350171102 >> 172.21.15.18:0/2350171102 conn(0x5555d0c09c60 msgr2=0x5555d0c032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 -- 172.21.15.18:0/2350171102 shutdown_connections 2024-09-13T16:51:36.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 -- 172.21.15.18:0/2350171102 wait complete. 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 -- start start 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.338+0000 7fa484c0b740 1 Processor -- start 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0bfd1a0 0x5555d0c12aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa484c0b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa484c0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0c10180 con 0x5555d0c01b30 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa484c0b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0c6db60 con 0x5555d0c02470 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa484c0b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d0c6dca0 con 0x5555d0bfd1a0 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa484c0b740 10 client.0 _ll_register_callbacks cb 0x7fa46c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa472000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa472000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59676/0 (socket says 172.21.15.18:59676) 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa472000640 1 -- 172.21.15.18:0/491678525 learned_addr learned my addr 172.21.15.18:0/491678525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa47aa00640 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0bfd1a0 0x5555d0c12aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa47b400640 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa472000640 1 -- 172.21.15.18:0/491678525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0bfd1a0 msgr2=0x5555d0c12aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa472000640 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0bfd1a0 0x5555d0c12aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa472000640 1 -- 172.21.15.18:0/491678525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 msgr2=0x5555d0c0fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa472000640 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.339+0000 7fa472000640 1 -- 172.21.15.18:0/491678525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555d0b2fbd0 con 0x5555d0c01b30 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.340+0000 7fa472000640 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0f540 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa46401f040 tx=0x7fa4640d0880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794eaecad4322c5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.340+0000 7fa469600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.340+0000 7fa469600640 1 -- 172.21.15.18:0/491678525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46409a0d0 con 0x5555d0c01b30 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.340+0000 7fa484c0b740 1 -- 172.21.15.18:0/491678525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa474012910 con 0x5555d0c01b30 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.340+0000 7fa469600640 1 -- 172.21.15.18:0/491678525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa46409df00 con 0x5555d0c01b30 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.340+0000 7fa469600640 1 -- 172.21.15.18:0/491678525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4640a2550 con 0x5555d0c01b30 2024-09-13T16:51:36.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.340+0000 7fa484c0b740 10 client.15147 fetch_fsmap learned FSMap version 24 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.340+0000 7fa484c0b740 1 -- 172.21.15.18:0/491678525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5555d0b631b0 con 0x5555d0c01b30 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.340+0000 7fa469600640 1 -- 172.21.15.18:0/491678525 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa474012910 con 0x5555d0c01b30 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.341+0000 7fa469600640 1 -- 172.21.15.18:0/491678525 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa464095ec0 con 0x5555d0c01b30 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.341+0000 7fa484c0b740 10 client.15147 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.341+0000 7fa484c0b740 10 client.15147 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.341+0000 7fa484c0b740 20 client.15147 populate_metadata read hostname 'smithi018' 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.341+0000 7fa484c0b740 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5555d0c07500 0x5555d0c6f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.341+0000 7fa484c0b740 4 client.15147 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.341+0000 7fa484c0b740 1 -- 172.21.15.18:0/491678525 --> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5555d08696c0 con 0x5555d0c07500 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.341+0000 7fa47aa00640 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5555d0c07500 0x5555d0c6f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.341+0000 7fa47aa00640 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5555d0c07500 0x5555d0c6f3e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=898a8598a46a0035 server_cookie=ac6532631e0bf7a4 in_seq=0 out_seq=0 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa469600640 10 client.15147 ms_handle_connect on v2:172.21.15.18:6838/152668011 2024-09-13T16:51:36.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa469600640 1 -- 172.21.15.18:0/491678525 <== mds.1 v2:172.21.15.18:6838/152668011 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x5555d08696c0 con 0x5555d0c07500 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa469600640 10 client.15147 handle_command_reply: tid=0 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 client.15147 shutdown 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 -- 172.21.15.18:0/491678525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 msgr2=0x5555d0c0f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0f540 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa46401f040 tx=0x7fa4640d0880 comp rx=0 tx=0).stop 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 -- 172.21.15.18:0/491678525 shutdown_connections 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5555d0c07500 0x5555d0c6f3e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5555d0c01b30 0x5555d0c0f540 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5555d0c02470 0x5555d0c0fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 --2- 172.21.15.18:0/491678525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555d0bfd1a0 0x5555d0c12aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa469600640 0 client.15147 ms_handle_reset on v2:172.21.15.18:6838/152668011 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 -- 172.21.15.18:0/491678525 >> 172.21.15.18:0/491678525 conn(0x5555d0c09c60 msgr2=0x5555d0c06500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 -- 172.21.15.18:0/491678525 shutdown_connections 2024-09-13T16:51:36.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 1 -- 172.21.15.18:0/491678525 wait complete. 2024-09-13T16:51:36.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.342+0000 7fa484c0b740 20 client.15147 trim_cache size 0 max 16384 2024-09-13T16:51:36.349 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T16:51:36.349 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "d8ff35a0-71ee-11ef-bceb-c7b262605968", 2024-09-13T16:51:36.349 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 1, 2024-09-13T16:51:36.349 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24566, 2024-09-13T16:51:36.349 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-13T16:51:36.349 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-13T16:51:36.349 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-13T16:51:36.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 100.567220245, 2024-09-13T16:51:36.350 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 24, 2024-09-13T16:51:36.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 93, 2024-09-13T16:51:36.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T16:51:36.350 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 139.435348473 2024-09-13T16:51:36.350 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T16:51:36.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 -- 172.21.15.18:0/359740897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4600a1090 msgr2=0x7fa4600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4600a1090 0x7fa4600a3550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa46c005e30 tx=0x7fa46c009800 comp rx=0 tx=0).stop 2024-09-13T16:51:36.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 -- 172.21.15.18:0/359740897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47c103180 msgr2=0x7fa47c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47c103180 0x7fa47c198480 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa46400e9f0 tx=0x7fa46400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 -- 172.21.15.18:0/359740897 shutdown_connections 2024-09-13T16:51:36.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa4600a1090 0x7fa4600a3550 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47c103180 0x7fa47c198480 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa47c103b40 0x7fa47c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 --2- 172.21.15.18:0/359740897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa47c101f90 0x7fa47c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 -- 172.21.15.18:0/359740897 >> 172.21.15.18:0/359740897 conn(0x7fa47c0fd6d0 msgr2=0x7fa47c1065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 -- 172.21.15.18:0/359740897 shutdown_connections 2024-09-13T16:51:36.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.343+0000 7fa481e00640 1 -- 172.21.15.18:0/359740897 wait complete. 2024-09-13T16:51:36.359 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T16:51:36.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:36 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/667394479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:51:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:36 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1046322298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:51:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:36 smithi094 ceph-mon[35259]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:36.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:36 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2112780483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:51:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.515+0000 7f9f00c00640 1 -- 172.21.15.18:0/421734395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9efc102f70 msgr2=0x7f9efc1033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.515+0000 7f9f00c00640 1 --2- 172.21.15.18:0/421734395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9efc102f70 0x7f9efc1033f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009900 tx=0x7f9ee402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.516+0000 7f9f00c00640 1 -- 172.21.15.18:0/421734395 shutdown_connections 2024-09-13T16:51:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.516+0000 7f9f00c00640 1 --2- 172.21.15.18:0/421734395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9efc102f70 0x7f9efc1033f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.516+0000 7f9f00c00640 1 --2- 172.21.15.18:0/421734395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9efc103930 0x7f9efc10a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.516+0000 7f9f00c00640 1 --2- 172.21.15.18:0/421734395 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9efc101d80 0x7f9efc102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.516+0000 7f9f00c00640 1 -- 172.21.15.18:0/421734395 >> 172.21.15.18:0/421734395 conn(0x7f9efc0fd500 msgr2=0x7f9efc0ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.516+0000 7f9f00c00640 1 -- 172.21.15.18:0/421734395 shutdown_connections 2024-09-13T16:51:36.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.516+0000 7f9f00c00640 1 -- 172.21.15.18:0/421734395 wait complete. 2024-09-13T16:51:36.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9f00c00640 1 Processor -- start 2024-09-13T16:51:36.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9f00c00640 1 -- start start 2024-09-13T16:51:36.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9f00c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9efc101d80 0x7f9efc197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9f00c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9efc102f70 0x7f9efc198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9f00c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9efc103930 0x7f9efc19f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9f00c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc19f8a0 con 0x7f9efc101d80 2024-09-13T16:51:36.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9f00c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc19fa10 con 0x7f9efc103930 2024-09-13T16:51:36.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9f00c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc19fbd0 con 0x7f9efc102f70 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9efb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9efc101d80 0x7f9efc197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9efb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9efc101d80 0x7f9efc197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59684/0 (socket says 172.21.15.18:59684) 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9efb400640 1 -- 172.21.15.18:0/3943269393 learned_addr learned my addr 172.21.15.18:0/3943269393 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9efbe00640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9efc103930 0x7f9efc19f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.517+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9efc102f70 0x7f9efc198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9efb400640 1 -- 172.21.15.18:0/3943269393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9efc102f70 msgr2=0x7f9efc198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9efb400640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9efc102f70 0x7f9efc198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9efb400640 1 -- 172.21.15.18:0/3943269393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9efc103930 msgr2=0x7f9efc19f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9efb400640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9efc103930 0x7f9efc19f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9efb400640 1 -- 172.21.15.18:0/3943269393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec009490 con 0x7f9efc101d80 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9efbe00640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9efc103930 0x7f9efc19f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:51:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9efb400640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9efc101d80 0x7f9efc197dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00e9c0 tx=0x7f9eec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9ef8c00640 1 -- 172.21.15.18:0/3943269393 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00cde0 con 0x7f9efc101d80 2024-09-13T16:51:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9ef8c00640 1 -- 172.21.15.18:0/3943269393 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9eec0108f0 con 0x7f9efc101d80 2024-09-13T16:51:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9ef8c00640 1 -- 172.21.15.18:0/3943269393 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0188c0 con 0x7f9efc101d80 2024-09-13T16:51:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9f00c00640 1 -- 172.21.15.18:0/3943269393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee4009560 con 0x7f9efc101d80 2024-09-13T16:51:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.518+0000 7f9f00c00640 1 -- 172.21.15.18:0/3943269393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc1a0180 con 0x7f9efc101d80 2024-09-13T16:51:36.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:36 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/667394479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:51:36.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:36 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1046322298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:51:36.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:36 smithi144 ceph-mon[35328]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:36.523 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:36 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2112780483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:51:36.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.521+0000 7f9ef8c00640 1 -- 172.21.15.18:0/3943269393 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9eec010a60 con 0x7f9efc101d80 2024-09-13T16:51:36.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.521+0000 7f9f05002740 1 Processor -- start 2024-09-13T16:51:36.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.521+0000 7f9f05002740 1 -- start start 2024-09-13T16:51:36.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9f05002740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415984dca0 0x56415984e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9f05002740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 0x5641598530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9f05002740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564159853670 0x564159855b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9f05002740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641597b7ab0 con 0x56415984dca0 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9f05002740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641597b5240 con 0x56415984e5e0 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9f05002740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641597b0b30 con 0x564159853670 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415984dca0 0x56415984e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415984dca0 0x56415984e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59696/0 (socket says 172.21.15.18:59696) 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9efbe00640 1 -- 172.21.15.18:0/1342855901 learned_addr learned my addr 172.21.15.18:0/1342855901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9efb400640 1 --2- 172.21.15.18:0/1342855901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 0x5641598530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/1342855901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564159853670 0x564159855b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9efbe00640 1 -- 172.21.15.18:0/1342855901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564159853670 msgr2=0x564159855b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9efbe00640 1 --2- 172.21.15.18:0/1342855901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564159853670 0x564159855b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9efbe00640 1 -- 172.21.15.18:0/1342855901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 msgr2=0x5641598530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9efbe00640 1 --2- 172.21.15.18:0/1342855901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 0x5641598530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.522+0000 7f9efbe00640 1 -- 172.21.15.18:0/1342855901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56415977bbd0 con 0x56415984dca0 2024-09-13T16:51:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.523+0000 7f9ef8c00640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ee00a1110 0x7f9ee00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.523+0000 7f9efbe00640 1 --2- 172.21.15.18:0/1342855901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415984dca0 0x56415984e0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009fd0 tx=0x7f9ef40108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a153a5d07012459 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.523+0000 7f9ef8c00640 1 -- 172.21.15.18:0/3943269393 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9eec014070 con 0x7f9efc101d80 2024-09-13T16:51:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.523+0000 7f9ef0c00640 1 -- 172.21.15.18:0/1342855901 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4011760 con 0x56415984dca0 2024-09-13T16:51:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.523+0000 7f9efb400640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ee00a1110 0x7f9ee00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.523+0000 7f9ef0c00640 1 -- 172.21.15.18:0/1342855901 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ef4015070 con 0x56415984dca0 2024-09-13T16:51:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.523+0000 7f9ef0c00640 1 -- 172.21.15.18:0/1342855901 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef401bd60 con 0x56415984dca0 2024-09-13T16:51:36.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9efb400640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ee00a1110 0x7f9ee00a35d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0a23d0 tx=0x7f9eec096040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9f05002740 1 -- 172.21.15.18:0/1342855901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415984dca0 msgr2=0x56415984e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9f05002740 1 --2- 172.21.15.18:0/1342855901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415984dca0 0x56415984e0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009fd0 tx=0x7f9ef40108e0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9f05002740 1 -- 172.21.15.18:0/1342855901 shutdown_connections 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9f05002740 1 --2- 172.21.15.18:0/1342855901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564159853670 0x564159855b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9f05002740 1 --2- 172.21.15.18:0/1342855901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 0x5641598530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9f05002740 1 --2- 172.21.15.18:0/1342855901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415984dca0 0x56415984e0a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9f05002740 1 -- 172.21.15.18:0/1342855901 >> 172.21.15.18:0/1342855901 conn(0x564159849310 msgr2=0x564159849710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9f05002740 1 -- 172.21.15.18:0/1342855901 shutdown_connections 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9f05002740 1 -- 172.21.15.18:0/1342855901 wait complete. 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.524+0000 7f9f05002740 1 -- start start 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9f05002740 1 Processor -- start 2024-09-13T16:51:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9f05002740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 0x5641598578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9f05002740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 0x564159857e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9f05002740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x56415985ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9f05002740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x564159752260 con 0x564159853670 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9f05002740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x564159751f00 con 0x56415984dca0 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9f05002740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564159517f20 con 0x56415984e5e0 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9f05002740 10 client.0 _ll_register_callbacks cb 0x5641597aa1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x56415985ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x56415985ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59702/0 (socket says 172.21.15.18:59702) 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9ef2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 0x564159857e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.525+0000 7f9efbe00640 1 -- 172.21.15.18:0/2535219178 learned_addr learned my addr 172.21.15.18:0/2535219178 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.526+0000 7f9efbe00640 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 0x5641598578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.526+0000 7f9ef2a00640 1 -- 172.21.15.18:0/2535219178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 msgr2=0x5641598578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.526+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 0x5641598578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.526+0000 7f9ef2a00640 1 -- 172.21.15.18:0/2535219178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 msgr2=0x56415985ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.526+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x56415985ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.526+0000 7f9ef2a00640 1 -- 172.21.15.18:0/2535219178 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef4009cb0 con 0x56415984e5e0 2024-09-13T16:51:36.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.526+0000 7f9efbe00640 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x56415985ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:36.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.526+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 0x564159857e30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ee402a910 tx=0x7f9ee40044f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23fdcd34c75fd6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.526+0000 7f9ee9600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:51:36.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.526+0000 7f9ee9600640 1 -- 172.21.15.18:0/2535219178 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4003930 con 0x56415984e5e0 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9f05002740 1 -- 172.21.15.18:0/2535219178 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641597dacd0 con 0x56415984e5e0 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9ee9600640 1 -- 172.21.15.18:0/2535219178 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9ee4003a90 con 0x56415984e5e0 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9ee9600640 1 -- 172.21.15.18:0/2535219178 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ee4003c50 con 0x56415984e5e0 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9f05002740 10 client.25183 fetch_fsmap learned FSMap version 24 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9f05002740 1 -- 172.21.15.18:0/2535219178 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5641597af1b0 con 0x56415984e5e0 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9ee9600640 1 -- 172.21.15.18:0/2535219178 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5641597dacd0 con 0x56415984e5e0 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9ee9600640 1 -- 172.21.15.18:0/2535219178 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9ee4046470 con 0x56415984e5e0 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9f05002740 10 client.25183 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9f05002740 10 client.25183 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9f05002740 20 client.25183 populate_metadata read hostname 'smithi018' 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9f05002740 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x564159863e60 0x564159867fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9f05002740 4 client.25183 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:51:36.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.527+0000 7f9f05002740 1 -- 172.21.15.18:0/2535219178 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641594a43c0 con 0x564159863e60 2024-09-13T16:51:36.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.528+0000 7f9efbe00640 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x564159863e60 0x564159867fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.528+0000 7f9efbe00640 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x564159863e60 0x564159867fc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c115bfa1f15c5fba server_cookie=eb421dff567a2dcf in_seq=0 out_seq=0 2024-09-13T16:51:36.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.528+0000 7f9ee9600640 10 client.25183 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:51:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9ee9600640 1 -- 172.21.15.18:0/2535219178 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5641594a43c0 con 0x564159863e60 2024-09-13T16:51:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9ee9600640 10 client.25183 handle_command_reply: tid=0 2024-09-13T16:51:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9f05002740 1 client.25183 shutdown 2024-09-13T16:51:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9f05002740 1 -- 172.21.15.18:0/2535219178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 msgr2=0x564159857e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9f05002740 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 0x564159857e30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ee402a910 tx=0x7f9ee40044f0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9f05002740 1 -- 172.21.15.18:0/2535219178 shutdown_connections 2024-09-13T16:51:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9f05002740 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x564159863e60 0x564159867fc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9f05002740 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x56415985ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9f05002740 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 0x564159857e30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9f05002740 1 --2- 172.21.15.18:0/2535219178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 0x5641598578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9ee9600640 0 client.25183 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:51:36.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.529+0000 7f9f05002740 1 -- 172.21.15.18:0/2535219178 >> 172.21.15.18:0/2535219178 conn(0x564159849310 msgr2=0x564159848650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.530+0000 7f9f05002740 1 -- 172.21.15.18:0/2535219178 shutdown_connections 2024-09-13T16:51:36.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.530+0000 7f9f05002740 1 -- 172.21.15.18:0/2535219178 wait complete. 2024-09-13T16:51:36.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.530+0000 7f9f05002740 20 client.25183 trim_cache size 0 max 16384 2024-09-13T16:51:36.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.545+0000 7f9f05002740 1 Processor -- start 2024-09-13T16:51:36.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.545+0000 7f9f05002740 1 -- start start 2024-09-13T16:51:36.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.545+0000 7f9f05002740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984dca0 0x56415985f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.545+0000 7f9f05002740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 0x56415985ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.545+0000 7f9f05002740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x564159857db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.545+0000 7f9f05002740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641598491d0 con 0x564159853670 2024-09-13T16:51:36.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.545+0000 7f9f05002740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415984da50 con 0x56415984e5e0 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.545+0000 7f9f05002740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415984ed30 con 0x56415984dca0 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9ef2a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 0x56415985ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x564159857db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9ef2a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 0x56415985ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:59782/0 (socket says 172.21.15.18:59782) 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9ef2a00640 1 -- 172.21.15.18:0/535244808 learned_addr learned my addr 172.21.15.18:0/535244808 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9efbe00640 1 --2- 172.21.15.18:0/535244808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984dca0 0x56415985f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9ef2a00640 1 -- 172.21.15.18:0/535244808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984dca0 msgr2=0x56415985f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/535244808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984dca0 0x56415985f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9ef2a00640 1 -- 172.21.15.18:0/535244808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 msgr2=0x564159857db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/535244808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x564159857db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9ef2a00640 1 -- 172.21.15.18:0/535244808 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564159751470 con 0x56415984e5e0 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9efbe00640 1 --2- 172.21.15.18:0/535244808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x564159857db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.546+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/535244808 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 0x56415985ee30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009900 tx=0x7f9ee4001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302a531894c24349 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9ef1600640 1 -- 172.21.15.18:0/535244808 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4046aa0 con 0x56415984e5e0 2024-09-13T16:51:36.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9ef1600640 1 -- 172.21.15.18:0/535244808 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ee4041070 con 0x56415984e5e0 2024-09-13T16:51:36.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9ef1600640 1 -- 172.21.15.18:0/535244808 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee403b7d0 con 0x56415984e5e0 2024-09-13T16:51:36.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9f05002740 1 -- 172.21.15.18:0/535244808 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 msgr2=0x56415985ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9f05002740 1 --2- 172.21.15.18:0/535244808 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 0x56415985ee30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009900 tx=0x7f9ee4001e50 comp rx=0 tx=0).stop 2024-09-13T16:51:36.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9f05002740 1 -- 172.21.15.18:0/535244808 shutdown_connections 2024-09-13T16:51:36.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9f05002740 1 --2- 172.21.15.18:0/535244808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x564159857db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9f05002740 1 --2- 172.21.15.18:0/535244808 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984e5e0 0x56415985ee30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9f05002740 1 --2- 172.21.15.18:0/535244808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984dca0 0x56415985f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9f05002740 1 -- 172.21.15.18:0/535244808 >> 172.21.15.18:0/535244808 conn(0x564159849310 msgr2=0x5641598576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9f05002740 1 -- 172.21.15.18:0/535244808 shutdown_connections 2024-09-13T16:51:36.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.547+0000 7f9f05002740 1 -- 172.21.15.18:0/535244808 wait complete. 2024-09-13T16:51:36.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.548+0000 7f9f05002740 1 -- start start 2024-09-13T16:51:36.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.548+0000 7f9f05002740 1 Processor -- start 2024-09-13T16:51:36.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.548+0000 7f9f05002740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 0x564159859160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.548+0000 7f9f05002740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 0x5641598596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.548+0000 7f9f05002740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x56415985e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.548+0000 7f9f05002740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415985ebc0 con 0x564159853670 2024-09-13T16:51:36.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.548+0000 7f9f05002740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415985ed30 con 0x56415984dca0 2024-09-13T16:51:36.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.548+0000 7f9f05002740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415985eef0 con 0x56415984e5e0 2024-09-13T16:51:36.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9f05002740 10 client.0 _ll_register_callbacks cb 0x7f9ef40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:51:36.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 0x564159859160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 0x564159859160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:59788/0 (socket says 172.21.15.18:59788) 2024-09-13T16:51:36.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9efbe00640 1 -- 172.21.15.18:0/671778935 learned_addr learned my addr 172.21.15.18:0/671778935 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9efbe00640 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x56415985e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 0x5641598596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9efbe00640 1 -- 172.21.15.18:0/671778935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 msgr2=0x5641598596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9efbe00640 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 0x5641598596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9efbe00640 1 -- 172.21.15.18:0/671778935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 msgr2=0x56415985e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9efbe00640 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x56415985e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9efbe00640 1 -- 172.21.15.18:0/671778935 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef4022040 con 0x56415984dca0 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 0x5641598596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9efbe00640 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 0x564159859160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4013010 tx=0x7f9ef40108e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e99b093d5c8ee609 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9ee9600640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.549+0000 7f9ee9600640 1 -- 172.21.15.18:0/671778935 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef401f070 con 0x56415984dca0 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9f05002740 1 -- 172.21.15.18:0/671778935 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ef4015070 con 0x56415984dca0 2024-09-13T16:51:36.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9ee9600640 1 -- 172.21.15.18:0/671778935 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9ef4017070 con 0x56415984dca0 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9ee9600640 1 -- 172.21.15.18:0/671778935 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ef40119e0 con 0x56415984dca0 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9f05002740 10 client.25208 fetch_fsmap learned FSMap version 24 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9f05002740 1 -- 172.21.15.18:0/671778935 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5641597af1b0 con 0x56415984dca0 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9ee9600640 1 -- 172.21.15.18:0/671778935 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ef4015070 con 0x56415984dca0 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9ee9600640 1 -- 172.21.15.18:0/671778935 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9ef402e7a0 con 0x56415984dca0 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9f05002740 10 client.25208 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9f05002740 10 client.25208 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9f05002740 20 client.25208 populate_metadata read hostname 'smithi018' 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9f05002740 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5641598be580 0x5641598baed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9f05002740 4 client.25208 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.550+0000 7f9f05002740 1 -- 172.21.15.18:0/671778935 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5641594b56c0 con 0x5641598be580 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.551+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5641598be580 0x5641598baed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:36.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.551+0000 7f9ef2a00640 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5641598be580 0x5641598baed0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f54ee7d04978a92 server_cookie=6b9a6abc9f43069b in_seq=0 out_seq=0 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.551+0000 7f9ee9600640 10 client.25208 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.551+0000 7f9ee9600640 1 -- 172.21.15.18:0/671778935 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5641594b56c0 con 0x5641598be580 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.551+0000 7f9ee9600640 10 client.25208 handle_command_reply: tid=0 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.551+0000 7f9f05002740 1 client.25208 shutdown 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 1 -- 172.21.15.18:0/671778935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 msgr2=0x564159859160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 0x564159859160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4013010 tx=0x7f9ef40108e0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 1 -- 172.21.15.18:0/671778935 shutdown_connections 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5641598be580 0x5641598baed0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564159853670 0x56415985e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56415984e5e0 0x5641598596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 1 --2- 172.21.15.18:0/671778935 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56415984dca0 0x564159859160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9ee9600640 0 client.25208 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:51:36.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 1 -- 172.21.15.18:0/671778935 >> 172.21.15.18:0/671778935 conn(0x564159849310 msgr2=0x56415986bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 1 -- 172.21.15.18:0/671778935 shutdown_connections 2024-09-13T16:51:36.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 1 -- 172.21.15.18:0/671778935 wait complete. 2024-09-13T16:51:36.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f05002740 20 client.25208 trim_cache size 0 max 16384 2024-09-13T16:51:36.560 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T16:51:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "d8ff35a0-71ee-11ef-bceb-c7b262605968", 2024-09-13T16:51:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-13T16:51:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24590, 2024-09-13T16:51:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-13T16:51:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-13T16:51:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-13T16:51:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 128.468200685, 2024-09-13T16:51:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 24, 2024-09-13T16:51:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 93, 2024-09-13T16:51:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T16:51:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 133.48075075200001 2024-09-13T16:51:36.561 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T16:51:36.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f00c00640 1 -- 172.21.15.18:0/3943269393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ee00a1110 msgr2=0x7f9ee00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f00c00640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ee00a1110 0x7f9ee00a35d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0a23d0 tx=0x7f9eec096040 comp rx=0 tx=0).stop 2024-09-13T16:51:36.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f00c00640 1 -- 172.21.15.18:0/3943269393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9efc101d80 msgr2=0x7f9efc197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:36.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.552+0000 7f9f00c00640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9efc101d80 0x7f9efc197dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00e9c0 tx=0x7f9eec00ee80 comp rx=0 tx=0).stop 2024-09-13T16:51:36.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.553+0000 7f9f00c00640 1 -- 172.21.15.18:0/3943269393 shutdown_connections 2024-09-13T16:51:36.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.553+0000 7f9f00c00640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9efc103930 0x7f9efc19f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.553+0000 7f9f00c00640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9efc102f70 0x7f9efc198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.553+0000 7f9f00c00640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9ee00a1110 0x7f9ee00a35d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.553+0000 7f9f00c00640 1 --2- 172.21.15.18:0/3943269393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9efc101d80 0x7f9efc197dc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:36.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.553+0000 7f9f00c00640 1 -- 172.21.15.18:0/3943269393 >> 172.21.15.18:0/3943269393 conn(0x7f9efc0fd500 msgr2=0x7f9efc106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:36.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.553+0000 7f9f00c00640 1 -- 172.21.15.18:0/3943269393 shutdown_connections 2024-09-13T16:51:36.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:36.553+0000 7f9f00c00640 1 -- 172.21.15.18:0/3943269393 wait complete. 2024-09-13T16:51:36.570 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T16:51:36.570 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T16:51:36.583 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T16:51:36.584 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T16:51:36.902 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:37 smithi094 ceph-mon[35259]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:38.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:37 smithi018 ceph-mon[30981]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:38.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:37 smithi144 ceph-mon[35328]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:39.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.014+0000 7f385e200640 1 -- 172.21.15.18:0/2772798231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3858103210 msgr2=0x7f3858103690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:39.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.014+0000 7f385e200640 1 --2- 172.21.15.18:0/2772798231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3858103210 0x7f3858103690 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3844009900 tx=0x7f384402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:51:39.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.014+0000 7f385e200640 1 -- 172.21.15.18:0/2772798231 shutdown_connections 2024-09-13T16:51:39.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.014+0000 7f385e200640 1 --2- 172.21.15.18:0/2772798231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3858103210 0x7f3858103690 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.014+0000 7f385e200640 1 --2- 172.21.15.18:0/2772798231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3858103bd0 0x7f385810a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.014+0000 7f385e200640 1 --2- 172.21.15.18:0/2772798231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3858102010 0x7f3858102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.014+0000 7f385e200640 1 -- 172.21.15.18:0/2772798231 >> 172.21.15.18:0/2772798231 conn(0x7f38580fd7a0 msgr2=0x7f38580ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.014+0000 7f385e200640 1 -- 172.21.15.18:0/2772798231 shutdown_connections 2024-09-13T16:51:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.014+0000 7f385e200640 1 -- 172.21.15.18:0/2772798231 wait complete. 2024-09-13T16:51:39.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.015+0000 7f385e200640 1 Processor -- start 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.015+0000 7f385e200640 1 -- start start 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f385e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3858102010 0x7f3858197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f385e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3858103210 0x7f3858198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f385e200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3858103bd0 0x7f385819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f385e200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385819fa90 con 0x7f3858102010 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f385e200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385819fc00 con 0x7f3858103bd0 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f385e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385819fdc0 con 0x7f3858103210 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f3857400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3858102010 0x7f3858197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f3857400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3858102010 0x7f3858197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59734/0 (socket says 172.21.15.18:59734) 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f3857400640 1 -- 172.21.15.18:0/3065180537 learned_addr learned my addr 172.21.15.18:0/3065180537 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f3857e00640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3858103bd0 0x7f385819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.016+0000 7f3856a00640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3858103210 0x7f3858198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f3857400640 1 -- 172.21.15.18:0/3065180537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3858103210 msgr2=0x7f3858198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f3857400640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3858103210 0x7f3858198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f3857400640 1 -- 172.21.15.18:0/3065180537 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3858103bd0 msgr2=0x7f385819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f3857400640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3858103bd0 0x7f385819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f3857400640 1 -- 172.21.15.18:0/3065180537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844009560 con 0x7f3858102010 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f3857e00640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3858103bd0 0x7f385819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f3857400640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3858102010 0x7f3858197fe0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f384800e9c0 tx=0x7f384800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f384fe00640 1 -- 172.21.15.18:0/3065180537 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848009700 con 0x7f3858102010 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f384fe00640 1 -- 172.21.15.18:0/3065180537 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38480044e0 con 0x7f3858102010 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f385e200640 1 -- 172.21.15.18:0/3065180537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38581a00a0 con 0x7f3858102010 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.017+0000 7f384fe00640 1 -- 172.21.15.18:0/3065180537 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848010430 con 0x7f3858102010 2024-09-13T16:51:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.018+0000 7f385e200640 1 -- 172.21.15.18:0/3065180537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38581a0520 con 0x7f3858102010 2024-09-13T16:51:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.019+0000 7f385e200640 1 -- 172.21.15.18:0/3065180537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3858109450 con 0x7f3858102010 2024-09-13T16:51:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.020+0000 7f384fe00640 1 -- 172.21.15.18:0/3065180537 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3848003f20 con 0x7f3858102010 2024-09-13T16:51:39.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.022+0000 7f384fe00640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f383c0a10b0 0x7f383c0a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:39.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.022+0000 7f384fe00640 1 -- 172.21.15.18:0/3065180537 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f3848014070 con 0x7f3858102010 2024-09-13T16:51:39.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.022+0000 7f3856a00640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f383c0a10b0 0x7f383c0a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:39.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.023+0000 7f3856a00640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f383c0a10b0 0x7f383c0a3570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3844005ab0 tx=0x7f3844005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.025+0000 7f384fe00640 1 -- 172.21.15.18:0/3065180537 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f38480964c0 con 0x7f3858102010 2024-09-13T16:51:39.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.223+0000 7f385e200640 1 -- 172.21.15.18:0/3065180537 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f385802c4f0 con 0x7f383c0a10b0 2024-09-13T16:51:39.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.224+0000 7f384fe00640 1 -- 172.21.15.18:0/3065180537 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f385802c4f0 con 0x7f383c0a10b0 2024-09-13T16:51:39.225 INFO:teuthology.orchestra.run.smithi018.stdout:Backend: cephadm 2024-09-13T16:51:39.225 INFO:teuthology.orchestra.run.smithi018.stdout:Available: Yes 2024-09-13T16:51:39.226 INFO:teuthology.orchestra.run.smithi018.stdout:Paused: No 2024-09-13T16:51:39.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.226+0000 7f385e200640 1 -- 172.21.15.18:0/3065180537 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f383c0a10b0 msgr2=0x7f383c0a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:39.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.226+0000 7f385e200640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f383c0a10b0 0x7f383c0a3570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3844005ab0 tx=0x7f3844005780 comp rx=0 tx=0).stop 2024-09-13T16:51:39.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.226+0000 7f385e200640 1 -- 172.21.15.18:0/3065180537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3858102010 msgr2=0x7f3858197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:39.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.226+0000 7f385e200640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3858102010 0x7f3858197fe0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f384800e9c0 tx=0x7f384800ee80 comp rx=0 tx=0).stop 2024-09-13T16:51:39.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.227+0000 7f385e200640 1 -- 172.21.15.18:0/3065180537 shutdown_connections 2024-09-13T16:51:39.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.227+0000 7f385e200640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3858103bd0 0x7f385819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:39.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.227+0000 7f385e200640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3858103210 0x7f3858198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:39.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.227+0000 7f385e200640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f383c0a10b0 0x7f383c0a3570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:39.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.227+0000 7f385e200640 1 --2- 172.21.15.18:0/3065180537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3858102010 0x7f3858197fe0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:39.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.227+0000 7f385e200640 1 -- 172.21.15.18:0/3065180537 >> 172.21.15.18:0/3065180537 conn(0x7f38580fd7a0 msgr2=0x7f3858106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:39.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.227+0000 7f385e200640 1 -- 172.21.15.18:0/3065180537 shutdown_connections 2024-09-13T16:51:39.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:39.227+0000 7f385e200640 1 -- 172.21.15.18:0/3065180537 wait complete. 2024-09-13T16:51:39.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T16:51:40.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:39 smithi094 ceph-mon[35259]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:40.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:39 smithi094 ceph-mon[35259]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:40.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:39 smithi018 ceph-mon[30981]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:40.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:39 smithi018 ceph-mon[30981]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:40.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:39 smithi144 ceph-mon[35328]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:40.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:39 smithi144 ceph-mon[35328]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:40.325 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:41.955 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:41 smithi018 ceph-mon[30981]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:42.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:41 smithi094 ceph-mon[35259]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:42.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:41 smithi144 ceph-mon[35328]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.397+0000 7fdd8ac00640 1 -- 172.21.15.18:0/599734013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd841019a0 msgr2=0x7fdd84108230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.397+0000 7fdd8ac00640 1 --2- 172.21.15.18:0/599734013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd841019a0 0x7fdd84108230 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009900 tx=0x7fdd7c02a410 comp rx=0 tx=0).stop 2024-09-13T16:51:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.397+0000 7fdd8ac00640 1 -- 172.21.15.18:0/599734013 shutdown_connections 2024-09-13T16:51:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.397+0000 7fdd8ac00640 1 --2- 172.21.15.18:0/599734013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd841019a0 0x7fdd84108230 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.397+0000 7fdd8ac00640 1 --2- 172.21.15.18:0/599734013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd84100fe0 0x7fdd84101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.397+0000 7fdd8ac00640 1 --2- 172.21.15.18:0/599734013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd840ffde0 0x7fdd841001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.397+0000 7fdd8ac00640 1 -- 172.21.15.18:0/599734013 >> 172.21.15.18:0/599734013 conn(0x7fdd840fb590 msgr2=0x7fdd840fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.397+0000 7fdd8ac00640 1 -- 172.21.15.18:0/599734013 shutdown_connections 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.397+0000 7fdd8ac00640 1 -- 172.21.15.18:0/599734013 wait complete. 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.398+0000 7fdd8ac00640 1 Processor -- start 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd8ac00640 1 -- start start 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd8ac00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840ffde0 0x7fdd84197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd8ac00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd84100fe0 0x7fdd841984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd8ac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd841019a0 0x7fdd8419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd8ac00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8419fa70 con 0x7fdd840ffde0 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd8ac00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8419fbe0 con 0x7fdd84100fe0 2024-09-13T16:51:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd8ac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8419fda0 con 0x7fdd841019a0 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd83e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840ffde0 0x7fdd84197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd83e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840ffde0 0x7fdd84197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58430/0 (socket says 172.21.15.18:58430) 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd83e00640 1 -- 172.21.15.18:0/2890853669 learned_addr learned my addr 172.21.15.18:0/2890853669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.399+0000 7fdd7b400640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd84100fe0 0x7fdd841984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd88c00640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd841019a0 0x7fdd8419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd83e00640 1 -- 172.21.15.18:0/2890853669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd841019a0 msgr2=0x7fdd8419f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd83e00640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd841019a0 0x7fdd8419f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd83e00640 1 -- 172.21.15.18:0/2890853669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd84100fe0 msgr2=0x7fdd841984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd83e00640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd84100fe0 0x7fdd841984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd83e00640 1 -- 172.21.15.18:0/2890853669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c009490 con 0x7fdd840ffde0 2024-09-13T16:51:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd83e00640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840ffde0 0x7fdd84197f70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400eb70 tx=0x7fdd7400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd81600640 1 -- 172.21.15.18:0/2890853669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74003b70 con 0x7fdd840ffde0 2024-09-13T16:51:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd8ac00640 1 -- 172.21.15.18:0/2890853669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7c009560 con 0x7fdd840ffde0 2024-09-13T16:51:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd81600640 1 -- 172.21.15.18:0/2890853669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd7400ee70 con 0x7fdd840ffde0 2024-09-13T16:51:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.400+0000 7fdd81600640 1 -- 172.21.15.18:0/2890853669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74010690 con 0x7fdd840ffde0 2024-09-13T16:51:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.401+0000 7fdd8ac00640 1 -- 172.21.15.18:0/2890853669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd841a03f0 con 0x7fdd840ffde0 2024-09-13T16:51:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.402+0000 7fdd8ac00640 1 -- 172.21.15.18:0/2890853669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8410b6a0 con 0x7fdd840ffde0 2024-09-13T16:51:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.403+0000 7fdd81600640 1 -- 172.21.15.18:0/2890853669 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdd74004020 con 0x7fdd840ffde0 2024-09-13T16:51:42.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.406+0000 7fdd81600640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdd680a1130 0x7fdd680a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:42.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.406+0000 7fdd81600640 1 -- 172.21.15.18:0/2890853669 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fdd74014070 con 0x7fdd840ffde0 2024-09-13T16:51:42.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.406+0000 7fdd7b400640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdd680a1130 0x7fdd680a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:42.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.407+0000 7fdd7b400640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdd680a1130 0x7fdd680a35f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdd84199490 tx=0x7fdd6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:42.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.408+0000 7fdd81600640 1 -- 172.21.15.18:0/2890853669 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdd74096a00 con 0x7fdd840ffde0 2024-09-13T16:51:42.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.596+0000 7fdd8ac00640 1 -- 172.21.15.18:0/2890853669 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd84073e00 con 0x7fdd680a1130 2024-09-13T16:51:42.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.610+0000 7fdd81600640 1 -- 172.21.15.18:0/2890853669 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4092 (secure 0 0 0) 0x7fdd84073e00 con 0x7fdd680a1130 2024-09-13T16:51:42.612 INFO:teuthology.orchestra.run.smithi018.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T16:51:42.612 INFO:teuthology.orchestra.run.smithi018.stdout:mds.a smithi018 running (2m) 25s ago 2m 12.5M - 18.2.4-850-g50bbe7f3 152d8bc6b19e f9c0996eb133 2024-09-13T16:51:42.612 INFO:teuthology.orchestra.run.smithi018.stdout:mds.b smithi094 running (2m) 73s ago 2m 25.0M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 88b0f03328cb 2024-09-13T16:51:42.612 INFO:teuthology.orchestra.run.smithi018.stdout:mds.c smithi144 running (2m) 73s ago 2m 19.5M - 18.2.4-850-g50bbe7f3 152d8bc6b19e b9736da3e20f 2024-09-13T16:51:42.612 INFO:teuthology.orchestra.run.smithi018.stdout:mds.d smithi018 running (2m) 25s ago 2m 12.7M - 18.2.4-850-g50bbe7f3 152d8bc6b19e b34164176946 2024-09-13T16:51:42.612 INFO:teuthology.orchestra.run.smithi018.stdout:mds.e smithi094 running (2m) 73s ago 2m 13.2M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 0d92e712d870 2024-09-13T16:51:42.612 INFO:teuthology.orchestra.run.smithi018.stdout:mds.f smithi144 running (2m) 73s ago 2m 15.9M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 41e9cd222da8 2024-09-13T16:51:42.612 INFO:teuthology.orchestra.run.smithi018.stdout:mds.g smithi018 running (2m) 25s ago 2m 15.7M - 18.2.4-850-g50bbe7f3 152d8bc6b19e c4b7cbb788f5 2024-09-13T16:51:42.612 INFO:teuthology.orchestra.run.smithi018.stdout:mds.h smithi094 running (2m) 73s ago 2m 18.2M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 9f7bd9e97b5b 2024-09-13T16:51:42.612 INFO:teuthology.orchestra.run.smithi018.stdout:mds.i smithi144 running (2m) 73s ago 2m 16.3M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 8d178548df97 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:mds.j smithi018 running (2m) 25s ago 2m 12.8M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 2460fe1f9ce0 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:mds.k smithi094 running (2m) 73s ago 2m 14.4M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 8b97e1e7e352 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:mds.l smithi144 running (2m) 73s ago 2m 14.3M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 9c1475af9546 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.x smithi018 *:9283,8765 running (10m) 25s ago 10m 497M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 51593b517033 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.y smithi094 *:8443,8765 running (8m) 73s ago 8m 439M - 18.2.4-850-g50bbe7f3 152d8bc6b19e a380fa1b64e8 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.z smithi144 *:8443,8765 running (8m) 73s ago 8m 440M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 2ba1af3953b9 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a smithi018 running (10m) 25s ago 10m 48.3M 2048M 18.2.4-850-g50bbe7f3 152d8bc6b19e c24cf9be08e7 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b smithi094 running (8m) 73s ago 8m 43.2M 2048M 18.2.4-850-g50bbe7f3 152d8bc6b19e 4f855e9daba1 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c smithi144 running (8m) 73s ago 8m 41.2M 2048M 18.2.4-850-g50bbe7f3 152d8bc6b19e da44f522e1a7 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 smithi018 running (7m) 25s ago 7m 46.2M 4273M 18.2.4-850-g50bbe7f3 152d8bc6b19e c958668414af 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 smithi094 running (7m) 73s ago 7m 49.3M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e a6beed9d9d26 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 smithi144 running (7m) 73s ago 7m 47.5M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e a33436fa157d 2024-09-13T16:51:42.613 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 smithi018 running (6m) 25s ago 6m 53.3M 4273M 18.2.4-850-g50bbe7f3 152d8bc6b19e abc06007ca4f 2024-09-13T16:51:42.614 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 smithi094 running (6m) 73s ago 6m 44.5M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e e1a192258ab1 2024-09-13T16:51:42.614 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 smithi144 running (5m) 73s ago 5m 45.8M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e fca5c24d78eb 2024-09-13T16:51:42.614 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 smithi018 running (5m) 25s ago 5m 42.4M 4273M 18.2.4-850-g50bbe7f3 152d8bc6b19e 414bd74f3628 2024-09-13T16:51:42.614 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 smithi094 running (4m) 73s ago 4m 51.5M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 31fe791b02cb 2024-09-13T16:51:42.614 INFO:teuthology.orchestra.run.smithi018.stdout:osd.8 smithi144 running (4m) 73s ago 4m 44.2M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e dc94fce292b5 2024-09-13T16:51:42.614 INFO:teuthology.orchestra.run.smithi018.stdout:osd.9 smithi018 running (4m) 25s ago 4m 48.0M 4273M 18.2.4-850-g50bbe7f3 152d8bc6b19e 610dc5baa2a9 2024-09-13T16:51:42.614 INFO:teuthology.orchestra.run.smithi018.stdout:osd.10 smithi094 running (3m) 73s ago 3m 54.9M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 3b68a34decdf 2024-09-13T16:51:42.614 INFO:teuthology.orchestra.run.smithi018.stdout:osd.11 smithi144 running (3m) 73s ago 3m 50.1M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e d304b41e8e0f 2024-09-13T16:51:42.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 -- 172.21.15.18:0/2890853669 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdd680a1130 msgr2=0x7fdd680a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:42.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdd680a1130 0x7fdd680a35f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdd84199490 tx=0x7fdd6c005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:42.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 -- 172.21.15.18:0/2890853669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840ffde0 msgr2=0x7fdd84197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:42.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840ffde0 0x7fdd84197f70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400eb70 tx=0x7fdd7400c6a0 comp rx=0 tx=0).stop 2024-09-13T16:51:42.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 -- 172.21.15.18:0/2890853669 shutdown_connections 2024-09-13T16:51:42.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd841019a0 0x7fdd8419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:42.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd84100fe0 0x7fdd841984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:42.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fdd680a1130 0x7fdd680a35f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:42.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 --2- 172.21.15.18:0/2890853669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840ffde0 0x7fdd84197f70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:42.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 -- 172.21.15.18:0/2890853669 >> 172.21.15.18:0/2890853669 conn(0x7fdd840fb590 msgr2=0x7fdd840726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:42.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 -- 172.21.15.18:0/2890853669 shutdown_connections 2024-09-13T16:51:42.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:42.612+0000 7fdd8ac00640 1 -- 172.21.15.18:0/2890853669 wait complete. 2024-09-13T16:51:43.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:42 smithi094 ceph-mon[35259]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:43.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:42 smithi018 ceph-mon[30981]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:43.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:42 smithi144 ceph-mon[35328]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:43.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T16:51:43.735 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:44.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:43 smithi094 ceph-mon[35259]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:44.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:43 smithi018 ceph-mon[30981]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:44.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:43 smithi144 ceph-mon[35328]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.763+0000 7f5576600640 1 -- 172.21.15.18:0/1615438759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5570103210 msgr2=0x7f5570103690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.763+0000 7f5576600640 1 --2- 172.21.15.18:0/1615438759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5570103210 0x7f5570103690 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5558009900 tx=0x7f555802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:51:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.763+0000 7f5576600640 1 -- 172.21.15.18:0/1615438759 shutdown_connections 2024-09-13T16:51:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.763+0000 7f5576600640 1 --2- 172.21.15.18:0/1615438759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5570103210 0x7f5570103690 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.763+0000 7f5576600640 1 --2- 172.21.15.18:0/1615438759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5570103bd0 0x7f557010a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.763+0000 7f5576600640 1 --2- 172.21.15.18:0/1615438759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5570102010 0x7f5570102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.763+0000 7f5576600640 1 -- 172.21.15.18:0/1615438759 >> 172.21.15.18:0/1615438759 conn(0x7f55700fd7a0 msgr2=0x7f55700ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.763+0000 7f5576600640 1 -- 172.21.15.18:0/1615438759 shutdown_connections 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.763+0000 7f5576600640 1 -- 172.21.15.18:0/1615438759 wait complete. 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.764+0000 7f5576600640 1 Processor -- start 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.764+0000 7f5576600640 1 -- start start 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5576600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5570102010 0x7f5570197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5576600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5570103210 0x7f5570198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5576600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5570103bd0 0x7f557019f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5576600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557019fac0 con 0x7f5570102010 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5576600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557019fc30 con 0x7f5570103210 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5576600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557019fdf0 con 0x7f5570103bd0 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5566a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5570103210 0x7f5570198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f556f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5570102010 0x7f5570197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5566a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5570103210 0x7f5570198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:38844/0 (socket says 172.21.15.18:38844) 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5566a00640 1 -- 172.21.15.18:0/3059061283 learned_addr learned my addr 172.21.15.18:0/3059061283 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f556fe00640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5570103bd0 0x7f557019f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5566a00640 1 -- 172.21.15.18:0/3059061283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5570103bd0 msgr2=0x7f557019f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5566a00640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5570103bd0 0x7f557019f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5566a00640 1 -- 172.21.15.18:0/3059061283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5570102010 msgr2=0x7f5570197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5566a00640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5570102010 0x7f5570197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.765+0000 7f5566a00640 1 -- 172.21.15.18:0/3059061283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558009560 con 0x7f5570103210 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.766+0000 7f5566a00640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5570103210 0x7f5570198500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5558009a20 tx=0x7f5558005620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.766+0000 7f556cc00640 1 -- 172.21.15.18:0/3059061283 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558004c10 con 0x7f5570103210 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.766+0000 7f5576600640 1 -- 172.21.15.18:0/3059061283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55701a0070 con 0x7f5570103210 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.766+0000 7f556cc00640 1 -- 172.21.15.18:0/3059061283 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5558004d70 con 0x7f5570103210 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.766+0000 7f556cc00640 1 -- 172.21.15.18:0/3059061283 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558031ae0 con 0x7f5570103210 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.766+0000 7f5576600640 1 -- 172.21.15.18:0/3059061283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55701a0510 con 0x7f5570103210 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.767+0000 7f5576600640 1 -- 172.21.15.18:0/3059061283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5570109500 con 0x7f5570103210 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.769+0000 7f556cc00640 1 -- 172.21.15.18:0/3059061283 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5558031c40 con 0x7f5570103210 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.771+0000 7f556cc00640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55540a10b0 0x7f55540a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.771+0000 7f556cc00640 1 -- 172.21.15.18:0/3059061283 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f55580edf50 con 0x7f5570103210 2024-09-13T16:51:45.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.771+0000 7f556f400640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55540a10b0 0x7f55540a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:45.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.772+0000 7f556f400640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55540a10b0 0x7f55540a3570 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5570103070 tx=0x7f5560009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:45.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.773+0000 7f556cc00640 1 -- 172.21.15.18:0/3059061283 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f55580b73d0 con 0x7f5570103210 2024-09-13T16:51:45.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:45 smithi018 ceph-mon[30981]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:45.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.961+0000 7f5576600640 1 -- 172.21.15.18:0/3059061283 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f557002c450 con 0x7f55540a10b0 2024-09-13T16:51:45.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.967+0000 7f556cc00640 1 -- 172.21.15.18:0/3059061283 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f557002c450 con 0x7f55540a10b0 2024-09-13T16:51:45.968 INFO:teuthology.orchestra.run.smithi018.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T16:51:45.969 INFO:teuthology.orchestra.run.smithi018.stdout:mds.all 12/12 76s ago 2m smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi094=b;smithi094=e;smithi094=h;smithi094=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-13T16:51:45.969 INFO:teuthology.orchestra.run.smithi018.stdout:mgr 3/3 76s ago 8m smithi018=x;smithi094=y;smithi144=z;count:3 2024-09-13T16:51:45.969 INFO:teuthology.orchestra.run.smithi018.stdout:mon 3/3 76s ago 8m smithi018:172.21.15.18=a;smithi094:172.21.15.94=b;smithi144:172.21.15.144=c;count:3 2024-09-13T16:51:45.969 INFO:teuthology.orchestra.run.smithi018.stdout:osd 12 76s ago - 2024-09-13T16:51:45.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 -- 172.21.15.18:0/3059061283 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55540a10b0 msgr2=0x7f55540a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:45.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55540a10b0 0x7f55540a3570 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5570103070 tx=0x7f5560009500 comp rx=0 tx=0).stop 2024-09-13T16:51:45.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 -- 172.21.15.18:0/3059061283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5570103210 msgr2=0x7f5570198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:45.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5570103210 0x7f5570198500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5558009a20 tx=0x7f5558005620 comp rx=0 tx=0).stop 2024-09-13T16:51:45.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 -- 172.21.15.18:0/3059061283 shutdown_connections 2024-09-13T16:51:45.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5570103bd0 0x7f557019f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:45.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5570103210 0x7f5570198500 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:45.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f55540a10b0 0x7f55540a3570 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:45.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 --2- 172.21.15.18:0/3059061283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5570102010 0x7f5570197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:45.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 -- 172.21.15.18:0/3059061283 >> 172.21.15.18:0/3059061283 conn(0x7f55700fd7a0 msgr2=0x7f55701066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:45.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 -- 172.21.15.18:0/3059061283 shutdown_connections 2024-09-13T16:51:45.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:45.969+0000 7f5576600640 1 -- 172.21.15.18:0/3059061283 wait complete. 2024-09-13T16:51:46.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:45 smithi094 ceph-mon[35259]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:46.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:45 smithi144 ceph-mon[35328]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:46.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T16:51:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:47.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:46 smithi094 ceph-mon[35259]: from='client.25226 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:47.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:46 smithi018 ceph-mon[30981]: from='client.25226 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:47.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:46 smithi144 ceph-mon[35328]: from='client.25226 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:48.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:47 smithi094 ceph-mon[35259]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:48.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:47 smithi018 ceph-mon[30981]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:48.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:47 smithi144 ceph-mon[35328]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.098+0000 7f9278e00640 1 -- 172.21.15.18:0/4099942728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9274074e60 msgr2=0x7f9274075260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.098+0000 7f9278e00640 1 --2- 172.21.15.18:0/4099942728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9274074e60 0x7f9274075260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9264009ca0 tx=0x7f926402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:51:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.098+0000 7f9278e00640 1 -- 172.21.15.18:0/4099942728 shutdown_connections 2024-09-13T16:51:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.098+0000 7f9278e00640 1 --2- 172.21.15.18:0/4099942728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9274076a50 0x7f92740772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.098+0000 7f9278e00640 1 --2- 172.21.15.18:0/4099942728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92740760b0 0x7f9274076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.098+0000 7f9278e00640 1 --2- 172.21.15.18:0/4099942728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9274074e60 0x7f9274075260 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.098+0000 7f9278e00640 1 -- 172.21.15.18:0/4099942728 >> 172.21.15.18:0/4099942728 conn(0x7f92740fd7a0 msgr2=0x7f92740ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.099+0000 7f9278e00640 1 -- 172.21.15.18:0/4099942728 shutdown_connections 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.099+0000 7f9278e00640 1 -- 172.21.15.18:0/4099942728 wait complete. 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.100+0000 7f9278e00640 1 Processor -- start 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.100+0000 7f9278e00640 1 -- start start 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.100+0000 7f9278e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9274074e60 0x7f927419c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.100+0000 7f9278e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92740760b0 0x7f927419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.100+0000 7f9278e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9274076a50 0x7f92741a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9278e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92741a3ef0 con 0x7f9274074e60 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9278e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92741a4060 con 0x7f9274076a50 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9278e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92741a4220 con 0x7f92740760b0 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9271e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9274074e60 0x7f927419c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9271e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9274074e60 0x7f927419c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58484/0 (socket says 172.21.15.18:58484) 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9271e00640 1 -- 172.21.15.18:0/1417263905 learned_addr learned my addr 172.21.15.18:0/1417263905 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9269400640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92740760b0 0x7f927419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9272800640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9274076a50 0x7f92741a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9271e00640 1 -- 172.21.15.18:0/1417263905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92740760b0 msgr2=0x7f927419c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9271e00640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92740760b0 0x7f927419c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9271e00640 1 -- 172.21.15.18:0/1417263905 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9274076a50 msgr2=0x7f92741a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9271e00640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9274076a50 0x7f92741a39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.101+0000 7f9271e00640 1 -- 172.21.15.18:0/1417263905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9264009900 con 0x7f9274074e60 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.102+0000 7f9271e00640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9274074e60 0x7f927419c3f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f92640097b0 tx=0x7f9264003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.102+0000 7f926b400640 1 -- 172.21.15.18:0/1417263905 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640307c0 con 0x7f9274074e60 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.102+0000 7f926b400640 1 -- 172.21.15.18:0/1417263905 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9264040070 con 0x7f9274074e60 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.102+0000 7f926b400640 1 -- 172.21.15.18:0/1417263905 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264004520 con 0x7f9274074e60 2024-09-13T16:51:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.102+0000 7f9278e00640 1 -- 172.21.15.18:0/1417263905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92741a44a0 con 0x7f9274074e60 2024-09-13T16:51:49.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.102+0000 7f9278e00640 1 -- 172.21.15.18:0/1417263905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92741a49a0 con 0x7f9274074e60 2024-09-13T16:51:49.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.103+0000 7f9278e00640 1 -- 172.21.15.18:0/1417263905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927410ec30 con 0x7f9274074e60 2024-09-13T16:51:49.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.105+0000 7f926b400640 1 -- 172.21.15.18:0/1417263905 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9264042030 con 0x7f9274074e60 2024-09-13T16:51:49.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.106+0000 7f926b400640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92580a1130 0x7f92580a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:49.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.106+0000 7f926b400640 1 -- 172.21.15.18:0/1417263905 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f92640ee430 con 0x7f9274074e60 2024-09-13T16:51:49.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.106+0000 7f9269400640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92580a1130 0x7f92580a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:49.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.107+0000 7f9269400640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92580a1130 0x7f92580a35f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f927419d910 tx=0x7f925c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:49.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.110+0000 7f926b400640 1 -- 172.21.15.18:0/1417263905 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f92640b7920 con 0x7f9274074e60 2024-09-13T16:51:49.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.299+0000 7f9278e00640 1 -- 172.21.15.18:0/1417263905 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f927402c450 con 0x7f92580a1130 2024-09-13T16:51:49.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.301+0000 7f926b400640 1 -- 172.21.15.18:0/1417263905 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f927402c450 con 0x7f92580a1130 2024-09-13T16:51:49.302 INFO:teuthology.orchestra.run.smithi018.stdout:HOST ADDR LABELS STATUS 2024-09-13T16:51:49.302 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018 172.21.15.18 2024-09-13T16:51:49.302 INFO:teuthology.orchestra.run.smithi018.stdout:smithi094 172.21.15.94 2024-09-13T16:51:49.303 INFO:teuthology.orchestra.run.smithi018.stdout:smithi144 172.21.15.144 2024-09-13T16:51:49.303 INFO:teuthology.orchestra.run.smithi018.stdout:3 hosts in cluster 2024-09-13T16:51:49.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.303+0000 7f9278e00640 1 -- 172.21.15.18:0/1417263905 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92580a1130 msgr2=0x7f92580a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:49.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.303+0000 7f9278e00640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92580a1130 0x7f92580a35f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f927419d910 tx=0x7f925c005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:49.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.303+0000 7f9278e00640 1 -- 172.21.15.18:0/1417263905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9274074e60 msgr2=0x7f927419c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:49.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.303+0000 7f9278e00640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9274074e60 0x7f927419c3f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f92640097b0 tx=0x7f9264003c20 comp rx=0 tx=0).stop 2024-09-13T16:51:49.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.304+0000 7f9278e00640 1 -- 172.21.15.18:0/1417263905 shutdown_connections 2024-09-13T16:51:49.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.304+0000 7f9278e00640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9274076a50 0x7f92741a39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:49.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.304+0000 7f9278e00640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92740760b0 0x7f927419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:49.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.304+0000 7f9278e00640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f92580a1130 0x7f92580a35f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:49.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.304+0000 7f9278e00640 1 --2- 172.21.15.18:0/1417263905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9274074e60 0x7f927419c3f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:49.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.304+0000 7f9278e00640 1 -- 172.21.15.18:0/1417263905 >> 172.21.15.18:0/1417263905 conn(0x7f92740fd7a0 msgr2=0x7f92740fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:49.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.304+0000 7f9278e00640 1 -- 172.21.15.18:0/1417263905 shutdown_connections 2024-09-13T16:51:49.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:49.304+0000 7f9278e00640 1 -- 172.21.15.18:0/1417263905 wait complete. 2024-09-13T16:51:49.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:49 smithi018 ceph-mon[30981]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:49.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:49 smithi018 ceph-mon[30981]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:50.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T16:51:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:49 smithi094 ceph-mon[35259]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:49 smithi094 ceph-mon[35259]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:50.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:49 smithi144 ceph-mon[35328]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:50.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:49 smithi144 ceph-mon[35328]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:50.447 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:52.068 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:51 smithi018 ceph-mon[30981]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:51 smithi094 ceph-mon[35259]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:52.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:51 smithi144 ceph-mon[35328]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:52.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.519+0000 7fd739a00640 1 -- 172.21.15.18:0/1931219644 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7340744e0 msgr2=0x7fd734072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.519+0000 7fd739a00640 1 --2- 172.21.15.18:0/1931219644 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7340744e0 0x7fd734072940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd724009860 tx=0x7fd72402a340 comp rx=0 tx=0).stop 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.519+0000 7fd739a00640 1 -- 172.21.15.18:0/1931219644 shutdown_connections 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.519+0000 7fd739a00640 1 --2- 172.21.15.18:0/1931219644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd734072f10 0x7fd734073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.519+0000 7fd739a00640 1 --2- 172.21.15.18:0/1931219644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd734107c60 0x7fd73410a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.519+0000 7fd739a00640 1 --2- 172.21.15.18:0/1931219644 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7340744e0 0x7fd734072940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.519+0000 7fd739a00640 1 -- 172.21.15.18:0/1931219644 >> 172.21.15.18:0/1931219644 conn(0x7fd7340fb590 msgr2=0x7fd7340fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.519+0000 7fd739a00640 1 -- 172.21.15.18:0/1931219644 shutdown_connections 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.519+0000 7fd739a00640 1 -- 172.21.15.18:0/1931219644 wait complete. 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.520+0000 7fd739a00640 1 Processor -- start 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd739a00640 1 -- start start 2024-09-13T16:51:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd739a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd734072f10 0x7fd734197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd739a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7340744e0 0x7fd734198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd739a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd734107c60 0x7fd73419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd739a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73419fac0 con 0x7fd734072f10 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd739a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73419fc30 con 0x7fd734107c60 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd739a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73419fdf0 con 0x7fd7340744e0 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd732a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd734072f10 0x7fd734197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd732a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd734072f10 0x7fd734197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58664/0 (socket says 172.21.15.18:58664) 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd732a00640 1 -- 172.21.15.18:0/3293272412 learned_addr learned my addr 172.21.15.18:0/3293272412 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd732000640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7340744e0 0x7fd734198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.521+0000 7fd733400640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd734107c60 0x7fd73419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.522+0000 7fd732a00640 1 -- 172.21.15.18:0/3293272412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7340744e0 msgr2=0x7fd734198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.522+0000 7fd732a00640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7340744e0 0x7fd734198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.522+0000 7fd732a00640 1 -- 172.21.15.18:0/3293272412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd734107c60 msgr2=0x7fd73419f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.522+0000 7fd732a00640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd734107c60 0x7fd73419f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.522+0000 7fd732a00640 1 -- 172.21.15.18:0/3293272412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd720009560 con 0x7fd734072f10 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.522+0000 7fd732a00640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd734072f10 0x7fd734197fc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd7240304b0 tx=0x7fd724032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.522+0000 7fd72b400640 1 -- 172.21.15.18:0/3293272412 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724004040 con 0x7fd734072f10 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.523+0000 7fd72b400640 1 -- 172.21.15.18:0/3293272412 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd724005050 con 0x7fd734072f10 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.523+0000 7fd739a00640 1 -- 172.21.15.18:0/3293272412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd724009490 con 0x7fd734072f10 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.523+0000 7fd72b400640 1 -- 172.21.15.18:0/3293272412 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724004920 con 0x7fd734072f10 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.523+0000 7fd739a00640 1 -- 172.21.15.18:0/3293272412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7341a03d0 con 0x7fd734072f10 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.524+0000 7fd739a00640 1 -- 172.21.15.18:0/3293272412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7341069e0 con 0x7fd734072f10 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.526+0000 7fd72b400640 1 -- 172.21.15.18:0/3293272412 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd7240041a0 con 0x7fd734072f10 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.527+0000 7fd72b400640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd7180a1130 0x7fd7180a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.527+0000 7fd72b400640 1 -- 172.21.15.18:0/3293272412 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fd7240edc60 con 0x7fd734072f10 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.528+0000 7fd732000640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd7180a1130 0x7fd7180a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.528+0000 7fd732000640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd7180a1130 0x7fd7180a35f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd7341994e0 tx=0x7fd720009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:52.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.530+0000 7fd72b400640 1 -- 172.21.15.18:0/3293272412 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd7240b70b0 con 0x7fd734072f10 2024-09-13T16:51:52.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.722+0000 7fd739a00640 1 -- 172.21.15.18:0/3293272412 --> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7340608f0 con 0x7fd7180a1130 2024-09-13T16:51:52.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.724+0000 7fd72b400640 1 -- 172.21.15.18:0/3293272412 <== mgr.14150 v2:172.21.15.18:6800/687548857 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fd7340608f0 con 0x7fd7180a1130 2024-09-13T16:51:52.725 INFO:teuthology.orchestra.run.smithi018.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T16:51:52.725 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120091480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-09-13T16:51:52.725 INFO:teuthology.orchestra.run.smithi018.stdout:smithi094 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513001L480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-13T16:51:52.725 INFO:teuthology.orchestra.run.smithi018.stdout:smithi144 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050085400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-13T16:51:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 -- 172.21.15.18:0/3293272412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd7180a1130 msgr2=0x7fd7180a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd7180a1130 0x7fd7180a35f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd7341994e0 tx=0x7fd720009260 comp rx=0 tx=0).stop 2024-09-13T16:51:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 -- 172.21.15.18:0/3293272412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd734072f10 msgr2=0x7fd734197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd734072f10 0x7fd734197fc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd7240304b0 tx=0x7fd724032d20 comp rx=0 tx=0).stop 2024-09-13T16:51:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 -- 172.21.15.18:0/3293272412 shutdown_connections 2024-09-13T16:51:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd734107c60 0x7fd73419f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7340744e0 0x7fd734198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd7180a1130 0x7fd7180a35f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 --2- 172.21.15.18:0/3293272412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd734072f10 0x7fd734197fc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 -- 172.21.15.18:0/3293272412 >> 172.21.15.18:0/3293272412 conn(0x7fd7340fb590 msgr2=0x7fd734103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.727+0000 7fd739a00640 1 -- 172.21.15.18:0/3293272412 shutdown_connections 2024-09-13T16:51:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:52.728+0000 7fd739a00640 1 -- 172.21.15.18:0/3293272412 wait complete. 2024-09-13T16:51:53.116 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:52 smithi018 ceph-mon[30981]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:53.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:52 smithi094 ceph-mon[35259]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:53.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:52 smithi144 ceph-mon[35328]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:51:53.540 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T16:51:53.548 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T16:51:53.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T16:51:53.875 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:54.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:53 smithi094 ceph-mon[35259]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:54.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:53 smithi018 ceph-mon[30981]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:54.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:53 smithi144 ceph-mon[35328]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:51:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.874+0000 7f75b8000640 1 -- 172.21.15.18:0/1394863734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b00ffde0 msgr2=0x7f75b01001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.874+0000 7f75b8000640 1 --2- 172.21.15.18:0/1394863734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b00ffde0 0x7f75b01001e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009900 tx=0x7f75a402a410 comp rx=0 tx=0).stop 2024-09-13T16:51:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.874+0000 7f75b8000640 1 -- 172.21.15.18:0/1394863734 shutdown_connections 2024-09-13T16:51:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.874+0000 7f75b8000640 1 --2- 172.21.15.18:0/1394863734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75b01019a0 0x7f75b0108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.874+0000 7f75b8000640 1 --2- 172.21.15.18:0/1394863734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75b0100fe0 0x7f75b0101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.874+0000 7f75b8000640 1 --2- 172.21.15.18:0/1394863734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b00ffde0 0x7f75b01001e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.874+0000 7f75b8000640 1 -- 172.21.15.18:0/1394863734 >> 172.21.15.18:0/1394863734 conn(0x7f75b00fb590 msgr2=0x7f75b00fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.874+0000 7f75b8000640 1 -- 172.21.15.18:0/1394863734 shutdown_connections 2024-09-13T16:51:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.874+0000 7f75b8000640 1 -- 172.21.15.18:0/1394863734 wait complete. 2024-09-13T16:51:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.875+0000 7f75b8000640 1 Processor -- start 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.875+0000 7f75b8000640 1 -- start start 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b8000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75b00ffde0 0x7f75b0195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b8000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75b0100fe0 0x7f75b0196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b8000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b01019a0 0x7f75b019d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b8000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b019d900 con 0x7f75b01019a0 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b8000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b019da70 con 0x7f75b00ffde0 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b8000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b019dc30 con 0x7f75b0100fe0 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b5600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75b00ffde0 0x7f75b0195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b5600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75b00ffde0 0x7f75b0195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:44894/0 (socket says 172.21.15.18:44894) 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b5600640 1 -- 172.21.15.18:0/1269557775 learned_addr learned my addr 172.21.15.18:0/1269557775 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b6000640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b01019a0 0x7f75b019d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.876+0000 7f75b4c00640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75b0100fe0 0x7f75b0196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:55.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75b5600640 1 -- 172.21.15.18:0/1269557775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75b0100fe0 msgr2=0x7f75b0196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75b5600640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75b0100fe0 0x7f75b0196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75b5600640 1 -- 172.21.15.18:0/1269557775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b01019a0 msgr2=0x7f75b019d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75b5600640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b01019a0 0x7f75b019d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75b5600640 1 -- 172.21.15.18:0/1269557775 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4009560 con 0x7f75b00ffde0 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75b5600640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75b00ffde0 0x7f75b0195e00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75a4031500 tx=0x7f75a4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75ae000640 1 -- 172.21.15.18:0/1269557775 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4003e00 con 0x7f75b00ffde0 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75ae000640 1 -- 172.21.15.18:0/1269557775 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75a4031c70 con 0x7f75b00ffde0 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75ae000640 1 -- 172.21.15.18:0/1269557775 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a403bc20 con 0x7f75b00ffde0 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75b8000640 1 -- 172.21.15.18:0/1269557775 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b019deb0 con 0x7f75b00ffde0 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.877+0000 7f75b8000640 1 -- 172.21.15.18:0/1269557775 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b019e270 con 0x7f75b00ffde0 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.878+0000 7f75b8000640 1 -- 172.21.15.18:0/1269557775 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b0107320 con 0x7f75b00ffde0 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.881+0000 7f75ae000640 1 -- 172.21.15.18:0/1269557775 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f75a40317b0 con 0x7f75b00ffde0 2024-09-13T16:51:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.882+0000 7f75ae000640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f75980a1130 0x7f75980a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.882+0000 7f75ae000640 1 -- 172.21.15.18:0/1269557775 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f75a40ed3f0 con 0x7f75b00ffde0 2024-09-13T16:51:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.882+0000 7f75b4c00640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f75980a1130 0x7f75980a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.883+0000 7f75b4c00640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f75980a1130 0x7f75980a35f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f75b0197320 tx=0x7f759c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:55.888+0000 7f75ae000640 1 -- 172.21.15.18:0/1269557775 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f75a40b6870 con 0x7f75b00ffde0 2024-09-13T16:51:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.105+0000 7f75b8000640 1 -- 172.21.15.18:0/1269557775 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f75b002c4f0 con 0x7f75b00ffde0 2024-09-13T16:51:56.106 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:55 smithi018 ceph-mon[30981]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.105+0000 7f75ae000640 1 -- 172.21.15.18:0/1269557775 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+2889 (secure 0 0 0) 0x7f75a4049b60 con 0x7f75b00ffde0 2024-09-13T16:51:56.107 INFO:teuthology.orchestra.run.smithi018.stdout:e24 2024-09-13T16:51:56.107 INFO:teuthology.orchestra.run.smithi018.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T16:51:56.107 INFO:teuthology.orchestra.run.smithi018.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T16:51:56.107 INFO:teuthology.orchestra.run.smithi018.stdout:legacy client fscid: 1 2024-09-13T16:51:56.107 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:56.107 INFO:teuthology.orchestra.run.smithi018.stdout:Filesystem 'cephfs' (1) 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:fs_name cephfs 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 24 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-13T16:49:28.080578+0000 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-09-13T16:49:57.790808+0000 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:tableserver 0 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:root 0 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:session_timeout 300 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:session_autoclose 300 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:max_file_size 1099511627776 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:max_xattr_size 65536 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:required_client_features {} 2024-09-13T16:51:56.108 INFO:teuthology.orchestra.run.smithi018.stdout:last_failure 0 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:last_failure_osd_epoch 0 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:max_mds 3 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:in 0,1,2 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:up {0=24590,1=24566,2=24539} 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:failed 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:damaged 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:stopped 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:data_pools [3,4] 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:metadata_pool 2 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:inline_data disabled 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:balancer 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:bal_rank_mask -1 2024-09-13T16:51:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:standby_count_wanted 0 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b{0:24590} state up:active seq 3 addr [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.i{0:24538} state up:standby-replay seq 1 addr [v2:172.21.15.144:6838/506298733,v1:172.21.15.144:6839/506298733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.g{1:24566} state up:active seq 11 addr [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c{1:24520} state up:standby-replay seq 1 addr [v2:172.21.15.144:6836/443543812,v1:172.21.15.144:6837/443543812] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.h{2:24539} state up:active seq 13 addr [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.f{2:24508} state up:standby-replay seq 1 addr [v2:172.21.15.144:6834/81449437,v1:172.21.15.144:6835/81449437] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:Standby daemons: 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.j{-1:14460} state up:standby seq 1 addr [v2:172.21.15.18:6834/1281964026,v1:172.21.15.18:6835/1281964026] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d{-1:14478} state up:standby seq 1 addr [v2:172.21.15.18:6836/2164016233,v1:172.21.15.18:6837/2164016233] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a{-1:14541} state up:standby seq 1 addr [v2:172.21.15.18:6840/2193765786,v1:172.21.15.18:6841/2193765786] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.111 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.l{-1:24451} state up:standby seq 1 addr [v2:172.21.15.144:6832/813398687,v1:172.21.15.144:6833/813398687] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.111 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.k{-1:24464} state up:standby seq 1 addr [v2:172.21.15.94:6832/3502575605,v1:172.21.15.94:6833/3502575605] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.111 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.e{-1:24506} state up:standby seq 1 addr [v2:172.21.15.94:6834/3926764648,v1:172.21.15.94:6835/3926764648] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T16:51:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 24 2024-09-13T16:51:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 -- 172.21.15.18:0/1269557775 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f75980a1130 msgr2=0x7f75980a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f75980a1130 0x7f75980a35f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f75b0197320 tx=0x7f759c005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 -- 172.21.15.18:0/1269557775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75b00ffde0 msgr2=0x7f75b0195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75b00ffde0 0x7f75b0195e00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75a4031500 tx=0x7f75a4003c10 comp rx=0 tx=0).stop 2024-09-13T16:51:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 -- 172.21.15.18:0/1269557775 shutdown_connections 2024-09-13T16:51:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f75980a1130 0x7f75980a35f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b01019a0 0x7f75b019d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75b0100fe0 0x7f75b0196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 --2- 172.21.15.18:0/1269557775 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75b00ffde0 0x7f75b0195e00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 -- 172.21.15.18:0/1269557775 >> 172.21.15.18:0/1269557775 conn(0x7f75b00fb590 msgr2=0x7f75b01044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 -- 172.21.15.18:0/1269557775 shutdown_connections 2024-09-13T16:51:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:56.109+0000 7f75b8000640 1 -- 172.21.15.18:0/1269557775 wait complete. 2024-09-13T16:51:56.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:55 smithi094 ceph-mon[35259]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:56.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:55 smithi144 ceph-mon[35328]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:51:56.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-13T16:51:57.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:56 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1269557775' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T16:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:51:57.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:56 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1269557775' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T16:51:57.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:56 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1269557775' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T16:51:57.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:57 smithi018 ceph-mon[30981]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:57 smithi094 ceph-mon[35259]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:58.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:57 smithi144 ceph-mon[35328]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:51:59.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.357+0000 7feb98000640 1 -- 172.21.15.18:0/596164289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb900760b0 msgr2=0x7feb90076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:59.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.357+0000 7feb98000640 1 --2- 172.21.15.18:0/596164289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb900760b0 0x7feb90076510 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009900 tx=0x7feb7c02a410 comp rx=0 tx=0).stop 2024-09-13T16:51:59.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.357+0000 7feb98000640 1 -- 172.21.15.18:0/596164289 shutdown_connections 2024-09-13T16:51:59.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.357+0000 7feb98000640 1 --2- 172.21.15.18:0/596164289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb900760b0 0x7feb90076510 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:59.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.357+0000 7feb98000640 1 --2- 172.21.15.18:0/596164289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb90076a50 0x7feb900772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.357+0000 7feb98000640 1 --2- 172.21.15.18:0/596164289 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb90074e60 0x7feb90075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.357+0000 7feb98000640 1 -- 172.21.15.18:0/596164289 >> 172.21.15.18:0/596164289 conn(0x7feb900fd780 msgr2=0x7feb900ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.358+0000 7feb98000640 1 -- 172.21.15.18:0/596164289 shutdown_connections 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.358+0000 7feb98000640 1 -- 172.21.15.18:0/596164289 wait complete. 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb98000640 1 Processor -- start 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb98000640 1 -- start start 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb98000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb90074e60 0x7feb9019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb98000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb900760b0 0x7feb9019c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb98000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb90076a50 0x7feb901a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb98000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb901a3ef0 con 0x7feb900760b0 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb98000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb901a4060 con 0x7feb90076a50 2024-09-13T16:51:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb98000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb901a4220 con 0x7feb90074e60 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb94c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb900760b0 0x7feb9019c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb95600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb90074e60 0x7feb9019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb96000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb90076a50 0x7feb901a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb94c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb900760b0 0x7feb9019c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58696/0 (socket says 172.21.15.18:58696) 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.359+0000 7feb94c00640 1 -- 172.21.15.18:0/491313311 learned_addr learned my addr 172.21.15.18:0/491313311 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.360+0000 7feb96000640 1 -- 172.21.15.18:0/491313311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb90074e60 msgr2=0x7feb9019c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.360+0000 7feb96000640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb90074e60 0x7feb9019c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.360+0000 7feb96000640 1 -- 172.21.15.18:0/491313311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb900760b0 msgr2=0x7feb9019c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.360+0000 7feb96000640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb900760b0 0x7feb9019c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.360+0000 7feb96000640 1 -- 172.21.15.18:0/491313311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c009560 con 0x7feb90076a50 2024-09-13T16:51:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.360+0000 7feb96000640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb90076a50 0x7feb901a39b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feb8800da10 tx=0x7feb8800ded0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:59.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.360+0000 7feb8e000640 1 -- 172.21.15.18:0/491313311 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800bd70 con 0x7feb90076a50 2024-09-13T16:51:59.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.361+0000 7feb8e000640 1 -- 172.21.15.18:0/491313311 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb88003e30 con 0x7feb90076a50 2024-09-13T16:51:59.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.361+0000 7feb98000640 1 -- 172.21.15.18:0/491313311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb901a4500 con 0x7feb90076a50 2024-09-13T16:51:59.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.361+0000 7feb8e000640 1 -- 172.21.15.18:0/491313311 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880106c0 con 0x7feb90076a50 2024-09-13T16:51:59.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.361+0000 7feb98000640 1 -- 172.21.15.18:0/491313311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb901a4a00 con 0x7feb90076a50 2024-09-13T16:51:59.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.362+0000 7feb98000640 1 -- 172.21.15.18:0/491313311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9010ebf0 con 0x7feb90076a50 2024-09-13T16:51:59.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.364+0000 7feb8e000640 1 -- 172.21.15.18:0/491313311 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7feb88004250 con 0x7feb90076a50 2024-09-13T16:51:59.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.365+0000 7feb8e000640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feb780a1130 0x7feb780a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:51:59.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.365+0000 7feb8e000640 1 -- 172.21.15.18:0/491313311 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7feb880cd2a0 con 0x7feb90076a50 2024-09-13T16:51:59.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.366+0000 7feb95600640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feb780a1130 0x7feb780a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:51:59.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.366+0000 7feb95600640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feb780a1130 0x7feb780a35f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feb84009bd0 tx=0x7feb84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:51:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.367+0000 7feb8e000640 1 -- 172.21.15.18:0/491313311 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb880966f0 con 0x7feb90076a50 2024-09-13T16:51:59.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.554+0000 7feb98000640 1 -- 172.21.15.18:0/491313311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7feb90111d40 con 0x7feb90076a50 2024-09-13T16:51:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.555+0000 7feb8e000640 1 -- 172.21.15.18:0/491313311 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v93) v1 ==== 56+0+5678 (secure 0 0 0) 0x7feb88099d10 con 0x7feb90076a50 2024-09-13T16:51:59.557 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 93 2024-09-13T16:51:59.557 INFO:teuthology.orchestra.run.smithi018.stdout:fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T16:51:59.557 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-13T16:41:18.754202+0000 2024-09-13T16:51:59.557 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-09-13T16:51:14.023061+0000 2024-09-13T16:51:59.557 INFO:teuthology.orchestra.run.smithi018.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:crush_version 27 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:full_ratio 0.95 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:backfillfull_ratio 0.9 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:nearfull_ratio 0.85 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:require_min_compat_client luminous 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:min_compat_client luminous 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:require_osd_release reef 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:stretch_mode_enabled false 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-13T16:51:59.558 INFO:teuthology.orchestra.run.smithi018.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:max_osd 12 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 up in weight 1 up_from 8 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6802/2385031914,v1:172.21.15.18:6803/2385031914] [v2:172.21.15.18:6804/2385031914,v1:172.21.15.18:6805/2385031914] exists,up 0d42fca5-9912-4f5c-9e13-13e879484040 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.94:6800/3875618914,v1:172.21.15.94:6801/3875618914] [v2:172.21.15.94:6802/3875618914,v1:172.21.15.94:6803/3875618914] exists,up 7347881e-6e90-45e4-8c22-a2dc8d8b7ec6 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/2547295971,v1:172.21.15.144:6801/2547295971] [v2:172.21.15.144:6802/2547295971,v1:172.21.15.144:6803/2547295971] exists,up eee31be9-0cee-459c-9552-e6addad9da7c 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 up in weight 1 up_from 25 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6810/4196858312,v1:172.21.15.18:6811/4196858312] [v2:172.21.15.18:6812/4196858312,v1:172.21.15.18:6813/4196858312] exists,up 97cbcd7e-845f-42fb-94eb-31432947a878 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 up in weight 1 up_from 33 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.94:6808/2294580,v1:172.21.15.94:6809/2294580] [v2:172.21.15.94:6810/2294580,v1:172.21.15.94:6811/2294580] exists,up 2b8a6a63-ece3-4271-92f5-a301abae658c 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 up in weight 1 up_from 38 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6808/890873206,v1:172.21.15.144:6809/890873206] [v2:172.21.15.144:6810/890873206,v1:172.21.15.144:6811/890873206] exists,up 3f93581d-1da2-4ff7-a4ae-81991f10c2d3 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 up in weight 1 up_from 46 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6818/1300118017,v1:172.21.15.18:6819/1300118017] [v2:172.21.15.18:6820/1300118017,v1:172.21.15.18:6821/1300118017] exists,up c20ed6ea-c9fa-4693-9f2d-085ce33538f4 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 up in weight 1 up_from 51 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.94:6816/976410580,v1:172.21.15.94:6817/976410580] [v2:172.21.15.94:6818/976410580,v1:172.21.15.94:6819/976410580] exists,up e5f3039b-06ae-4447-bf57-464bfda06871 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.8 up in weight 1 up_from 59 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6816/4258945385,v1:172.21.15.144:6817/4258945385] [v2:172.21.15.144:6818/4258945385,v1:172.21.15.144:6819/4258945385] exists,up 125a9e98-8193-4f8e-a548-c15d5127629c 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.9 up in weight 1 up_from 67 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6826/2756311466,v1:172.21.15.18:6827/2756311466] [v2:172.21.15.18:6828/2756311466,v1:172.21.15.18:6829/2756311466] exists,up 7b40b786-9a18-4702-9db8-be1fa45b58d7 2024-09-13T16:51:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:osd.10 up in weight 1 up_from 72 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.94:6824/896296327,v1:172.21.15.94:6825/896296327] [v2:172.21.15.94:6826/896296327,v1:172.21.15.94:6827/896296327] exists,up bb72e047-4488-48a5-801c-24e24423bbc5 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:osd.11 up in weight 1 up_from 80 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6824/3936121056,v1:172.21.15.144:6825/3936121056] [v2:172.21.15.144:6826/3936121056,v1:172.21.15.144:6827/3936121056] exists,up d65a22d5-6e7a-4000-a463-59ed1f22518c 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.f [8,11] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.10 [8,11] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.14 [2,4] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.16 [2,4] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.1 [4,9] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.1b [3,8] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.1e [3,9] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.25 [5,9] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.31 [4,8] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.3a [4,6] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.10 [9,10] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.12 [5,10] 2024-09-13T16:51:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.13 [9,8] 2024-09-13T16:51:59.561 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.16 [9,8] 2024-09-13T16:51:59.561 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6801/920683112 expires 2024-09-14T16:42:11.669513+0000 2024-09-13T16:51:59.561 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/920683112 expires 2024-09-14T16:42:11.669513+0000 2024-09-13T16:51:59.561 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/3837246804 expires 2024-09-14T16:42:11.669513+0000 2024-09-13T16:51:59.562 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/4227001658 expires 2024-09-14T16:42:11.669513+0000 2024-09-13T16:51:59.562 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/2737842128 expires 2024-09-14T16:41:44.259356+0000 2024-09-13T16:51:59.562 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/295009687 expires 2024-09-14T16:41:44.259356+0000 2024-09-13T16:51:59.562 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/1872401951 expires 2024-09-14T16:41:44.259356+0000 2024-09-13T16:51:59.562 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6801/1236399643 expires 2024-09-14T16:41:44.259356+0000 2024-09-13T16:51:59.562 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/237199304 expires 2024-09-14T16:42:11.669513+0000 2024-09-13T16:51:59.562 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/1236399643 expires 2024-09-14T16:41:44.259356+0000 2024-09-13T16:51:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.557+0000 7feb98000640 1 -- 172.21.15.18:0/491313311 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feb780a1130 msgr2=0x7feb780a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.557+0000 7feb98000640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feb780a1130 0x7feb780a35f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feb84009bd0 tx=0x7feb84005f90 comp rx=0 tx=0).stop 2024-09-13T16:51:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.557+0000 7feb98000640 1 -- 172.21.15.18:0/491313311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb90076a50 msgr2=0x7feb901a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:51:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.557+0000 7feb98000640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb90076a50 0x7feb901a39b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feb8800da10 tx=0x7feb8800ded0 comp rx=0 tx=0).stop 2024-09-13T16:51:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.557+0000 7feb98000640 1 -- 172.21.15.18:0/491313311 shutdown_connections 2024-09-13T16:51:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.557+0000 7feb98000640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feb780a1130 0x7feb780a35f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.557+0000 7feb98000640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb900760b0 0x7feb9019c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:59.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.557+0000 7feb98000640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb90076a50 0x7feb901a39b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:59.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.557+0000 7feb98000640 1 --2- 172.21.15.18:0/491313311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb90074e60 0x7feb9019c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:51:59.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.557+0000 7feb98000640 1 -- 172.21.15.18:0/491313311 >> 172.21.15.18:0/491313311 conn(0x7feb900fd780 msgr2=0x7feb900fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:51:59.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.558+0000 7feb98000640 1 -- 172.21.15.18:0/491313311 shutdown_connections 2024-09-13T16:51:59.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:51:59.558+0000 7feb98000640 1 -- 172.21.15.18:0/491313311 wait complete. 2024-09-13T16:51:59.899 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:51:59 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/491313311' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T16:51:59.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:51:59 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/491313311' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T16:52:00.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:51:59 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/491313311' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T16:52:00.321 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-13T16:52:00.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:52:00.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.492+0000 7f4e91200640 1 -- 172.21.15.18:0/3109765702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8c103b50 msgr2=0x7f4e8c10a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.492+0000 7f4e91200640 1 --2- 172.21.15.18:0/3109765702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8c103b50 0x7f4e8c10a3e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009ca0 tx=0x7f4e8402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.492+0000 7f4e91200640 1 -- 172.21.15.18:0/3109765702 shutdown_connections 2024-09-13T16:52:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.492+0000 7f4e91200640 1 --2- 172.21.15.18:0/3109765702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c103190 0x7f4e8c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.492+0000 7f4e91200640 1 --2- 172.21.15.18:0/3109765702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8c103b50 0x7f4e8c10a3e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.492+0000 7f4e91200640 1 --2- 172.21.15.18:0/3109765702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e8c101fa0 0x7f4e8c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.492+0000 7f4e91200640 1 -- 172.21.15.18:0/3109765702 >> 172.21.15.18:0/3109765702 conn(0x7f4e8c0fd700 msgr2=0x7f4e8c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.492+0000 7f4e91200640 1 -- 172.21.15.18:0/3109765702 shutdown_connections 2024-09-13T16:52:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.492+0000 7f4e91200640 1 -- 172.21.15.18:0/3109765702 wait complete. 2024-09-13T16:52:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.493+0000 7f4e91200640 1 Processor -- start 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.493+0000 7f4e91200640 1 -- start start 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.493+0000 7f4e91200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c101fa0 0x7f4e8c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.493+0000 7f4e91200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e8c103190 0x7f4e8c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.493+0000 7f4e91200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8c103b50 0x7f4e8c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.493+0000 7f4e91200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c19f9c0 con 0x7f4e8c101fa0 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.493+0000 7f4e91200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c19fb30 con 0x7f4e8c103190 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.493+0000 7f4e91200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c19fcf0 con 0x7f4e8c103b50 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e89e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c101fa0 0x7f4e8c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e8a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8c103b50 0x7f4e8c19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e8a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8c103b50 0x7f4e8c19f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:50566/0 (socket says 172.21.15.18:50566) 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e8a800640 1 -- 172.21.15.18:0/4078318724 learned_addr learned my addr 172.21.15.18:0/4078318724 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e81400640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e8c103190 0x7f4e8c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e8a800640 1 -- 172.21.15.18:0/4078318724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e8c103190 msgr2=0x7f4e8c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e8a800640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e8c103190 0x7f4e8c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e8a800640 1 -- 172.21.15.18:0/4078318724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c101fa0 msgr2=0x7f4e8c197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e8a800640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c101fa0 0x7f4e8c197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e8a800640 1 -- 172.21.15.18:0/4078318724 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e84009900 con 0x7f4e8c103b50 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.494+0000 7f4e89e00640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c101fa0 0x7f4e8c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.495+0000 7f4e8a800640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8c103b50 0x7f4e8c19f480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e8402aeb0 tx=0x7f4e84003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.495+0000 7f4e83400640 1 -- 172.21.15.18:0/4078318724 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840307c0 con 0x7f4e8c103b50 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.495+0000 7f4e83400640 1 -- 172.21.15.18:0/4078318724 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e84040070 con 0x7f4e8c103b50 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.495+0000 7f4e91200640 1 -- 172.21.15.18:0/4078318724 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c19ff70 con 0x7f4e8c103b50 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.495+0000 7f4e83400640 1 -- 172.21.15.18:0/4078318724 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840044a0 con 0x7f4e8c103b50 2024-09-13T16:52:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.495+0000 7f4e91200640 1 -- 172.21.15.18:0/4078318724 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c1a03f0 con 0x7f4e8c103b50 2024-09-13T16:52:00.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.496+0000 7f4e91200640 1 -- 172.21.15.18:0/4078318724 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c109430 con 0x7f4e8c103b50 2024-09-13T16:52:00.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.498+0000 7f4e83400640 1 -- 172.21.15.18:0/4078318724 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4e84042030 con 0x7f4e8c103b50 2024-09-13T16:52:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.499+0000 7f4e83400640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4e700a1090 0x7f4e700a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.499+0000 7f4e83400640 1 -- 172.21.15.18:0/4078318724 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f4e840ee3b0 con 0x7f4e8c103b50 2024-09-13T16:52:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.500+0000 7f4e89e00640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4e700a1090 0x7f4e700a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.500+0000 7f4e89e00640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4e700a1090 0x7f4e700a3550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c102ff0 tx=0x7f4e7c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:00.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.501+0000 7f4e83400640 1 -- 172.21.15.18:0/4078318724 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4e840b7780 con 0x7f4e8c103b50 2024-09-13T16:52:00.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.687+0000 7f4e91200640 1 -- 172.21.15.18:0/4078318724 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e8c108ea0 con 0x7f4e8c103b50 2024-09-13T16:52:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.689+0000 7f4e83400640 1 -- 172.21.15.18:0/4078318724 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24592 (secure 0 0 0) 0x7f4e840bada0 con 0x7f4e8c103b50 2024-09-13T16:52:00.691 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:52:00.691 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":93,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:51:14.023061+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:52:00.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.691+0000 7f4e91200640 1 -- 172.21.15.18:0/4078318724 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4e700a1090 msgr2=0x7f4e700a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:00.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.691+0000 7f4e91200640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4e700a1090 0x7f4e700a3550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c102ff0 tx=0x7f4e7c005f90 comp rx=0 tx=0).stop 2024-09-13T16:52:00.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.691+0000 7f4e91200640 1 -- 172.21.15.18:0/4078318724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8c103b50 msgr2=0x7f4e8c19f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:00.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.691+0000 7f4e91200640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8c103b50 0x7f4e8c19f480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e8402aeb0 tx=0x7f4e84003c20 comp rx=0 tx=0).stop 2024-09-13T16:52:00.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.691+0000 7f4e91200640 1 -- 172.21.15.18:0/4078318724 shutdown_connections 2024-09-13T16:52:00.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.691+0000 7f4e91200640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e8c103b50 0x7f4e8c19f480 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.691+0000 7f4e91200640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e8c103190 0x7f4e8c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.691+0000 7f4e91200640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f4e700a1090 0x7f4e700a3550 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.691+0000 7f4e91200640 1 --2- 172.21.15.18:0/4078318724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c101fa0 0x7f4e8c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.691+0000 7f4e91200640 1 -- 172.21.15.18:0/4078318724 >> 172.21.15.18:0/4078318724 conn(0x7f4e8c0fd700 msgr2=0x7f4e8c106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:00.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.692+0000 7f4e91200640 1 -- 172.21.15.18:0/4078318724 shutdown_connections 2024-09-13T16:52:00.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.692+0000 7f4e91200640 1 -- 172.21.15.18:0/4078318724 wait complete. 2024-09-13T16:52:00.710 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:49:26.572697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:49:27.624038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:49:30.629093+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:52:00.711 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:52:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.870+0000 7f04eb200640 1 -- 172.21.15.18:0/725553064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04e4103170 msgr2=0x7f04e41035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.870+0000 7f04eb200640 1 --2- 172.21.15.18:0/725553064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04e4103170 0x7f04e41035f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009900 tx=0x7f04d002a400 comp rx=0 tx=0).stop 2024-09-13T16:52:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.870+0000 7f04eb200640 1 -- 172.21.15.18:0/725553064 shutdown_connections 2024-09-13T16:52:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.870+0000 7f04eb200640 1 --2- 172.21.15.18:0/725553064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e4103b30 0x7f04e410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.870+0000 7f04eb200640 1 --2- 172.21.15.18:0/725553064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04e4103170 0x7f04e41035f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.870+0000 7f04eb200640 1 --2- 172.21.15.18:0/725553064 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04e4101f80 0x7f04e4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.870+0000 7f04eb200640 1 -- 172.21.15.18:0/725553064 >> 172.21.15.18:0/725553064 conn(0x7f04e40fd700 msgr2=0x7f04e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.870+0000 7f04eb200640 1 -- 172.21.15.18:0/725553064 shutdown_connections 2024-09-13T16:52:00.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.870+0000 7f04eb200640 1 -- 172.21.15.18:0/725553064 wait complete. 2024-09-13T16:52:00.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.871+0000 7f04eb200640 1 Processor -- start 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.871+0000 7f04eb200640 1 -- start start 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.871+0000 7f04eb200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e4101f80 0x7f04e4197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04eb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04e4103170 0x7f04e41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04eb200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04e4103b30 0x7f04e419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04eb200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e419fa60 con 0x7f04e4101f80 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04eb200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e419fbd0 con 0x7f04e4103b30 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04eb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e419fd90 con 0x7f04e4103170 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e4101f80 0x7f04e4197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04e4103170 0x7f04e41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e4101f80 0x7f04e4197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55440/0 (socket says 172.21.15.18:55440) 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04e4103170 0x7f04e41984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:58418/0 (socket says 172.21.15.18:58418) 2024-09-13T16:52:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3e00640 1 -- 172.21.15.18:0/1965563773 learned_addr learned my addr 172.21.15.18:0/1965563773 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e9200640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04e4103b30 0x7f04e419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3400640 1 -- 172.21.15.18:0/1965563773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04e4103b30 msgr2=0x7f04e419f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3400640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04e4103b30 0x7f04e419f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3400640 1 -- 172.21.15.18:0/1965563773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e4101f80 msgr2=0x7f04e4197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3400640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e4101f80 0x7f04e4197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3400640 1 -- 172.21.15.18:0/1965563773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4009490 con 0x7f04e4103170 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.872+0000 7f04e3e00640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e4101f80 0x7f04e4197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.873+0000 7f04e3400640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04e4103170 0x7f04e41984b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f04d002a920 tx=0x7f04d0003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.873+0000 7f04e0c00640 1 -- 172.21.15.18:0/1965563773 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0003e00 con 0x7f04e4103170 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.873+0000 7f04eb200640 1 -- 172.21.15.18:0/1965563773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d0009560 con 0x7f04e4103170 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.873+0000 7f04e0c00640 1 -- 172.21.15.18:0/1965563773 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04d0031c70 con 0x7f04e4103170 2024-09-13T16:52:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.873+0000 7f04e0c00640 1 -- 172.21.15.18:0/1965563773 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d003bbb0 con 0x7f04e4103170 2024-09-13T16:52:00.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.873+0000 7f04eb200640 1 -- 172.21.15.18:0/1965563773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e41a0350 con 0x7f04e4103170 2024-09-13T16:52:00.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.874+0000 7f04eb200640 1 -- 172.21.15.18:0/1965563773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e41093e0 con 0x7f04e4103170 2024-09-13T16:52:00.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.876+0000 7f04e0c00640 1 -- 172.21.15.18:0/1965563773 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f04d003bd10 con 0x7f04e4103170 2024-09-13T16:52:00.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.877+0000 7f04e0c00640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f04c80a1090 0x7f04c80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:00.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.877+0000 7f04e0c00640 1 -- 172.21.15.18:0/1965563773 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f04d00eda60 con 0x7f04e4103170 2024-09-13T16:52:00.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.877+0000 7f04e3e00640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f04c80a1090 0x7f04c80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:00.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.878+0000 7f04e3e00640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f04c80a1090 0x7f04c80a3550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f04d40058c0 tx=0x7f04d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:00.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:00.879+0000 7f04e0c00640 1 -- 172.21.15.18:0/1965563773 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f04d00b6ee0 con 0x7f04e4103170 2024-09-13T16:52:00.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:00 smithi094 ceph-mon[35259]: pgmap v377: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:52:00.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:00 smithi018 ceph-mon[30981]: pgmap v377: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:52:01.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:00 smithi144 ceph-mon[35328]: pgmap v377: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:52:01.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.057+0000 7f04eb200640 1 -- 172.21.15.18:0/1965563773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04e410d870 con 0x7f04e4103170 2024-09-13T16:52:01.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.058+0000 7f04e0c00640 1 -- 172.21.15.18:0/1965563773 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04d003f020 con 0x7f04e4103170 2024-09-13T16:52:01.059 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T16:52:01.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 -- 172.21.15.18:0/1965563773 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f04c80a1090 msgr2=0x7f04c80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f04c80a1090 0x7f04c80a3550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f04d40058c0 tx=0x7f04d4005f90 comp rx=0 tx=0).stop 2024-09-13T16:52:01.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 -- 172.21.15.18:0/1965563773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04e4103170 msgr2=0x7f04e41984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04e4103170 0x7f04e41984b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f04d002a920 tx=0x7f04d0003c10 comp rx=0 tx=0).stop 2024-09-13T16:52:01.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 -- 172.21.15.18:0/1965563773 shutdown_connections 2024-09-13T16:52:01.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04e4103b30 0x7f04e419f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04e4103170 0x7f04e41984b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f04c80a1090 0x7f04c80a3550 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 --2- 172.21.15.18:0/1965563773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e4101f80 0x7f04e4197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 -- 172.21.15.18:0/1965563773 >> 172.21.15.18:0/1965563773 conn(0x7f04e40fd700 msgr2=0x7f04e41065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:01.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 -- 172.21.15.18:0/1965563773 shutdown_connections 2024-09-13T16:52:01.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.060+0000 7f04eb200640 1 -- 172.21.15.18:0/1965563773 wait complete. 2024-09-13T16:52:01.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:52:01.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.237+0000 7faee5200640 1 -- 172.21.15.18:0/1459656315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0100f60 msgr2=0x7faee01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.237+0000 7faee5200640 1 --2- 172.21.15.18:0/1459656315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0100f60 0x7faee01013e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faec8009900 tx=0x7faec802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.237+0000 7faee5200640 1 -- 172.21.15.18:0/1459656315 shutdown_connections 2024-09-13T16:52:01.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.237+0000 7faee5200640 1 --2- 172.21.15.18:0/1459656315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0100f60 0x7faee01013e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.237+0000 7faee5200640 1 --2- 172.21.15.18:0/1459656315 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee0101920 0x7faee01081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.237+0000 7faee5200640 1 --2- 172.21.15.18:0/1459656315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee00ffd70 0x7faee0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.237+0000 7faee5200640 1 -- 172.21.15.18:0/1459656315 >> 172.21.15.18:0/1459656315 conn(0x7faee00fb4d0 msgr2=0x7faee00fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:01.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.237+0000 7faee5200640 1 -- 172.21.15.18:0/1459656315 shutdown_connections 2024-09-13T16:52:01.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.237+0000 7faee5200640 1 -- 172.21.15.18:0/1459656315 wait complete. 2024-09-13T16:52:01.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.238+0000 7faee5200640 1 Processor -- start 2024-09-13T16:52:01.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.238+0000 7faee5200640 1 -- start start 2024-09-13T16:52:01.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.238+0000 7faee5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee00ffd70 0x7faee0074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.238+0000 7faee5200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee0100f60 0x7faee00728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.238+0000 7faee5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0101920 0x7faee0072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.238+0000 7faee5200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee0073540 con 0x7faee0101920 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.238+0000 7faee5200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00736b0 con 0x7faee0100f60 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.238+0000 7faee5200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee019fe50 con 0x7faee00ffd70 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faede800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0101920 0x7faee0072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faede800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0101920 0x7faee0072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55444/0 (socket says 172.21.15.18:55444) 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faedde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee00ffd70 0x7faee0074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faede800640 1 -- 172.21.15.18:0/4113452002 learned_addr learned my addr 172.21.15.18:0/4113452002 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faed5400640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee0100f60 0x7faee00728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faede800640 1 -- 172.21.15.18:0/4113452002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee00ffd70 msgr2=0x7faee0074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faede800640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee00ffd70 0x7faee0074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faede800640 1 -- 172.21.15.18:0/4113452002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee0100f60 msgr2=0x7faee00728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faede800640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee0100f60 0x7faee00728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faede800640 1 -- 172.21.15.18:0/4113452002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8009840 con 0x7faee0101920 2024-09-13T16:52:01.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faedde00640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee00ffd70 0x7faee0074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:01.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.239+0000 7faede800640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0101920 0x7faee0072de0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faed8009cf0 tx=0x7faed800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:01.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.240+0000 7faed7400640 1 -- 172.21.15.18:0/4113452002 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8009b40 con 0x7faee0101920 2024-09-13T16:52:01.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.240+0000 7faed7400640 1 -- 172.21.15.18:0/4113452002 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faed8003b70 con 0x7faee0101920 2024-09-13T16:52:01.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.240+0000 7faee5200640 1 -- 172.21.15.18:0/4113452002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec8009560 con 0x7faee0101920 2024-09-13T16:52:01.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.240+0000 7faed7400640 1 -- 172.21.15.18:0/4113452002 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8010850 con 0x7faee0101920 2024-09-13T16:52:01.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.240+0000 7faee5200640 1 -- 172.21.15.18:0/4113452002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee01a0450 con 0x7faee0101920 2024-09-13T16:52:01.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.241+0000 7faee5200640 1 -- 172.21.15.18:0/4113452002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee01071f0 con 0x7faee0101920 2024-09-13T16:52:01.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.242+0000 7faed7400640 1 -- 172.21.15.18:0/4113452002 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7faed8003ce0 con 0x7faee0101920 2024-09-13T16:52:01.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.244+0000 7faed7400640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7faec40a1110 0x7faec40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.244+0000 7faed7400640 1 -- 172.21.15.18:0/4113452002 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7faed8014070 con 0x7faee0101920 2024-09-13T16:52:01.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.244+0000 7faedde00640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7faec40a1110 0x7faec40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.245+0000 7faedde00640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7faec40a1110 0x7faec40a35d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faee0100dc0 tx=0x7faed0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.248+0000 7faed7400640 1 -- 172.21.15.18:0/4113452002 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faed8096650 con 0x7faee0101920 2024-09-13T16:52:01.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.427+0000 7faee5200640 1 -- 172.21.15.18:0/4113452002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faee0106c60 con 0x7faee0101920 2024-09-13T16:52:01.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.428+0000 7faed7400640 1 -- 172.21.15.18:0/4113452002 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7faed8099c70 con 0x7faee0101920 2024-09-13T16:52:01.429 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:52:01.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 -- 172.21.15.18:0/4113452002 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7faec40a1110 msgr2=0x7faec40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7faec40a1110 0x7faec40a35d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faee0100dc0 tx=0x7faed0005f90 comp rx=0 tx=0).stop 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 -- 172.21.15.18:0/4113452002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0101920 msgr2=0x7faee0072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0101920 0x7faee0072de0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faed8009cf0 tx=0x7faed800c6a0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 -- 172.21.15.18:0/4113452002 shutdown_connections 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7faec40a1110 0x7faec40a35d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0101920 0x7faee0072de0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faee0100f60 0x7faee00728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 --2- 172.21.15.18:0/4113452002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee00ffd70 0x7faee0074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 -- 172.21.15.18:0/4113452002 >> 172.21.15.18:0/4113452002 conn(0x7faee00fb4d0 msgr2=0x7faee01043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 -- 172.21.15.18:0/4113452002 shutdown_connections 2024-09-13T16:52:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.430+0000 7faee5200640 1 -- 172.21.15.18:0/4113452002 wait complete. 2024-09-13T16:52:01.448 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:52:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.607+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2439468031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6c8074490 msgr2=0x7fc6c80728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.607+0000 7fc6c7e00640 1 --2- 172.21.15.18:0/2439468031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6c8074490 0x7fc6c80728e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009900 tx=0x7fc6b802a480 comp rx=0 tx=0).stop 2024-09-13T16:52:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.607+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2439468031 shutdown_connections 2024-09-13T16:52:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.607+0000 7fc6c7e00640 1 --2- 172.21.15.18:0/2439468031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6c8107b70 0x7fc6c810a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.607+0000 7fc6c7e00640 1 --2- 172.21.15.18:0/2439468031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8072eb0 0x7fc6c8073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.607+0000 7fc6c7e00640 1 --2- 172.21.15.18:0/2439468031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6c8074490 0x7fc6c80728e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.607+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2439468031 >> 172.21.15.18:0/2439468031 conn(0x7fc6c80fb440 msgr2=0x7fc6c80fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.607+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2439468031 shutdown_connections 2024-09-13T16:52:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.607+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2439468031 wait complete. 2024-09-13T16:52:01.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.608+0000 7fc6c7e00640 1 Processor -- start 2024-09-13T16:52:01.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.608+0000 7fc6c7e00640 1 -- start start 2024-09-13T16:52:01.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c7e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6c8072eb0 0x7fc6c8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6c8074490 0x7fc6c8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8107b70 0x7fc6c819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c7e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c819f9c0 con 0x7fc6c8074490 2024-09-13T16:52:01.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c7e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c819fb30 con 0x7fc6c8072eb0 2024-09-13T16:52:01.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c819fcf0 con 0x7fc6c8107b70 2024-09-13T16:52:01.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c6a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6c8072eb0 0x7fc6c8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6c8074490 0x7fc6c8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c6a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6c8072eb0 0x7fc6c8197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:57628/0 (socket says 172.21.15.18:57628) 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c6a00640 1 -- 172.21.15.18:0/2130701251 learned_addr learned my addr 172.21.15.18:0/2130701251 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c7400640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8107b70 0x7fc6c819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c6a00640 1 -- 172.21.15.18:0/2130701251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8107b70 msgr2=0x7fc6c819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c6a00640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8107b70 0x7fc6c819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c6a00640 1 -- 172.21.15.18:0/2130701251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6c8074490 msgr2=0x7fc6c8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c6a00640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6c8074490 0x7fc6c8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c6a00640 1 -- 172.21.15.18:0/2130701251 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0009840 con 0x7fc6c8072eb0 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.609+0000 7fc6c6000640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6c8074490 0x7fc6c8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.610+0000 7fc6c6a00640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6c8072eb0 0x7fc6c8197f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009a20 tx=0x7fc6b8005620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.610+0000 7fc6bf400640 1 -- 172.21.15.18:0/2130701251 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8004c10 con 0x7fc6c8072eb0 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.610+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2130701251 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b8009560 con 0x7fc6c8072eb0 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.610+0000 7fc6bf400640 1 -- 172.21.15.18:0/2130701251 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6b8004d70 con 0x7fc6c8072eb0 2024-09-13T16:52:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.610+0000 7fc6bf400640 1 -- 172.21.15.18:0/2130701251 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8031ad0 con 0x7fc6c8072eb0 2024-09-13T16:52:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.610+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2130701251 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c81a0220 con 0x7fc6c8072eb0 2024-09-13T16:52:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.611+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2130701251 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c8106930 con 0x7fc6c8072eb0 2024-09-13T16:52:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.613+0000 7fc6bf400640 1 -- 172.21.15.18:0/2130701251 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc6b8003c40 con 0x7fc6c8072eb0 2024-09-13T16:52:01.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.614+0000 7fc6bf400640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc6ac0a1110 0x7fc6ac0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.614+0000 7fc6bf400640 1 -- 172.21.15.18:0/2130701251 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fc6b80edf70 con 0x7fc6c8072eb0 2024-09-13T16:52:01.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.615+0000 7fc6c6000640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc6ac0a1110 0x7fc6ac0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.615+0000 7fc6c6000640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc6ac0a1110 0x7fc6ac0a35d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc6c81993e0 tx=0x7fc6b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:01.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.616+0000 7fc6bf400640 1 -- 172.21.15.18:0/2130701251 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc6b80b7340 con 0x7fc6c8072eb0 2024-09-13T16:52:01.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:01 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4078318724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:52:01.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:01 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1965563773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:52:01.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:01 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4113452002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:52:01.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.797+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2130701251 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6c810d7b0 con 0x7fc6c8072eb0 2024-09-13T16:52:01.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.798+0000 7fc6bf400640 1 -- 172.21.15.18:0/2130701251 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6b8040020 con 0x7fc6c8072eb0 2024-09-13T16:52:01.799 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-13T16:52:01.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2130701251 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc6ac0a1110 msgr2=0x7fc6ac0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc6ac0a1110 0x7fc6ac0a35d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc6c81993e0 tx=0x7fc6b4005f90 comp rx=0 tx=0).stop 2024-09-13T16:52:01.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2130701251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6c8072eb0 msgr2=0x7fc6c8197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6c8072eb0 0x7fc6c8197f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009a20 tx=0x7fc6b8005620 comp rx=0 tx=0).stop 2024-09-13T16:52:01.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2130701251 shutdown_connections 2024-09-13T16:52:01.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc6ac0a1110 0x7fc6ac0a35d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6c8074490 0x7fc6c8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8107b70 0x7fc6c819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 --2- 172.21.15.18:0/2130701251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc6c8072eb0 0x7fc6c8197f20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2130701251 >> 172.21.15.18:0/2130701251 conn(0x7fc6c80fb440 msgr2=0x7fc6c8103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:01.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2130701251 shutdown_connections 2024-09-13T16:52:01.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.800+0000 7fc6c7e00640 1 -- 172.21.15.18:0/2130701251 wait complete. 2024-09-13T16:52:01.818 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:52:01.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:01 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/4078318724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:52:01.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:01 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1965563773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:52:01.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:01 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/4113452002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:52:01.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.978+0000 7f5b95600640 1 -- 172.21.15.18:0/215634619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b90074470 msgr2=0x7f5b900728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.978+0000 7f5b95600640 1 --2- 172.21.15.18:0/215634619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b90074470 0x7f5b900728c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009900 tx=0x7f5b8002a480 comp rx=0 tx=0).stop 2024-09-13T16:52:01.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.978+0000 7f5b95600640 1 -- 172.21.15.18:0/215634619 shutdown_connections 2024-09-13T16:52:01.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.978+0000 7f5b95600640 1 --2- 172.21.15.18:0/215634619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b90072e90 0x7f5b900732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.978+0000 7f5b95600640 1 --2- 172.21.15.18:0/215634619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b90107b90 0x7f5b9010a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.978+0000 7f5b95600640 1 --2- 172.21.15.18:0/215634619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b90074470 0x7f5b900728c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.978+0000 7f5b95600640 1 -- 172.21.15.18:0/215634619 >> 172.21.15.18:0/215634619 conn(0x7f5b900fb440 msgr2=0x7f5b900fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:01.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.978+0000 7f5b95600640 1 -- 172.21.15.18:0/215634619 shutdown_connections 2024-09-13T16:52:01.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.978+0000 7f5b95600640 1 -- 172.21.15.18:0/215634619 wait complete. 2024-09-13T16:52:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.979+0000 7f5b95600640 1 Processor -- start 2024-09-13T16:52:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.979+0000 7f5b95600640 1 -- start start 2024-09-13T16:52:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.979+0000 7f5b95600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b90072e90 0x7f5b90197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.979+0000 7f5b95600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b90074470 0x7f5b90198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.979+0000 7f5b95600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b90107b90 0x7f5b9019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.979+0000 7f5b95600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9019fa10 con 0x7f5b90107b90 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.979+0000 7f5b95600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9019fb80 con 0x7f5b90072e90 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.979+0000 7f5b95600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9019fd40 con 0x7f5b90074470 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b94c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b90107b90 0x7f5b9019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b94c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b90107b90 0x7f5b9019f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55474/0 (socket says 172.21.15.18:55474) 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b94c00640 1 -- 172.21.15.18:0/450638733 learned_addr learned my addr 172.21.15.18:0/450638733 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b8f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b90074470 0x7f5b90198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b8fe00640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b90072e90 0x7f5b90197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b94c00640 1 -- 172.21.15.18:0/450638733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b90074470 msgr2=0x7f5b90198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b94c00640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b90074470 0x7f5b90198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b94c00640 1 -- 172.21.15.18:0/450638733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b90072e90 msgr2=0x7f5b90197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b94c00640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b90072e90 0x7f5b90197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:01.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b94c00640 1 -- 172.21.15.18:0/450638733 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80009560 con 0x7f5b90107b90 2024-09-13T16:52:01.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.980+0000 7f5b94c00640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b90107b90 0x7f5b9019f4d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009fd0 tx=0x7f5b8800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:01.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.981+0000 7f5b8cc00640 1 -- 172.21.15.18:0/450638733 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8800bea0 con 0x7f5b90107b90 2024-09-13T16:52:01.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.981+0000 7f5b8cc00640 1 -- 172.21.15.18:0/450638733 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b88009940 con 0x7f5b90107b90 2024-09-13T16:52:01.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.981+0000 7f5b95600640 1 -- 172.21.15.18:0/450638733 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9019ffc0 con 0x7f5b90107b90 2024-09-13T16:52:01.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.981+0000 7f5b8cc00640 1 -- 172.21.15.18:0/450638733 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880106c0 con 0x7f5b90107b90 2024-09-13T16:52:01.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.981+0000 7f5b95600640 1 -- 172.21.15.18:0/450638733 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b901a0450 con 0x7f5b90107b90 2024-09-13T16:52:01.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.982+0000 7f5b95600640 1 -- 172.21.15.18:0/450638733 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b90106950 con 0x7f5b90107b90 2024-09-13T16:52:01.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.984+0000 7f5b8cc00640 1 -- 172.21.15.18:0/450638733 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5b880041b0 con 0x7f5b90107b90 2024-09-13T16:52:01.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.985+0000 7f5b8cc00640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b740a1090 0x7f5b740a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:01.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.985+0000 7f5b8cc00640 1 -- 172.21.15.18:0/450638733 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f5b880cc8e0 con 0x7f5b90107b90 2024-09-13T16:52:01.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.986+0000 7f5b8fe00640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b740a1090 0x7f5b740a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:01.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.986+0000 7f5b8fe00640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b740a1090 0x7f5b740a3550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b80006010 tx=0x7f5b80005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:01.989+0000 7f5b8cc00640 1 -- 172.21.15.18:0/450638733 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5b88095d60 con 0x7f5b90107b90 2024-09-13T16:52:02.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:01 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/4078318724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:52:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:01 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1965563773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:52:02.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:01 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/4113452002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:52:02.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.169+0000 7f5b95600640 1 -- 172.21.15.18:0/450638733 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5b901063c0 con 0x7f5b90107b90 2024-09-13T16:52:02.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.169+0000 7f5b8cc00640 1 -- 172.21.15.18:0/450638733 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5b88099380 con 0x7f5b90107b90 2024-09-13T16:52:02.171 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:52:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.171+0000 7f5b95600640 1 -- 172.21.15.18:0/450638733 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b740a1090 msgr2=0x7f5b740a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.171+0000 7f5b95600640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b740a1090 0x7f5b740a3550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b80006010 tx=0x7f5b80005760 comp rx=0 tx=0).stop 2024-09-13T16:52:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.171+0000 7f5b95600640 1 -- 172.21.15.18:0/450638733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b90107b90 msgr2=0x7f5b9019f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.171+0000 7f5b95600640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b90107b90 0x7f5b9019f4d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009fd0 tx=0x7f5b8800b260 comp rx=0 tx=0).stop 2024-09-13T16:52:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.171+0000 7f5b95600640 1 -- 172.21.15.18:0/450638733 shutdown_connections 2024-09-13T16:52:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.171+0000 7f5b95600640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5b740a1090 0x7f5b740a3550 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.172+0000 7f5b95600640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b90107b90 0x7f5b9019f4d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.172+0000 7f5b95600640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b90074470 0x7f5b90198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.172+0000 7f5b95600640 1 --2- 172.21.15.18:0/450638733 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b90072e90 0x7f5b90197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.172+0000 7f5b95600640 1 -- 172.21.15.18:0/450638733 >> 172.21.15.18:0/450638733 conn(0x7f5b900fb440 msgr2=0x7f5b90103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:02.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.172+0000 7f5b95600640 1 -- 172.21.15.18:0/450638733 shutdown_connections 2024-09-13T16:52:02.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.172+0000 7f5b95600640 1 -- 172.21.15.18:0/450638733 wait complete. 2024-09-13T16:52:02.189 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:52:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.343+0000 7f90fb200640 1 -- 172.21.15.18:0/2080885648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc103960 msgr2=0x7f90fc10a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.343+0000 7f90fb200640 1 --2- 172.21.15.18:0/2080885648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc103960 0x7f90fc10a1f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f90f4009ca0 tx=0x7f90f402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.344+0000 7f90fb200640 1 -- 172.21.15.18:0/2080885648 shutdown_connections 2024-09-13T16:52:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.344+0000 7f90fb200640 1 --2- 172.21.15.18:0/2080885648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc103960 0x7f90fc10a1f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.344+0000 7f90fb200640 1 --2- 172.21.15.18:0/2080885648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90fc102fa0 0x7f90fc103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.344+0000 7f90fb200640 1 --2- 172.21.15.18:0/2080885648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90fc101db0 0x7f90fc1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.344+0000 7f90fb200640 1 -- 172.21.15.18:0/2080885648 >> 172.21.15.18:0/2080885648 conn(0x7f90fc0fd530 msgr2=0x7f90fc0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:02.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.344+0000 7f90fb200640 1 -- 172.21.15.18:0/2080885648 shutdown_connections 2024-09-13T16:52:02.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.344+0000 7f90fb200640 1 -- 172.21.15.18:0/2080885648 wait complete. 2024-09-13T16:52:02.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90fb200640 1 Processor -- start 2024-09-13T16:52:02.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90fb200640 1 -- start start 2024-09-13T16:52:02.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90fb200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90fc101db0 0x7f90fc197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:02.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90fb200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc102fa0 0x7f90fc1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:02.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90fb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90fc103960 0x7f90fc19f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:02.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90fb200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc19f810 con 0x7f90fc102fa0 2024-09-13T16:52:02.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90fb200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc19f980 con 0x7f90fc101db0 2024-09-13T16:52:02.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90fb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc19fb40 con 0x7f90fc103960 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc102fa0 0x7f90fc1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc102fa0 0x7f90fc1982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55490/0 (socket says 172.21.15.18:55490) 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90f3e00640 1 -- 172.21.15.18:0/3429209841 learned_addr learned my addr 172.21.15.18:0/3429209841 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90f9e00640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90fc101db0 0x7f90fc197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.345+0000 7f90fa800640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90fc103960 0x7f90fc19f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90f3e00640 1 -- 172.21.15.18:0/3429209841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90fc103960 msgr2=0x7f90fc19f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90f3e00640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90fc103960 0x7f90fc19f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90f3e00640 1 -- 172.21.15.18:0/3429209841 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90fc101db0 msgr2=0x7f90fc197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90f3e00640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90fc101db0 0x7f90fc197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90f3e00640 1 -- 172.21.15.18:0/3429209841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f4009900 con 0x7f90fc102fa0 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90f3e00640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc102fa0 0x7f90fc1982c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e9f0 tx=0x7f90e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90f2a00640 1 -- 172.21.15.18:0/3429209841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4009700 con 0x7f90fc102fa0 2024-09-13T16:52:02.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90f2a00640 1 -- 172.21.15.18:0/3429209841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90e400cd80 con 0x7f90fc102fa0 2024-09-13T16:52:02.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90fb200640 1 -- 172.21.15.18:0/3429209841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90fc19fe20 con 0x7f90fc102fa0 2024-09-13T16:52:02.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90f2a00640 1 -- 172.21.15.18:0/3429209841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4018860 con 0x7f90fc102fa0 2024-09-13T16:52:02.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.346+0000 7f90fb200640 1 -- 172.21.15.18:0/3429209841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90fc1a02a0 con 0x7f90fc102fa0 2024-09-13T16:52:02.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.347+0000 7f90fb200640 1 -- 172.21.15.18:0/3429209841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90fc10d6a0 con 0x7f90fc102fa0 2024-09-13T16:52:02.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.349+0000 7f90f2a00640 1 -- 172.21.15.18:0/3429209841 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f90e40189c0 con 0x7f90fc102fa0 2024-09-13T16:52:02.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.350+0000 7f90f2a00640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90e00a1110 0x7f90e00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:02.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.351+0000 7f90f2a00640 1 -- 172.21.15.18:0/3429209841 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f90e4014070 con 0x7f90fc102fa0 2024-09-13T16:52:02.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.351+0000 7f90f9e00640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90e00a1110 0x7f90e00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:02.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.351+0000 7f90f9e00640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90e00a1110 0x7f90e00a35d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f90fc199200 tx=0x7f90ec00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:02.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.354+0000 7f90f2a00640 1 -- 172.21.15.18:0/3429209841 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f90e4052e20 con 0x7f90fc102fa0 2024-09-13T16:52:02.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.573+0000 7f90fb200640 1 -- 172.21.15.18:0/3429209841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90fc10d8b0 con 0x7f90fc102fa0 2024-09-13T16:52:02.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.573+0000 7f90f2a00640 1 -- 172.21.15.18:0/3429209841 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10852 (secure 0 0 0) 0x7f90e4096320 con 0x7f90fc102fa0 2024-09-13T16:52:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:52:02.575 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:49:28.080578+0000","modified":"2024-09-13T16:49:57.790808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24590,"mds_1":24566,"mds_2":24539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24539":{"gid":24539,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:52:02.575 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 24 2024-09-13T16:52:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 -- 172.21.15.18:0/3429209841 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90e00a1110 msgr2=0x7f90e00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90e00a1110 0x7f90e00a35d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f90fc199200 tx=0x7f90ec00b410 comp rx=0 tx=0).stop 2024-09-13T16:52:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 -- 172.21.15.18:0/3429209841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc102fa0 msgr2=0x7f90fc1982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc102fa0 0x7f90fc1982c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e9f0 tx=0x7f90e400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 -- 172.21.15.18:0/3429209841 shutdown_connections 2024-09-13T16:52:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f90e00a1110 0x7f90e00a35d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc102fa0 0x7f90fc1982c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90fc103960 0x7f90fc19f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 --2- 172.21.15.18:0/3429209841 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90fc101db0 0x7f90fc197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 -- 172.21.15.18:0/3429209841 >> 172.21.15.18:0/3429209841 conn(0x7f90fc0fd530 msgr2=0x7f90fc0ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:02.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 -- 172.21.15.18:0/3429209841 shutdown_connections 2024-09-13T16:52:02.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.576+0000 7f90fb200640 1 -- 172.21.15.18:0/3429209841 wait complete. 2024-09-13T16:52:02.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:52:02.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.750+0000 7f3e9ee00640 1 -- 172.21.15.18:0/821074776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e98103960 msgr2=0x7f3e9810a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.750+0000 7f3e9ee00640 1 --2- 172.21.15.18:0/821074776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e98103960 0x7f3e9810a1f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009ca0 tx=0x7f3e9002a8b0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.750+0000 7f3e9ee00640 1 -- 172.21.15.18:0/821074776 shutdown_connections 2024-09-13T16:52:02.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.750+0000 7f3e9ee00640 1 --2- 172.21.15.18:0/821074776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e98103960 0x7f3e9810a1f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.750+0000 7f3e9ee00640 1 --2- 172.21.15.18:0/821074776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e98102fa0 0x7f3e98103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.750+0000 7f3e9ee00640 1 --2- 172.21.15.18:0/821074776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e98101db0 0x7f3e981021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.750+0000 7f3e9ee00640 1 -- 172.21.15.18:0/821074776 >> 172.21.15.18:0/821074776 conn(0x7f3e980fd530 msgr2=0x7f3e980ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:02.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.750+0000 7f3e9ee00640 1 -- 172.21.15.18:0/821074776 shutdown_connections 2024-09-13T16:52:02.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.750+0000 7f3e9ee00640 1 -- 172.21.15.18:0/821074776 wait complete. 2024-09-13T16:52:02.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.751+0000 7f3e9ee00640 1 Processor -- start 2024-09-13T16:52:02.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.751+0000 7f3e9ee00640 1 -- start start 2024-09-13T16:52:02.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.751+0000 7f3e9ee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e98101db0 0x7f3e98197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:02.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.751+0000 7f3e9ee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e98102fa0 0x7f3e981982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:02.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.751+0000 7f3e9ee00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e98103960 0x7f3e9819f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:02.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.751+0000 7f3e9ee00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9819f810 con 0x7f3e98102fa0 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.751+0000 7f3e9ee00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9819f980 con 0x7f3e98103960 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.751+0000 7f3e9ee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9819fb40 con 0x7f3e98101db0 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.751+0000 7f3e9d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e98102fa0 0x7f3e981982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e98102fa0 0x7f3e981982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55496/0 (socket says 172.21.15.18:55496) 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9d000640 1 -- 172.21.15.18:0/2260873344 learned_addr learned my addr 172.21.15.18:0/2260873344 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9da00640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e98101db0 0x7f3e98197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9e400640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e98103960 0x7f3e9819f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9d000640 1 -- 172.21.15.18:0/2260873344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e98101db0 msgr2=0x7f3e98197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9d000640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e98101db0 0x7f3e98197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9d000640 1 -- 172.21.15.18:0/2260873344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e98103960 msgr2=0x7f3e9819f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9d000640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e98103960 0x7f3e9819f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9d000640 1 -- 172.21.15.18:0/2260873344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009900 con 0x7f3e98102fa0 2024-09-13T16:52:02.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9e400640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e98103960 0x7f3e9819f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:02.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9da00640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e98101db0 0x7f3e98197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:02.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9d000640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e98102fa0 0x7f3e981982c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400e9f0 tx=0x7f3e8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:02.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e96000640 1 -- 172.21.15.18:0/2260873344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84009700 con 0x7f3e98102fa0 2024-09-13T16:52:02.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e96000640 1 -- 172.21.15.18:0/2260873344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e8400cd80 con 0x7f3e98102fa0 2024-09-13T16:52:02.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.752+0000 7f3e9ee00640 1 -- 172.21.15.18:0/2260873344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9819fe20 con 0x7f3e98102fa0 2024-09-13T16:52:02.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.753+0000 7f3e96000640 1 -- 172.21.15.18:0/2260873344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84018860 con 0x7f3e98102fa0 2024-09-13T16:52:02.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.753+0000 7f3e9ee00640 1 -- 172.21.15.18:0/2260873344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e981a02a0 con 0x7f3e98102fa0 2024-09-13T16:52:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.754+0000 7f3e9ee00640 1 -- 172.21.15.18:0/2260873344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9810d6a0 con 0x7f3e98102fa0 2024-09-13T16:52:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.755+0000 7f3e96000640 1 -- 172.21.15.18:0/2260873344 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3e840189c0 con 0x7f3e98102fa0 2024-09-13T16:52:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.757+0000 7f3e96000640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3e800a1110 0x7f3e800a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.757+0000 7f3e96000640 1 -- 172.21.15.18:0/2260873344 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f3e84014070 con 0x7f3e98102fa0 2024-09-13T16:52:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.757+0000 7f3e9da00640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3e800a1110 0x7f3e800a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:02.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.758+0000 7f3e9da00640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3e800a1110 0x7f3e800a35d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3e98199200 tx=0x7f3e8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:02.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.760+0000 7f3e96000640 1 -- 172.21.15.18:0/2260873344 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3e84052e20 con 0x7f3e98102fa0 2024-09-13T16:52:02.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:02 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2130701251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:52:02.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:02 smithi094 ceph-mon[35259]: pgmap v378: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:52:02.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:02 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/450638733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:52:02.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:02 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3429209841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:52:02.925 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:02 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2130701251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:52:02.925 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:02 smithi018 ceph-mon[30981]: pgmap v378: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:52:02.925 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:02 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/450638733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:52:02.926 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:02 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3429209841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:52:02.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.943+0000 7f3e9ee00640 1 -- 172.21.15.18:0/2260873344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e9810d8b0 con 0x7f3e98102fa0 2024-09-13T16:52:02.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.944+0000 7f3e96000640 1 -- 172.21.15.18:0/2260873344 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24592 (secure 0 0 0) 0x7f3e840964c0 con 0x7f3e98102fa0 2024-09-13T16:52:02.946 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:52:02.946 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":93,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:51:14.023061+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:52:02.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.946+0000 7f3e9ee00640 1 -- 172.21.15.18:0/2260873344 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3e800a1110 msgr2=0x7f3e800a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.946+0000 7f3e9ee00640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3e800a1110 0x7f3e800a35d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3e98199200 tx=0x7f3e8c005f90 comp rx=0 tx=0).stop 2024-09-13T16:52:02.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.946+0000 7f3e9ee00640 1 -- 172.21.15.18:0/2260873344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e98102fa0 msgr2=0x7f3e981982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:02.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.946+0000 7f3e9ee00640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e98102fa0 0x7f3e981982c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400e9f0 tx=0x7f3e8400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.947+0000 7f3e9ee00640 1 -- 172.21.15.18:0/2260873344 shutdown_connections 2024-09-13T16:52:02.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.947+0000 7f3e9ee00640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3e800a1110 0x7f3e800a35d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.947+0000 7f3e9ee00640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e98102fa0 0x7f3e981982c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.947+0000 7f3e9ee00640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e98103960 0x7f3e9819f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.947+0000 7f3e9ee00640 1 --2- 172.21.15.18:0/2260873344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e98101db0 0x7f3e98197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:02.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.947+0000 7f3e9ee00640 1 -- 172.21.15.18:0/2260873344 >> 172.21.15.18:0/2260873344 conn(0x7f3e980fd530 msgr2=0x7f3e980ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:02.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.947+0000 7f3e9ee00640 1 -- 172.21.15.18:0/2260873344 shutdown_connections 2024-09-13T16:52:02.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:02.947+0000 7f3e9ee00640 1 -- 172.21.15.18:0/2260873344 wait complete. 2024-09-13T16:52:02.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:49:26.572697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:49:27.624038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:49:30.629093+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:52:02.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:52:03.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:02 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2130701251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:52:03.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:02 smithi144 ceph-mon[35328]: pgmap v378: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:52:03.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:02 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/450638733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:52:03.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:02 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3429209841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:52:03.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.126+0000 7f6b87200640 1 -- 172.21.15.18:0/1438423734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b800ffd70 msgr2=0x7f6b80100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.126+0000 7f6b87200640 1 --2- 172.21.15.18:0/1438423734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b800ffd70 0x7f6b80100170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009900 tx=0x7f6b7002a410 comp rx=0 tx=0).stop 2024-09-13T16:52:03.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.126+0000 7f6b87200640 1 -- 172.21.15.18:0/1438423734 shutdown_connections 2024-09-13T16:52:03.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.126+0000 7f6b87200640 1 --2- 172.21.15.18:0/1438423734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b80101920 0x7f6b801081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.126+0000 7f6b87200640 1 --2- 172.21.15.18:0/1438423734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b80100f60 0x7f6b801013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.126+0000 7f6b87200640 1 --2- 172.21.15.18:0/1438423734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b800ffd70 0x7f6b80100170 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.126+0000 7f6b87200640 1 -- 172.21.15.18:0/1438423734 >> 172.21.15.18:0/1438423734 conn(0x7f6b800fb4d0 msgr2=0x7f6b800fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:03.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.126+0000 7f6b87200640 1 -- 172.21.15.18:0/1438423734 shutdown_connections 2024-09-13T16:52:03.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.126+0000 7f6b87200640 1 -- 172.21.15.18:0/1438423734 wait complete. 2024-09-13T16:52:03.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.127+0000 7f6b87200640 1 Processor -- start 2024-09-13T16:52:03.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.127+0000 7f6b87200640 1 -- start start 2024-09-13T16:52:03.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.127+0000 7f6b87200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b800ffd70 0x7f6b80197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.127+0000 7f6b87200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b80100f60 0x7f6b801984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.127+0000 7f6b87200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b80101920 0x7f6b8019f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.127+0000 7f6b87200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8019fa80 con 0x7f6b800ffd70 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.127+0000 7f6b87200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8019fbf0 con 0x7f6b80101920 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.127+0000 7f6b87200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8019fdb0 con 0x7f6b80100f60 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.127+0000 7f6b7fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b800ffd70 0x7f6b80197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b77400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b80100f60 0x7f6b801984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b7fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b800ffd70 0x7f6b80197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55516/0 (socket says 172.21.15.18:55516) 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b7fe00640 1 -- 172.21.15.18:0/3635293648 learned_addr learned my addr 172.21.15.18:0/3635293648 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b85200640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b80101920 0x7f6b8019f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b77400640 1 -- 172.21.15.18:0/3635293648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b80101920 msgr2=0x7f6b8019f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b77400640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b80101920 0x7f6b8019f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b77400640 1 -- 172.21.15.18:0/3635293648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b800ffd70 msgr2=0x7f6b80197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b77400640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b800ffd70 0x7f6b80197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b77400640 1 -- 172.21.15.18:0/3635293648 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70009560 con 0x7f6b80100f60 2024-09-13T16:52:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b7fe00640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b800ffd70 0x7f6b80197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.128+0000 7f6b77400640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b80100f60 0x7f6b801984d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800e9f0 tx=0x7f6b6800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.129+0000 7f6b7d600640 1 -- 172.21.15.18:0/3635293648 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800ccc0 con 0x7f6b80100f60 2024-09-13T16:52:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.129+0000 7f6b87200640 1 -- 172.21.15.18:0/3635293648 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b801a0090 con 0x7f6b80100f60 2024-09-13T16:52:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.129+0000 7f6b7d600640 1 -- 172.21.15.18:0/3635293648 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b6800ce20 con 0x7f6b80100f60 2024-09-13T16:52:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.129+0000 7f6b7d600640 1 -- 172.21.15.18:0/3635293648 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68004a00 con 0x7f6b80100f60 2024-09-13T16:52:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.129+0000 7f6b87200640 1 -- 172.21.15.18:0/3635293648 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b801a05a0 con 0x7f6b80100f60 2024-09-13T16:52:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.130+0000 7f6b87200640 1 -- 172.21.15.18:0/3635293648 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8010b630 con 0x7f6b80100f60 2024-09-13T16:52:03.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.132+0000 7f6b7d600640 1 -- 172.21.15.18:0/3635293648 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6b68005020 con 0x7f6b80100f60 2024-09-13T16:52:03.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.133+0000 7f6b7d600640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6b640a1110 0x7f6b640a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.133+0000 7f6b7d600640 1 -- 172.21.15.18:0/3635293648 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f6b68014070 con 0x7f6b80100f60 2024-09-13T16:52:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.133+0000 7f6b7fe00640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6b640a1110 0x7f6b640a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.134+0000 7f6b7fe00640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6b640a1110 0x7f6b640a35d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6b70004650 tx=0x7f6b700314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:03.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.135+0000 7f6b7d600640 1 -- 172.21.15.18:0/3635293648 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6b680960a0 con 0x7f6b80100f60 2024-09-13T16:52:03.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.313+0000 7f6b87200640 1 -- 172.21.15.18:0/3635293648 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b801a0820 con 0x7f6b80100f60 2024-09-13T16:52:03.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.313+0000 7f6b7d600640 1 -- 172.21.15.18:0/3635293648 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b680996c0 con 0x7f6b80100f60 2024-09-13T16:52:03.315 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T16:52:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.315+0000 7f6b87200640 1 -- 172.21.15.18:0/3635293648 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6b640a1110 msgr2=0x7f6b640a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.315+0000 7f6b87200640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6b640a1110 0x7f6b640a35d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6b70004650 tx=0x7f6b700314a0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.315+0000 7f6b87200640 1 -- 172.21.15.18:0/3635293648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b80100f60 msgr2=0x7f6b801984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.315+0000 7f6b87200640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b80100f60 0x7f6b801984d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800e9f0 tx=0x7f6b6800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.316+0000 7f6b87200640 1 -- 172.21.15.18:0/3635293648 shutdown_connections 2024-09-13T16:52:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.316+0000 7f6b87200640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b80101920 0x7f6b8019f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.316+0000 7f6b87200640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b80100f60 0x7f6b801984d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.316+0000 7f6b87200640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6b640a1110 0x7f6b640a35d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.316+0000 7f6b87200640 1 --2- 172.21.15.18:0/3635293648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b800ffd70 0x7f6b80197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.316+0000 7f6b87200640 1 -- 172.21.15.18:0/3635293648 >> 172.21.15.18:0/3635293648 conn(0x7f6b800fb4d0 msgr2=0x7f6b80106780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:03.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.316+0000 7f6b87200640 1 -- 172.21.15.18:0/3635293648 shutdown_connections 2024-09-13T16:52:03.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.316+0000 7f6b87200640 1 -- 172.21.15.18:0/3635293648 wait complete. 2024-09-13T16:52:03.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:52:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.494+0000 7fb9d6000640 1 -- 172.21.15.18:0/3914920440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d0101fa0 msgr2=0x7fb9d01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.494+0000 7fb9d6000640 1 --2- 172.21.15.18:0/3914920440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d0101fa0 0x7fb9d01023a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009900 tx=0x7fb9c002a410 comp rx=0 tx=0).stop 2024-09-13T16:52:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.495+0000 7fb9d6000640 1 -- 172.21.15.18:0/3914920440 shutdown_connections 2024-09-13T16:52:03.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.495+0000 7fb9d6000640 1 --2- 172.21.15.18:0/3914920440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d0103190 0x7fb9d0103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.495+0000 7fb9d6000640 1 --2- 172.21.15.18:0/3914920440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9d0103b50 0x7fb9d010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.495+0000 7fb9d6000640 1 --2- 172.21.15.18:0/3914920440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d0101fa0 0x7fb9d01023a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.495+0000 7fb9d6000640 1 -- 172.21.15.18:0/3914920440 >> 172.21.15.18:0/3914920440 conn(0x7fb9d00fd700 msgr2=0x7fb9d00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:03.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.495+0000 7fb9d6000640 1 -- 172.21.15.18:0/3914920440 shutdown_connections 2024-09-13T16:52:03.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.495+0000 7fb9d6000640 1 -- 172.21.15.18:0/3914920440 wait complete. 2024-09-13T16:52:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9d6000640 1 Processor -- start 2024-09-13T16:52:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9d6000640 1 -- start start 2024-09-13T16:52:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9d6000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9d0101fa0 0x7fb9d0197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9d6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d0103190 0x7fb9d0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9d6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d0103b50 0x7fb9d019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9d6000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d019fad0 con 0x7fb9d0103b50 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9d6000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d019fc40 con 0x7fb9d0101fa0 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9d6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d019fe00 con 0x7fb9d0103190 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9cfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d0103b50 0x7fb9d019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9cf400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9d0101fa0 0x7fb9d0197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9cf400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9d0101fa0 0x7fb9d0197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:57728/0 (socket says 172.21.15.18:57728) 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9cf400640 1 -- 172.21.15.18:0/2506769017 learned_addr learned my addr 172.21.15.18:0/2506769017 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.496+0000 7fb9cea00640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d0103190 0x7fb9d0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.497+0000 7fb9cf400640 1 -- 172.21.15.18:0/2506769017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d0103190 msgr2=0x7fb9d0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.497+0000 7fb9cf400640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d0103190 0x7fb9d0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.497+0000 7fb9cf400640 1 -- 172.21.15.18:0/2506769017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d0103b50 msgr2=0x7fb9d019f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.497+0000 7fb9cf400640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d0103b50 0x7fb9d019f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.497+0000 7fb9cf400640 1 -- 172.21.15.18:0/2506769017 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0009560 con 0x7fb9d0101fa0 2024-09-13T16:52:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.497+0000 7fb9cfe00640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d0103b50 0x7fb9d019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.497+0000 7fb9cf400640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9d0101fa0 0x7fb9d0197fe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0031500 tx=0x7fb9c0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.497+0000 7fb9c7e00640 1 -- 172.21.15.18:0/2506769017 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0003e00 con 0x7fb9d0101fa0 2024-09-13T16:52:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.497+0000 7fb9c7e00640 1 -- 172.21.15.18:0/2506769017 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9c0031c70 con 0x7fb9d0101fa0 2024-09-13T16:52:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.497+0000 7fb9d6000640 1 -- 172.21.15.18:0/2506769017 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d01a0080 con 0x7fb9d0101fa0 2024-09-13T16:52:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.498+0000 7fb9c7e00640 1 -- 172.21.15.18:0/2506769017 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c003bc50 con 0x7fb9d0101fa0 2024-09-13T16:52:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.498+0000 7fb9d6000640 1 -- 172.21.15.18:0/2506769017 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d01a0580 con 0x7fb9d0101fa0 2024-09-13T16:52:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.499+0000 7fb9d6000640 1 -- 172.21.15.18:0/2506769017 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d0109420 con 0x7fb9d0101fa0 2024-09-13T16:52:03.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.501+0000 7fb9c7e00640 1 -- 172.21.15.18:0/2506769017 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb9c00317b0 con 0x7fb9d0101fa0 2024-09-13T16:52:03.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.502+0000 7fb9c7e00640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb9b40a1110 0x7fb9b40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.502+0000 7fb9c7e00640 1 -- 172.21.15.18:0/2506769017 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fb9c00ed580 con 0x7fb9d0101fa0 2024-09-13T16:52:03.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.502+0000 7fb9cea00640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb9b40a1110 0x7fb9b40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.503+0000 7fb9cea00640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb9b40a1110 0x7fb9b40a35d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb9d01994f0 tx=0x7fb9bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:03.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.504+0000 7fb9c7e00640 1 -- 172.21.15.18:0/2506769017 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb9c00b6b20 con 0x7fb9d0101fa0 2024-09-13T16:52:03.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.690+0000 7fb9d6000640 1 -- 172.21.15.18:0/2506769017 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9d002c3e0 con 0x7fb9d0101fa0 2024-09-13T16:52:03.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.690+0000 7fb9c7e00640 1 -- 172.21.15.18:0/2506769017 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9c0035020 con 0x7fb9d0101fa0 2024-09-13T16:52:03.692 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:52:03.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 -- 172.21.15.18:0/2506769017 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb9b40a1110 msgr2=0x7fb9b40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb9b40a1110 0x7fb9b40a35d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb9d01994f0 tx=0x7fb9bc005f90 comp rx=0 tx=0).stop 2024-09-13T16:52:03.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 -- 172.21.15.18:0/2506769017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9d0101fa0 msgr2=0x7fb9d0197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9d0101fa0 0x7fb9d0197fe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0031500 tx=0x7fb9c0003c10 comp rx=0 tx=0).stop 2024-09-13T16:52:03.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 -- 172.21.15.18:0/2506769017 shutdown_connections 2024-09-13T16:52:03.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb9b40a1110 0x7fb9b40a35d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d0103b50 0x7fb9d019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d0103190 0x7fb9d0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 --2- 172.21.15.18:0/2506769017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9d0101fa0 0x7fb9d0197fe0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 -- 172.21.15.18:0/2506769017 >> 172.21.15.18:0/2506769017 conn(0x7fb9d00fd700 msgr2=0x7fb9d01065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:03.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 -- 172.21.15.18:0/2506769017 shutdown_connections 2024-09-13T16:52:03.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.693+0000 7fb9d6000640 1 -- 172.21.15.18:0/2506769017 wait complete. 2024-09-13T16:52:03.713 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:52:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.872+0000 7fd914400640 1 -- 172.21.15.18:0/4085551259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd90c1007f0 msgr2=0x7fd90c102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.872+0000 7fd914400640 1 --2- 172.21.15.18:0/4085551259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd90c1007f0 0x7fd90c102be0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd900009900 tx=0x7fd90002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.872+0000 7fd914400640 1 -- 172.21.15.18:0/4085551259 shutdown_connections 2024-09-13T16:52:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.872+0000 7fd914400640 1 --2- 172.21.15.18:0/4085551259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd90c105a50 0x7fd90c107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.872+0000 7fd914400640 1 --2- 172.21.15.18:0/4085551259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90c103120 0x7fd90c105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.872+0000 7fd914400640 1 --2- 172.21.15.18:0/4085551259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd90c1007f0 0x7fd90c102be0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.872+0000 7fd914400640 1 -- 172.21.15.18:0/4085551259 >> 172.21.15.18:0/4085551259 conn(0x7fd90c0fa3d0 msgr2=0x7fd90c0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.872+0000 7fd914400640 1 -- 172.21.15.18:0/4085551259 shutdown_connections 2024-09-13T16:52:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.872+0000 7fd914400640 1 -- 172.21.15.18:0/4085551259 wait complete. 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.873+0000 7fd914400640 1 Processor -- start 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.873+0000 7fd914400640 1 -- start start 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.873+0000 7fd914400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd90c1007f0 0x7fd90c195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.873+0000 7fd914400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd90c103120 0x7fd90c196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.873+0000 7fd914400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90c105a50 0x7fd90c19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd914400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c19d8e0 con 0x7fd90c103120 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd914400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c19da50 con 0x7fd90c1007f0 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd914400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c19dc10 con 0x7fd90c105a50 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd90c103120 0x7fd90c196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd90c103120 0x7fd90c196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55572/0 (socket says 172.21.15.18:55572) 2024-09-13T16:52:03.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911000640 1 -- 172.21.15.18:0/2339383013 learned_addr learned my addr 172.21.15.18:0/2339383013 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911a00640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd90c1007f0 0x7fd90c195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd912400640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90c105a50 0x7fd90c19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911000640 1 -- 172.21.15.18:0/2339383013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90c105a50 msgr2=0x7fd90c19d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911000640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90c105a50 0x7fd90c19d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911000640 1 -- 172.21.15.18:0/2339383013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd90c1007f0 msgr2=0x7fd90c195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911000640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd90c1007f0 0x7fd90c195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911000640 1 -- 172.21.15.18:0/2339383013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8009490 con 0x7fd90c103120 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911a00640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd90c1007f0 0x7fd90c195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.874+0000 7fd911000640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd90c103120 0x7fd90c196330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e9a0 tx=0x7fd8f800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.875+0000 7fd90a000640 1 -- 172.21.15.18:0/2339383013 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800cd80 con 0x7fd90c103120 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.875+0000 7fd90a000640 1 -- 172.21.15.18:0/2339383013 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8f80035f0 con 0x7fd90c103120 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.875+0000 7fd914400640 1 -- 172.21.15.18:0/2339383013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd904009840 con 0x7fd90c103120 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.875+0000 7fd90a000640 1 -- 172.21.15.18:0/2339383013 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80044e0 con 0x7fd90c103120 2024-09-13T16:52:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.875+0000 7fd914400640 1 -- 172.21.15.18:0/2339383013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd900009560 con 0x7fd90c103120 2024-09-13T16:52:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.876+0000 7fd914400640 1 -- 172.21.15.18:0/2339383013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90c0fbec0 con 0x7fd90c103120 2024-09-13T16:52:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.879+0000 7fd90a000640 1 -- 172.21.15.18:0/2339383013 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd8f8003760 con 0x7fd90c103120 2024-09-13T16:52:03.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.880+0000 7fd90a000640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd8f40a1090 0x7fd8f40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:03.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.880+0000 7fd90a000640 1 -- 172.21.15.18:0/2339383013 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fd8f8014070 con 0x7fd90c103120 2024-09-13T16:52:03.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.880+0000 7fd911a00640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd8f40a1090 0x7fd8f40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:03.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.881+0000 7fd911a00640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd8f40a1090 0x7fd8f40a3550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd900000c00 tx=0x7fd900005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:03.883+0000 7fd90a000640 1 -- 172.21.15.18:0/2339383013 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd8f80966d0 con 0x7fd90c103120 2024-09-13T16:52:03.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:03 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2260873344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:52:03.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:03 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3635293648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:52:03.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:03 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2260873344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:52:03.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:03 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3635293648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:52:04.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:03 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2260873344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:52:04.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:03 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3635293648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:52:04.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.065+0000 7fd914400640 1 -- 172.21.15.18:0/2339383013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd90c02c3e0 con 0x7fd90c103120 2024-09-13T16:52:04.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.065+0000 7fd90a000640 1 -- 172.21.15.18:0/2339383013 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8f8099cf0 con 0x7fd90c103120 2024-09-13T16:52:04.067 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-13T16:52:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 -- 172.21.15.18:0/2339383013 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd8f40a1090 msgr2=0x7fd8f40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd8f40a1090 0x7fd8f40a3550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd900000c00 tx=0x7fd900005760 comp rx=0 tx=0).stop 2024-09-13T16:52:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 -- 172.21.15.18:0/2339383013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd90c103120 msgr2=0x7fd90c196330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd90c103120 0x7fd90c196330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e9a0 tx=0x7fd8f800eda0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 -- 172.21.15.18:0/2339383013 shutdown_connections 2024-09-13T16:52:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd8f40a1090 0x7fd8f40a3550 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd90c103120 0x7fd90c196330 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90c105a50 0x7fd90c19d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 --2- 172.21.15.18:0/2339383013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd90c1007f0 0x7fd90c195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 -- 172.21.15.18:0/2339383013 >> 172.21.15.18:0/2339383013 conn(0x7fd90c0fa3d0 msgr2=0x7fd90c101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 -- 172.21.15.18:0/2339383013 shutdown_connections 2024-09-13T16:52:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.068+0000 7fd914400640 1 -- 172.21.15.18:0/2339383013 wait complete. 2024-09-13T16:52:04.085 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:52:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.246+0000 7f7e79a00640 1 -- 172.21.15.18:0/3607342869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e74100ee0 msgr2=0x7f7e74101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.246+0000 7f7e79a00640 1 --2- 172.21.15.18:0/3607342869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e74100ee0 0x7f7e74101360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009860 tx=0x7f7e6002a340 comp rx=0 tx=0).stop 2024-09-13T16:52:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.246+0000 7f7e79a00640 1 -- 172.21.15.18:0/3607342869 shutdown_connections 2024-09-13T16:52:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.246+0000 7f7e79a00640 1 --2- 172.21.15.18:0/3607342869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e741018a0 0x7f7e74108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.246+0000 7f7e79a00640 1 --2- 172.21.15.18:0/3607342869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e74100ee0 0x7f7e74101360 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.246+0000 7f7e79a00640 1 --2- 172.21.15.18:0/3607342869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e740ffcf0 0x7f7e741000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.246+0000 7f7e79a00640 1 -- 172.21.15.18:0/3607342869 >> 172.21.15.18:0/3607342869 conn(0x7f7e740fb450 msgr2=0x7f7e740fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.246+0000 7f7e79a00640 1 -- 172.21.15.18:0/3607342869 shutdown_connections 2024-09-13T16:52:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.246+0000 7f7e79a00640 1 -- 172.21.15.18:0/3607342869 wait complete. 2024-09-13T16:52:04.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.247+0000 7f7e79a00640 1 Processor -- start 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.247+0000 7f7e79a00640 1 -- start start 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e79a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e740ffcf0 0x7f7e74074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e79a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e74100ee0 0x7f7e740728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e79a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e741018a0 0x7f7e74072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e79a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e74073540 con 0x7f7e740ffcf0 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e79a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740736b0 con 0x7f7e74100ee0 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e79a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7419fd60 con 0x7f7e741018a0 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e740ffcf0 0x7f7e74074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e740ffcf0 0x7f7e74074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55596/0 (socket says 172.21.15.18:55596) 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e73e00640 1 -- 172.21.15.18:0/1142213432 learned_addr learned my addr 172.21.15.18:0/1142213432 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e73400640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e74100ee0 0x7f7e740728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:04.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e73e00640 1 -- 172.21.15.18:0/1142213432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e741018a0 msgr2=0x7f7e74072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e79000640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e741018a0 0x7f7e74072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e73e00640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e741018a0 0x7f7e74072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e73e00640 1 -- 172.21.15.18:0/1142213432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e74100ee0 msgr2=0x7f7e740728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e73e00640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e74100ee0 0x7f7e740728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.248+0000 7f7e73e00640 1 -- 172.21.15.18:0/1142213432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e64009560 con 0x7f7e740ffcf0 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.249+0000 7f7e73e00640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e740ffcf0 0x7f7e74074260 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400e9d0 tx=0x7f7e6400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.249+0000 7f7e70c00640 1 -- 172.21.15.18:0/1142213432 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400cde0 con 0x7f7e740ffcf0 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.249+0000 7f7e70c00640 1 -- 172.21.15.18:0/1142213432 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e640108f0 con 0x7f7e740ffcf0 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.249+0000 7f7e79a00640 1 -- 172.21.15.18:0/1142213432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e60009490 con 0x7f7e740ffcf0 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.249+0000 7f7e70c00640 1 -- 172.21.15.18:0/1142213432 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640188e0 con 0x7f7e740ffcf0 2024-09-13T16:52:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.249+0000 7f7e79a00640 1 -- 172.21.15.18:0/1142213432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e741a02a0 con 0x7f7e740ffcf0 2024-09-13T16:52:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.250+0000 7f7e79a00640 1 -- 172.21.15.18:0/1142213432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e74107220 con 0x7f7e740ffcf0 2024-09-13T16:52:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.252+0000 7f7e70c00640 1 -- 172.21.15.18:0/1142213432 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7e64010a60 con 0x7f7e740ffcf0 2024-09-13T16:52:04.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.253+0000 7f7e70c00640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7e580a1090 0x7f7e580a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:04.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.253+0000 7f7e70c00640 1 -- 172.21.15.18:0/1142213432 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f7e64014070 con 0x7f7e740ffcf0 2024-09-13T16:52:04.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.254+0000 7f7e73400640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7e580a1090 0x7f7e580a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:04.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.254+0000 7f7e73400640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7e580a1090 0x7f7e580a3550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e60030410 tx=0x7f7e60030580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:04.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.257+0000 7f7e70c00640 1 -- 172.21.15.18:0/1142213432 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7e64096670 con 0x7f7e740ffcf0 2024-09-13T16:52:04.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.437+0000 7f7e79a00640 1 -- 172.21.15.18:0/1142213432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7e7402c480 con 0x7f7e740ffcf0 2024-09-13T16:52:04.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.437+0000 7f7e70c00640 1 -- 172.21.15.18:0/1142213432 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7e64099c90 con 0x7f7e740ffcf0 2024-09-13T16:52:04.439 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T16:52:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 -- 172.21.15.18:0/1142213432 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7e580a1090 msgr2=0x7f7e580a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7e580a1090 0x7f7e580a3550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e60030410 tx=0x7f7e60030580 comp rx=0 tx=0).stop 2024-09-13T16:52:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 -- 172.21.15.18:0/1142213432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e740ffcf0 msgr2=0x7f7e74074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e740ffcf0 0x7f7e74074260 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400e9d0 tx=0x7f7e6400ee90 comp rx=0 tx=0).stop 2024-09-13T16:52:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 -- 172.21.15.18:0/1142213432 shutdown_connections 2024-09-13T16:52:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e741018a0 0x7f7e74072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e74100ee0 0x7f7e740728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f7e580a1090 0x7f7e580a3550 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 --2- 172.21.15.18:0/1142213432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e740ffcf0 0x7f7e74074260 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 -- 172.21.15.18:0/1142213432 >> 172.21.15.18:0/1142213432 conn(0x7f7e740fb450 msgr2=0x7f7e741043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:04.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 -- 172.21.15.18:0/1142213432 shutdown_connections 2024-09-13T16:52:04.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.440+0000 7f7e79a00640 1 -- 172.21.15.18:0/1142213432 wait complete. 2024-09-13T16:52:04.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:52:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.613+0000 7f097cc00640 1 -- 172.21.15.18:0/159452383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0978101f90 msgr2=0x7f0978102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.613+0000 7f097cc00640 1 --2- 172.21.15.18:0/159452383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0978101f90 0x7f0978102390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0968009860 tx=0x7f096802a340 comp rx=0 tx=0).stop 2024-09-13T16:52:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.614+0000 7f097cc00640 1 -- 172.21.15.18:0/159452383 shutdown_connections 2024-09-13T16:52:04.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.614+0000 7f097cc00640 1 --2- 172.21.15.18:0/159452383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0978103b40 0x7f097810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.614+0000 7f097cc00640 1 --2- 172.21.15.18:0/159452383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0978103180 0x7f0978103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.614+0000 7f097cc00640 1 --2- 172.21.15.18:0/159452383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0978101f90 0x7f0978102390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.614+0000 7f097cc00640 1 -- 172.21.15.18:0/159452383 >> 172.21.15.18:0/159452383 conn(0x7f09780fd730 msgr2=0x7f09780ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:04.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.614+0000 7f097cc00640 1 -- 172.21.15.18:0/159452383 shutdown_connections 2024-09-13T16:52:04.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.614+0000 7f097cc00640 1 -- 172.21.15.18:0/159452383 wait complete. 2024-09-13T16:52:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.614+0000 7f097cc00640 1 Processor -- start 2024-09-13T16:52:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f097cc00640 1 -- start start 2024-09-13T16:52:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f097cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0978101f90 0x7f0978198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f097cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0978103180 0x7f0978198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f097cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0978103b40 0x7f097819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f097cc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097819fb10 con 0x7f0978103180 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f097cc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097819fc80 con 0x7f0978103b40 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f097cc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097819fe40 con 0x7f0978101f90 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f096fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0978103180 0x7f0978198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f096fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0978103180 0x7f0978198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55614/0 (socket says 172.21.15.18:55614) 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f096fe00640 1 -- 172.21.15.18:0/3073119846 learned_addr learned my addr 172.21.15.18:0/3073119846 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f0975e00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0978101f90 0x7f0978198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.615+0000 7f0976800640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0978103b40 0x7f097819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.616+0000 7f0975e00640 1 -- 172.21.15.18:0/3073119846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0978103b40 msgr2=0x7f097819f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.616+0000 7f0975e00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0978103b40 0x7f097819f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.616+0000 7f0975e00640 1 -- 172.21.15.18:0/3073119846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0978103180 msgr2=0x7f0978198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.616+0000 7f0975e00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0978103180 0x7f0978198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.616+0000 7f0975e00640 1 -- 172.21.15.18:0/3073119846 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970009900 con 0x7f0978101f90 2024-09-13T16:52:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.616+0000 7f0975e00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0978101f90 0x7f0978198020 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f096802a860 tx=0x7f0968032d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.616+0000 7f096ea00640 1 -- 172.21.15.18:0/3073119846 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968004040 con 0x7f0978101f90 2024-09-13T16:52:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.616+0000 7f097cc00640 1 -- 172.21.15.18:0/3073119846 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0968009490 con 0x7f0978101f90 2024-09-13T16:52:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.617+0000 7f097cc00640 1 -- 172.21.15.18:0/3073119846 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09781a0400 con 0x7f0978101f90 2024-09-13T16:52:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.617+0000 7f096ea00640 1 -- 172.21.15.18:0/3073119846 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0968005050 con 0x7f0978101f90 2024-09-13T16:52:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.617+0000 7f096ea00640 1 -- 172.21.15.18:0/3073119846 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968004920 con 0x7f0978101f90 2024-09-13T16:52:04.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.617+0000 7f097cc00640 1 -- 172.21.15.18:0/3073119846 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0978102390 con 0x7f0978101f90 2024-09-13T16:52:04.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.620+0000 7f096ea00640 1 -- 172.21.15.18:0/3073119846 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f09680041a0 con 0x7f0978101f90 2024-09-13T16:52:04.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.621+0000 7f096ea00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f095c0a1110 0x7f095c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:04.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.621+0000 7f096ea00640 1 -- 172.21.15.18:0/3073119846 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f09680ed480 con 0x7f0978101f90 2024-09-13T16:52:04.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.621+0000 7f096fe00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f095c0a1110 0x7f095c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.622+0000 7f096fe00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f095c0a1110 0x7f095c0a35d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0978199530 tx=0x7f0960005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:04.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.623+0000 7f096ea00640 1 -- 172.21.15.18:0/3073119846 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f09680b6850 con 0x7f0978101f90 2024-09-13T16:52:04.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:04 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2506769017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:52:04.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:04 smithi018 ceph-mon[30981]: pgmap v379: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:52:04.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:04 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2339383013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:52:04.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:04 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1142213432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:52:04.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.841+0000 7f097cc00640 1 -- 172.21.15.18:0/3073119846 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0978109560 con 0x7f0978101f90 2024-09-13T16:52:04.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.842+0000 7f096ea00640 1 -- 172.21.15.18:0/3073119846 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10852 (secure 0 0 0) 0x7f0968040090 con 0x7f0978101f90 2024-09-13T16:52:04.843 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:52:04.844 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:49:28.080578+0000","modified":"2024-09-13T16:49:57.790808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24590,"mds_1":24566,"mds_2":24539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/506298733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":506298733},{"type":"v1","addr":"172.21.15.144:6839","nonce":506298733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24539":{"gid":24539,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:52:04.844 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 24 2024-09-13T16:52:04.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 -- 172.21.15.18:0/3073119846 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f095c0a1110 msgr2=0x7f095c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f095c0a1110 0x7f095c0a35d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0978199530 tx=0x7f0960005f90 comp rx=0 tx=0).stop 2024-09-13T16:52:04.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 -- 172.21.15.18:0/3073119846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0978101f90 msgr2=0x7f0978198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:04.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0978101f90 0x7f0978198020 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f096802a860 tx=0x7f0968032d20 comp rx=0 tx=0).stop 2024-09-13T16:52:04.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 -- 172.21.15.18:0/3073119846 shutdown_connections 2024-09-13T16:52:04.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f095c0a1110 0x7f095c0a35d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0978103180 0x7f0978198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0978103b40 0x7f097819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 --2- 172.21.15.18:0/3073119846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0978101f90 0x7f0978198020 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:04.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 -- 172.21.15.18:0/3073119846 >> 172.21.15.18:0/3073119846 conn(0x7f09780fd730 msgr2=0x7f0978106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:04.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 -- 172.21.15.18:0/3073119846 shutdown_connections 2024-09-13T16:52:04.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:04.844+0000 7f097cc00640 1 -- 172.21.15.18:0/3073119846 wait complete. 2024-09-13T16:52:04.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:52:04.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:04 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2506769017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:52:04.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:04 smithi094 ceph-mon[35259]: pgmap v379: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:52:04.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:04 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2339383013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:52:04.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:04 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1142213432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:52:05.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.018+0000 7f477f200640 1 -- 172.21.15.18:0/1185639370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780076a50 msgr2=0x7f47800772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.018+0000 7f477f200640 1 --2- 172.21.15.18:0/1185639370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780076a50 0x7f47800772f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4778009ca0 tx=0x7f477802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.018+0000 7f477f200640 1 -- 172.21.15.18:0/1185639370 shutdown_connections 2024-09-13T16:52:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.018+0000 7f477f200640 1 --2- 172.21.15.18:0/1185639370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780076a50 0x7f47800772f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.018+0000 7f477f200640 1 --2- 172.21.15.18:0/1185639370 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47800760b0 0x7f4780076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.018+0000 7f477f200640 1 --2- 172.21.15.18:0/1185639370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4780074e70 0x7f4780075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.018+0000 7f477f200640 1 -- 172.21.15.18:0/1185639370 >> 172.21.15.18:0/1185639370 conn(0x7f47800fd530 msgr2=0x7f47800ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.018+0000 7f477f200640 1 -- 172.21.15.18:0/1185639370 shutdown_connections 2024-09-13T16:52:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.018+0000 7f477f200640 1 -- 172.21.15.18:0/1185639370 wait complete. 2024-09-13T16:52:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477f200640 1 Processor -- start 2024-09-13T16:52:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477f200640 1 -- start start 2024-09-13T16:52:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780074e70 0x7f478019c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47800760b0 0x7f478019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780076a50 0x7f47801a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47801a3c80 con 0x7f4780074e70 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47801a3df0 con 0x7f4780076a50 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47801a3fb0 con 0x7f47800760b0 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780074e70 0x7f478019c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780074e70 0x7f478019c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55630/0 (socket says 172.21.15.18:55630) 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.019+0000 7f477de00640 1 -- 172.21.15.18:0/1807937240 learned_addr learned my addr 172.21.15.18:0/1807937240 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f477e800640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780076a50 0x7f47801a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f4777e00640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47800760b0 0x7f478019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f477de00640 1 -- 172.21.15.18:0/1807937240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47800760b0 msgr2=0x7f478019c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f477de00640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47800760b0 0x7f478019c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f477de00640 1 -- 172.21.15.18:0/1807937240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780076a50 msgr2=0x7f47801a3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f477de00640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780076a50 0x7f47801a3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f477de00640 1 -- 172.21.15.18:0/1807937240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4778009900 con 0x7f4780074e70 2024-09-13T16:52:05.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f477de00640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780074e70 0x7f478019c190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f477000e9f0 tx=0x7f477000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f4776a00640 1 -- 172.21.15.18:0/1807937240 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770009720 con 0x7f4780074e70 2024-09-13T16:52:05.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f4776a00640 1 -- 172.21.15.18:0/1807937240 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f477000cd80 con 0x7f4780074e70 2024-09-13T16:52:05.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f4776a00640 1 -- 172.21.15.18:0/1807937240 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770010430 con 0x7f4780074e70 2024-09-13T16:52:05.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.020+0000 7f477f200640 1 -- 172.21.15.18:0/1807937240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47801a4290 con 0x7f4780074e70 2024-09-13T16:52:05.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.021+0000 7f477f200640 1 -- 172.21.15.18:0/1807937240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47801a4750 con 0x7f4780074e70 2024-09-13T16:52:05.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:04 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2506769017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:52:05.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:04 smithi144 ceph-mon[35328]: pgmap v379: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:52:05.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:04 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2339383013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:52:05.025 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:04 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1142213432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:52:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.022+0000 7f477f200640 1 -- 172.21.15.18:0/1807937240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478010e720 con 0x7f4780074e70 2024-09-13T16:52:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.023+0000 7f4776a00640 1 -- 172.21.15.18:0/1807937240 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4770005020 con 0x7f4780074e70 2024-09-13T16:52:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.025+0000 7f4776a00640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1110 0x7f47640a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.025+0000 7f4776a00640 1 -- 172.21.15.18:0/1807937240 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f4770014070 con 0x7f4780074e70 2024-09-13T16:52:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.025+0000 7f4777e00640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1110 0x7f47640a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.026+0000 7f4777e00640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1110 0x7f47640a35d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f478019d6a0 tx=0x7f4768005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.029+0000 7f4776a00640 1 -- 172.21.15.18:0/1807937240 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4770096380 con 0x7f4780074e70 2024-09-13T16:52:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.215+0000 7f477f200640 1 -- 172.21.15.18:0/1807937240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4780111aa0 con 0x7f4780074e70 2024-09-13T16:52:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.217+0000 7f4776a00640 1 -- 172.21.15.18:0/1807937240 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24592 (secure 0 0 0) 0x7f47700999a0 con 0x7f4780074e70 2024-09-13T16:52:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T16:52:05.219 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":93,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:51:14.023061+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:52:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 -- 172.21.15.18:0/1807937240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1110 msgr2=0x7f47640a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1110 0x7f47640a35d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f478019d6a0 tx=0x7f4768005f90 comp rx=0 tx=0).stop 2024-09-13T16:52:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 -- 172.21.15.18:0/1807937240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780074e70 msgr2=0x7f478019c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780074e70 0x7f478019c190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f477000e9f0 tx=0x7f477000edf0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 -- 172.21.15.18:0/1807937240 shutdown_connections 2024-09-13T16:52:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780076a50 0x7f47801a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47800760b0 0x7f478019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1110 0x7f47640a35d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 --2- 172.21.15.18:0/1807937240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780074e70 0x7f478019c190 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 -- 172.21.15.18:0/1807937240 >> 172.21.15.18:0/1807937240 conn(0x7f47800fd530 msgr2=0x7f47800feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 -- 172.21.15.18:0/1807937240 shutdown_connections 2024-09-13T16:52:05.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.220+0000 7f477f200640 1 -- 172.21.15.18:0/1807937240 wait complete. 2024-09-13T16:52:05.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T16:49:28.080578+0000', 'modified': '2024-09-13T16:49:57.790808+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24590, 'mds_1': 24566, 'mds_2': 24539}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24508': {'gid': 24508, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6835/81449437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 81449437}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 81449437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24520': {'gid': 24520, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6837/443543812', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 443543812}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 443543812}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24538': {'gid': 24538, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6839/506298733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 506298733}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 506298733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.94:6837/2839586927', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6836', 'nonce': 2839586927}, {'type': 'v1', 'addr': '172.21.15.94:6837', 'nonce': 2839586927}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24566': {'gid': 24566, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.18:6839/152668011', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6838', 'nonce': 152668011}, {'type': 'v1', 'addr': '172.21.15.18:6839', 'nonce': 152668011}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24590': {'gid': 24590, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.94:6839/1508206800', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6838', 'nonce': 1508206800}, {'type': 'v1', 'addr': '172.21.15.94:6839', 'nonce': 1508206800}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T16:52:05.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T16:52:05.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-09-13T16:52:05.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.397+0000 7fa1cf200640 1 -- 172.21.15.18:0/3535463388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d0102f70 msgr2=0x7fa1d01033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.397+0000 7fa1cf200640 1 --2- 172.21.15.18:0/3535463388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d0102f70 0x7fa1d01033f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009900 tx=0x7fa1b802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.397+0000 7fa1cf200640 1 -- 172.21.15.18:0/3535463388 shutdown_connections 2024-09-13T16:52:05.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.397+0000 7fa1cf200640 1 --2- 172.21.15.18:0/3535463388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d0102f70 0x7fa1d01033f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.397+0000 7fa1cf200640 1 --2- 172.21.15.18:0/3535463388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1d0103930 0x7fa1d010a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.397+0000 7fa1cf200640 1 --2- 172.21.15.18:0/3535463388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d0101d80 0x7fa1d0102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.397+0000 7fa1cf200640 1 -- 172.21.15.18:0/3535463388 >> 172.21.15.18:0/3535463388 conn(0x7fa1d00fd500 msgr2=0x7fa1d00ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.397+0000 7fa1cf200640 1 -- 172.21.15.18:0/3535463388 shutdown_connections 2024-09-13T16:52:05.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.397+0000 7fa1cf200640 1 -- 172.21.15.18:0/3535463388 wait complete. 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.398+0000 7fa1cf200640 1 Processor -- start 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.398+0000 7fa1cf200640 1 -- start start 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.398+0000 7fa1cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1d0101d80 0x7fa1d0197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.398+0000 7fa1cf200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d0102f70 0x7fa1d0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.398+0000 7fa1cf200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d0103930 0x7fa1d019f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.398+0000 7fa1cf200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d019f8a0 con 0x7fa1d0103930 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.398+0000 7fa1cf200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d019fa10 con 0x7fa1d0102f70 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.398+0000 7fa1cf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d019fbd0 con 0x7fa1d0101d80 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1ce800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d0103930 0x7fa1d019f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1cde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1d0101d80 0x7fa1d0197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d0102f70 0x7fa1d0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1cde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1d0101d80 0x7fa1d0197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:58664/0 (socket says 172.21.15.18:58664) 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1cde00640 1 -- 172.21.15.18:0/186455763 learned_addr learned my addr 172.21.15.18:0/186455763 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d0102f70 0x7fa1d0198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:57802/0 (socket says 172.21.15.18:57802) 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1cde00640 1 -- 172.21.15.18:0/186455763 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d0102f70 msgr2=0x7fa1d0198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1cde00640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d0102f70 0x7fa1d0198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1cde00640 1 -- 172.21.15.18:0/186455763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d0103930 msgr2=0x7fa1d019f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1cde00640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d0103930 0x7fa1d019f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1cde00640 1 -- 172.21.15.18:0/186455763 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c0009490 con 0x7fa1d0101d80 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1cde00640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1d0101d80 0x7fa1d0197dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000e9c0 tx=0x7fa1c000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.399+0000 7fa1c7400640 1 -- 172.21.15.18:0/186455763 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000cde0 con 0x7fa1d0101d80 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.400+0000 7fa1cf200640 1 -- 172.21.15.18:0/186455763 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b8009560 con 0x7fa1d0101d80 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.400+0000 7fa1c7400640 1 -- 172.21.15.18:0/186455763 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1c00108f0 con 0x7fa1d0101d80 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.400+0000 7fa1c7400640 1 -- 172.21.15.18:0/186455763 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c00188c0 con 0x7fa1d0101d80 2024-09-13T16:52:05.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.400+0000 7fa1cf200640 1 -- 172.21.15.18:0/186455763 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d01a01d0 con 0x7fa1d0101d80 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.402+0000 7fa1d79be740 1 Processor -- start 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.402+0000 7fa1d79be740 1 -- start start 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1c7400640 1 -- 172.21.15.18:0/186455763 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa1c0010a60 con 0x7fa1d0101d80 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237e10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e8237e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1d79be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e82374aab0 con 0x55e8237e15e0 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1d79be740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e823748240 con 0x55e8237e6670 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1d79be740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e823743b30 con 0x55e8237e0ca0 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1cde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237e10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237e10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:58670/0 (socket says 172.21.15.18:58670) 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1ce800640 1 -- 172.21.15.18:0/1410356407 learned_addr learned my addr 172.21.15.18:0/1410356407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1cde00640 1 --2- 172.21.15.18:0/1410356407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55662/0 (socket says 172.21.15.18:55662) 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1c5400640 1 --2- 172.21.15.18:0/1410356407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e8237e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1ce800640 1 -- 172.21.15.18:0/1410356407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 msgr2=0x55e8237e8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1ce800640 1 --2- 172.21.15.18:0/1410356407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e8237e8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1ce800640 1 -- 172.21.15.18:0/1410356407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 msgr2=0x55e8237e60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1ce800640 1 --2- 172.21.15.18:0/1410356407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1ce800640 1 -- 172.21.15.18:0/1410356407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e82370ebd0 con 0x55e8237e0ca0 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.403+0000 7fa1cde00640 1 --2- 172.21.15.18:0/1410356407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:05.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.404+0000 7fa1ce800640 1 --2- 172.21.15.18:0/1410356407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237e10a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009fd0 tx=0x7fa1c80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b6bffded12781a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.404+0000 7fa1bf400640 1 -- 172.21.15.18:0/1410356407 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8004d20 con 0x55e8237e0ca0 2024-09-13T16:52:05.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.404+0000 7fa1bf400640 1 -- 172.21.15.18:0/1410356407 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1c8004e80 con 0x55e8237e0ca0 2024-09-13T16:52:05.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.404+0000 7fa1bf400640 1 -- 172.21.15.18:0/1410356407 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8005280 con 0x55e8237e0ca0 2024-09-13T16:52:05.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.404+0000 7fa1c7400640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1b40a1090 0x7fa1b40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1d79be740 1 -- 172.21.15.18:0/1410356407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 msgr2=0x55e8237e10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1d79be740 1 --2- 172.21.15.18:0/1410356407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237e10a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009fd0 tx=0x7fa1c80118d0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1d79be740 1 -- 172.21.15.18:0/1410356407 shutdown_connections 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1d79be740 1 --2- 172.21.15.18:0/1410356407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1d79be740 1 --2- 172.21.15.18:0/1410356407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e8237e8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1d79be740 1 --2- 172.21.15.18:0/1410356407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237e10a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1d79be740 1 -- 172.21.15.18:0/1410356407 >> 172.21.15.18:0/1410356407 conn(0x55e8237dc310 msgr2=0x55e8237dc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1c7400640 1 -- 172.21.15.18:0/186455763 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa1c0014070 con 0x7fa1d0101d80 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1cde00640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1b40a1090 0x7fa1b40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1d79be740 1 -- 172.21.15.18:0/1410356407 shutdown_connections 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1d79be740 1 -- 172.21.15.18:0/1410356407 wait complete. 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.405+0000 7fa1d79be740 1 -- start start 2024-09-13T16:52:05.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1cde00640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1b40a1090 0x7fa1b40a3550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00967d0 tx=0x7fa1c00d0b10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1d79be740 1 Processor -- start 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e0ca0 0x55e8237ea890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e6670 0x55e8237f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1d79be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8236e5260 con 0x55e8237e15e0 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1d79be740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8236e4f00 con 0x55e8237e0ca0 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1d79be740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8234aaf20 con 0x55e8237e6670 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1d79be740 10 client.0 _ll_register_callbacks cb 0x55e82373d1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e6670 0x55e8237f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e6670 0x55e8237f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:58676/0 (socket says 172.21.15.18:58676) 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237eadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55668/0 (socket says 172.21.15.18:55668) 2024-09-13T16:52:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.406+0000 7fa1ce800640 1 -- 172.21.15.18:0/1166164811 learned_addr learned my addr 172.21.15.18:0/1166164811 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1ce800640 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e0ca0 0x55e8237ea890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1c5400640 1 -- 172.21.15.18:0/1166164811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e6670 msgr2=0x55e8237f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1c5400640 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e6670 0x55e8237f1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1c5400640 1 -- 172.21.15.18:0/1166164811 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e0ca0 msgr2=0x55e8237ea890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1c5400640 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e0ca0 0x55e8237ea890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1c5400640 1 -- 172.21.15.18:0/1166164811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c8009c80 con 0x55e8237e15e0 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1c5400640 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237eadd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa1b802a910 tx=0x7fa1b80043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7a9439414b63a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1b3e00640 1 -- 172.21.15.18:0/1166164811 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8003a00 con 0x55e8237e15e0 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1b3e00640 1 -- 172.21.15.18:0/1166164811 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa1b8003b60 con 0x55e8237e15e0 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.407+0000 7fa1d79be740 1 -- 172.21.15.18:0/1166164811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8234373c0 con 0x55e8237e15e0 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1b3e00640 1 -- 172.21.15.18:0/1166164811 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1b8003d20 con 0x55e8237e15e0 2024-09-13T16:52:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1d79be740 10 client.15297 fetch_fsmap learned FSMap version 24 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1d79be740 1 -- 172.21.15.18:0/1166164811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e8237421b0 con 0x55e8237e15e0 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1b3e00640 1 -- 172.21.15.18:0/1166164811 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e8234373c0 con 0x55e8237e15e0 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1b3e00640 1 -- 172.21.15.18:0/1166164811 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa1b8045550 con 0x55e8237e15e0 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1d79be740 10 client.15297 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1d79be740 10 client.15297 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1d79be740 20 client.15297 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1d79be740 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x55e8237f6cb0 0x55e8237fae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1d79be740 4 client.15297 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.408+0000 7fa1d79be740 1 -- 172.21.15.18:0/1166164811 --> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8234486c0 con 0x55e8237f6cb0 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.409+0000 7fa1ce800640 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x55e8237f6cb0 0x55e8237fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.409+0000 7fa1ce800640 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x55e8237f6cb0 0x55e8237fae30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba5427dc6cbc278e server_cookie=9ed418f7f2188e26 in_seq=0 out_seq=0 2024-09-13T16:52:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.409+0000 7fa1b3e00640 10 client.15297 ms_handle_connect on v2:172.21.15.94:6836/2839586927 2024-09-13T16:52:05.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1b3e00640 1 -- 172.21.15.18:0/1166164811 <== mds.2 v2:172.21.15.94:6836/2839586927 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e8234486c0 con 0x55e8237f6cb0 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1b3e00640 10 client.15297 handle_command_reply: tid=0 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 client.15297 shutdown 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 -- 172.21.15.18:0/1166164811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 msgr2=0x55e8237eadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237eadd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa1b802a910 tx=0x7fa1b80043d0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 -- 172.21.15.18:0/1166164811 shutdown_connections 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237eadd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x55e8237f6cb0 0x55e8237fae30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e6670 0x55e8237f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 --2- 172.21.15.18:0/1166164811 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e0ca0 0x55e8237ea890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1b3e00640 0 client.15297 ms_handle_reset on v2:172.21.15.94:6836/2839586927 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 -- 172.21.15.18:0/1166164811 >> 172.21.15.18:0/1166164811 conn(0x55e8237dc310 msgr2=0x55e8237db650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 -- 172.21.15.18:0/1166164811 shutdown_connections 2024-09-13T16:52:05.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.410+0000 7fa1d79be740 1 -- 172.21.15.18:0/1166164811 wait complete. 2024-09-13T16:52:05.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.411+0000 7fa1d79be740 20 client.15297 trim_cache size 0 max 16384 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.426+0000 7fa1d79be740 1 Processor -- start 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.426+0000 7fa1d79be740 1 -- start start 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.426+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.426+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.426+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e8237f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.426+0000 7fa1d79be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8237d0d80 con 0x55e8237e15e0 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.426+0000 7fa1d79be740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8234486c0 con 0x55e8237e6670 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.426+0000 7fa1d79be740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8234373c0 con 0x55e8237e0ca0 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.426+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55680/0 (socket says 172.21.15.18:55680) 2024-09-13T16:52:05.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1c5400640 1 -- 172.21.15.18:0/2608189963 learned_addr learned my addr 172.21.15.18:0/2608189963 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1ce800640 1 --2- 172.21.15.18:0/2608189963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1ce800640 1 --2- 172.21.15.18:0/2608189963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e8237f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1c5400640 1 -- 172.21.15.18:0/2608189963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 msgr2=0x55e8237e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1c5400640 1 --2- 172.21.15.18:0/2608189963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1c5400640 1 -- 172.21.15.18:0/2608189963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 msgr2=0x55e8237f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1c5400640 1 --2- 172.21.15.18:0/2608189963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e8237f1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1c5400640 1 -- 172.21.15.18:0/2608189963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8236e4470 con 0x55e8237e15e0 2024-09-13T16:52:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1c5400640 1 --2- 172.21.15.18:0/2608189963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e5fb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8031500 tx=0x7fa1b802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5828f851f2eb1ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1bfe00640 1 -- 172.21.15.18:0/2608189963 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8004440 con 0x55e8237e15e0 2024-09-13T16:52:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1bfe00640 1 -- 172.21.15.18:0/2608189963 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1b8045b80 con 0x55e8237e15e0 2024-09-13T16:52:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.427+0000 7fa1bfe00640 1 -- 172.21.15.18:0/2608189963 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b803bea0 con 0x55e8237e15e0 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.428+0000 7fa1d79be740 1 -- 172.21.15.18:0/2608189963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 msgr2=0x55e8237e5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.428+0000 7fa1d79be740 1 --2- 172.21.15.18:0/2608189963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e5fb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8031500 tx=0x7fa1b802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.428+0000 7fa1d79be740 1 -- 172.21.15.18:0/2608189963 shutdown_connections 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.428+0000 7fa1d79be740 1 --2- 172.21.15.18:0/2608189963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237e5fb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.428+0000 7fa1d79be740 1 --2- 172.21.15.18:0/2608189963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e8237f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.428+0000 7fa1d79be740 1 --2- 172.21.15.18:0/2608189963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.428+0000 7fa1d79be740 1 -- 172.21.15.18:0/2608189963 >> 172.21.15.18:0/2608189963 conn(0x55e8237dc310 msgr2=0x55e8237e89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.428+0000 7fa1d79be740 1 -- 172.21.15.18:0/2608189963 shutdown_connections 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.428+0000 7fa1d79be740 1 -- 172.21.15.18:0/2608189963 wait complete. 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.428+0000 7fa1d79be740 1 -- start start 2024-09-13T16:52:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1d79be740 1 Processor -- start 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237ed000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1d79be740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e82384caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1d79be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8237f2030 con 0x55e8237e15e0 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1d79be740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8237f21a0 con 0x55e8237e6670 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1d79be740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e82384d030 con 0x55e8237e0ca0 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1d79be740 10 client.0 _ll_register_callbacks cb 0x7fa1c80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237ed000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55682/0 (socket says 172.21.15.18:55682) 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1c5400640 1 -- 172.21.15.18:0/2508525860 learned_addr learned my addr 172.21.15.18:0/2508525860 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1ce800640 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.429+0000 7fa1ce800640 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e82384caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1c5400640 1 -- 172.21.15.18:0/2508525860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 msgr2=0x55e8237ecac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1c5400640 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237ecac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1c5400640 1 -- 172.21.15.18:0/2508525860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 msgr2=0x55e82384caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1c5400640 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e82384caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1c5400640 1 -- 172.21.15.18:0/2508525860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8237421b0 con 0x55e8237e15e0 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1ce800640 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237ecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1c5400640 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237ed000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005cd0 tx=0x7fa1b80454a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bf388b0136dacf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1b3e00640 1 -- 172.21.15.18:0/2508525860 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8003c10 con 0x55e8237e15e0 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1b3e00640 1 -- 172.21.15.18:0/2508525860 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa1b8000e40 con 0x55e8237e15e0 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1d79be740 1 -- 172.21.15.18:0/2508525860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e82376dcd0 con 0x55e8237e15e0 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1b3e00640 1 -- 172.21.15.18:0/2508525860 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1b80456d0 con 0x55e8237e15e0 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1d79be740 10 client.15303 fetch_fsmap learned FSMap version 24 2024-09-13T16:52:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.430+0000 7fa1d79be740 1 -- 172.21.15.18:0/2508525860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e823709980 con 0x55e8237e15e0 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.431+0000 7fa1b3e00640 1 -- 172.21.15.18:0/2508525860 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e82376dcd0 con 0x55e8237e15e0 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.431+0000 7fa1b3e00640 1 -- 172.21.15.18:0/2508525860 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa1b8044470 con 0x55e8237e15e0 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.431+0000 7fa1d79be740 10 client.15303 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.431+0000 7fa1d79be740 10 client.15303 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.431+0000 7fa1d79be740 20 client.15303 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.431+0000 7fa1d79be740 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x55e823851910 0x55e82384e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.431+0000 7fa1d79be740 4 client.15303 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.431+0000 7fa1d79be740 1 -- 172.21.15.18:0/2508525860 --> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e82349bd10 con 0x55e823851910 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.431+0000 7fa1ce800640 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x55e823851910 0x55e82384e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1ce800640 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x55e823851910 0x55e82384e270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa66a11c661ffab9 server_cookie=65da3a2c1cdbca7 in_seq=0 out_seq=0 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1b3e00640 10 client.15303 ms_handle_connect on v2:172.21.15.94:6836/2839586927 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1b3e00640 1 -- 172.21.15.18:0/2508525860 <== mds.2 v2:172.21.15.94:6836/2839586927 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e82349bd10 con 0x55e823851910 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1b3e00640 10 client.15303 handle_command_reply: tid=0 2024-09-13T16:52:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 client.15303 shutdown 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 -- 172.21.15.18:0/2508525860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 msgr2=0x55e8237ed000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237ed000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005cd0 tx=0x7fa1b80454a0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 -- 172.21.15.18:0/2508525860 shutdown_connections 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e8237e15e0 0x55e8237ed000 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.94:6836/2839586927,v1:172.21.15.94:6837/2839586927] conn(0x55e823851910 0x55e82384e270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e8237e6670 0x55e82384caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 --2- 172.21.15.18:0/2508525860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e8237e0ca0 0x55e8237ecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 -- 172.21.15.18:0/2508525860 >> 172.21.15.18:0/2508525860 conn(0x55e8237dc310 msgr2=0x55e8237fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1b3e00640 0 client.15303 ms_handle_reset on v2:172.21.15.94:6836/2839586927 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 -- 172.21.15.18:0/2508525860 shutdown_connections 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.432+0000 7fa1d79be740 1 -- 172.21.15.18:0/2508525860 wait complete. 2024-09-13T16:52:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1d79be740 20 client.15303 trim_cache size 0 max 16384 2024-09-13T16:52:05.440 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T16:52:05.440 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "d8ff35a0-71ee-11ef-bceb-c7b262605968", 2024-09-13T16:52:05.440 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 2, 2024-09-13T16:52:05.440 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24539, 2024-09-13T16:52:05.440 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-13T16:52:05.440 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-13T16:52:05.440 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-13T16:52:05.440 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 128.65339990699999, 2024-09-13T16:52:05.440 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 24, 2024-09-13T16:52:05.440 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 93, 2024-09-13T16:52:05.441 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T16:52:05.441 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 174.62762676599999 2024-09-13T16:52:05.441 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T16:52:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 -- 172.21.15.18:0/186455763 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1b40a1090 msgr2=0x7fa1b40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1b40a1090 0x7fa1b40a3550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00967d0 tx=0x7fa1c00d0b10 comp rx=0 tx=0).stop 2024-09-13T16:52:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 -- 172.21.15.18:0/186455763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1d0101d80 msgr2=0x7fa1d0197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1d0101d80 0x7fa1d0197dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000e9c0 tx=0x7fa1c000ee80 comp rx=0 tx=0).stop 2024-09-13T16:52:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 -- 172.21.15.18:0/186455763 shutdown_connections 2024-09-13T16:52:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa1b40a1090 0x7fa1b40a3550 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d0103930 0x7fa1d019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1d0102f70 0x7fa1d0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 --2- 172.21.15.18:0/186455763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1d0101d80 0x7fa1d0197dc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 -- 172.21.15.18:0/186455763 >> 172.21.15.18:0/186455763 conn(0x7fa1d00fd500 msgr2=0x7fa1d0106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 -- 172.21.15.18:0/186455763 shutdown_connections 2024-09-13T16:52:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.433+0000 7fa1cf200640 1 -- 172.21.15.18:0/186455763 wait complete. 2024-09-13T16:52:05.450 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2024-09-13T16:52:05.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.607+0000 7fc637e00640 1 -- 172.21.15.18:0/4172152452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc638103930 msgr2=0x7fc63810a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.607+0000 7fc637e00640 1 --2- 172.21.15.18:0/4172152452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc638103930 0x7fc63810a1c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc630009ca0 tx=0x7fc63002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.607+0000 7fc637e00640 1 -- 172.21.15.18:0/4172152452 shutdown_connections 2024-09-13T16:52:05.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.607+0000 7fc637e00640 1 --2- 172.21.15.18:0/4172152452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc638103930 0x7fc63810a1c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.607+0000 7fc637e00640 1 --2- 172.21.15.18:0/4172152452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc638102f70 0x7fc6381033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.607+0000 7fc637e00640 1 --2- 172.21.15.18:0/4172152452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc638101d80 0x7fc638102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.607+0000 7fc637e00640 1 -- 172.21.15.18:0/4172152452 >> 172.21.15.18:0/4172152452 conn(0x7fc6380fd500 msgr2=0x7fc6380ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.607+0000 7fc637e00640 1 -- 172.21.15.18:0/4172152452 shutdown_connections 2024-09-13T16:52:05.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.607+0000 7fc637e00640 1 -- 172.21.15.18:0/4172152452 wait complete. 2024-09-13T16:52:05.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc637e00640 1 Processor -- start 2024-09-13T16:52:05.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc637e00640 1 -- start start 2024-09-13T16:52:05.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc637e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc638101d80 0x7fc638197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc637e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc638102f70 0x7fc6381982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc637e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc638103930 0x7fc63819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc637e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63819f850 con 0x7fc638101d80 2024-09-13T16:52:05.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc637e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63819f9c0 con 0x7fc638102f70 2024-09-13T16:52:05.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc637e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63819fb80 con 0x7fc638103930 2024-09-13T16:52:05.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc636a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc638101d80 0x7fc638197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc636a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc638101d80 0x7fc638197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55700/0 (socket says 172.21.15.18:55700) 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.608+0000 7fc636a00640 1 -- 172.21.15.18:0/968559471 learned_addr learned my addr 172.21.15.18:0/968559471 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc62e000640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc638102f70 0x7fc6381982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc637400640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc638103930 0x7fc63819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc636a00640 1 -- 172.21.15.18:0/968559471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc638103930 msgr2=0x7fc63819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc636a00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc638103930 0x7fc63819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc636a00640 1 -- 172.21.15.18:0/968559471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc638102f70 msgr2=0x7fc6381982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc636a00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc638102f70 0x7fc6381982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc636a00640 1 -- 172.21.15.18:0/968559471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628009490 con 0x7fc638101d80 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc62e000640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc638102f70 0x7fc6381982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc636a00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc638101d80 0x7fc638197d60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc62800e9c0 tx=0x7fc62800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc63ca00640 1 -- 172.21.15.18:0/968559471 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800cde0 con 0x7fc638101d80 2024-09-13T16:52:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc63ca00640 1 -- 172.21.15.18:0/968559471 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6280108f0 con 0x7fc638101d80 2024-09-13T16:52:05.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.609+0000 7fc63ca00640 1 -- 172.21.15.18:0/968559471 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6280188c0 con 0x7fc638101d80 2024-09-13T16:52:05.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.610+0000 7fc637e00640 1 -- 172.21.15.18:0/968559471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc630009900 con 0x7fc638101d80 2024-09-13T16:52:05.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.610+0000 7fc637e00640 1 -- 172.21.15.18:0/968559471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6381a0190 con 0x7fc638101d80 2024-09-13T16:52:05.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc640bee740 1 Processor -- start 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc63ca00640 1 -- 172.21.15.18:0/968559471 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc628010a60 con 0x7fc638101d80 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc640bee740 1 -- start start 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc640bee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b14960a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc640bee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 0x5585b149b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc640bee740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b149b670 0x5585b149db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc640bee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b13ffab0 con 0x5585b1495ca0 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc640bee740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b13fd240 con 0x5585b149b670 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc640bee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b13f8b30 con 0x5585b14965e0 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc637400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b14960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc637400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b14960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55702/0 (socket says 172.21.15.18:55702) 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc637400640 1 -- 172.21.15.18:0/1581680820 learned_addr learned my addr 172.21.15.18:0/1581680820 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc636a00640 1 --2- 172.21.15.18:0/1581680820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 0x5585b149b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.613+0000 7fc62e000640 1 --2- 172.21.15.18:0/1581680820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b149b670 0x5585b149db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.614+0000 7fc637400640 1 -- 172.21.15.18:0/1581680820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 msgr2=0x5585b149b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.614+0000 7fc637400640 1 --2- 172.21.15.18:0/1581680820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 0x5585b149b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.614+0000 7fc637400640 1 -- 172.21.15.18:0/1581680820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b149b670 msgr2=0x5585b149db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.614+0000 7fc637400640 1 --2- 172.21.15.18:0/1581680820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b149b670 0x5585b149db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.614+0000 7fc637400640 1 -- 172.21.15.18:0/1581680820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585b13c3bd0 con 0x5585b1495ca0 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.614+0000 7fc637400640 1 --2- 172.21.15.18:0/1581680820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b14960a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc630009ca0 tx=0x7fc630009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29916dac6f29a74d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.614+0000 7fc62cc00640 1 -- 172.21.15.18:0/1581680820 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630031450 con 0x5585b1495ca0 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.614+0000 7fc62cc00640 1 -- 172.21.15.18:0/1581680820 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc630003970 con 0x5585b1495ca0 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.614+0000 7fc63ca00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc61c0a1110 0x7fc61c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.614+0000 7fc62cc00640 1 -- 172.21.15.18:0/1581680820 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630030ba0 con 0x5585b1495ca0 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc63ca00640 1 -- 172.21.15.18:0/968559471 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fc628014070 con 0x7fc638101d80 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc636a00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc61c0a1110 0x7fc61c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc640bee740 1 -- 172.21.15.18:0/1581680820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 msgr2=0x5585b14960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc640bee740 1 --2- 172.21.15.18:0/1581680820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b14960a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc630009ca0 tx=0x7fc630009360 comp rx=0 tx=0).stop 2024-09-13T16:52:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc640bee740 1 -- 172.21.15.18:0/1581680820 shutdown_connections 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc640bee740 1 --2- 172.21.15.18:0/1581680820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b149b670 0x5585b149db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc640bee740 1 --2- 172.21.15.18:0/1581680820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 0x5585b149b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc640bee740 1 --2- 172.21.15.18:0/1581680820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b14960a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc640bee740 1 -- 172.21.15.18:0/1581680820 >> 172.21.15.18:0/1581680820 conn(0x5585b1491310 msgr2=0x5585b1491710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc636a00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc61c0a1110 0x7fc61c0a35d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc6280a21b0 tx=0x7fc6280d0a10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc640bee740 1 -- 172.21.15.18:0/1581680820 shutdown_connections 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.615+0000 7fc640bee740 1 -- 172.21.15.18:0/1581680820 wait complete. 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.616+0000 7fc640bee740 1 -- start start 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.616+0000 7fc640bee740 1 Processor -- start 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.616+0000 7fc640bee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b1495ca0 0x5585b149f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.616+0000 7fc640bee740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b149fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.616+0000 7fc640bee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 0x5585b14a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.616+0000 7fc640bee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b139a260 con 0x5585b149b670 2024-09-13T16:52:05.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.616+0000 7fc640bee740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b1399f00 con 0x5585b14965e0 2024-09-13T16:52:05.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.616+0000 7fc640bee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b115ff20 con 0x5585b1495ca0 2024-09-13T16:52:05.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.616+0000 7fc640bee740 10 client.0 _ll_register_callbacks cb 0x5585b13f21a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:05.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc62e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b149fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc62e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b149fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:57886/0 (socket says 172.21.15.18:57886) 2024-09-13T16:52:05.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc637400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 0x5585b14a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc62e000640 1 -- 172.21.15.18:0/2827306320 learned_addr learned my addr 172.21.15.18:0/2827306320 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc637400640 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b1495ca0 0x5585b149f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc62e000640 1 -- 172.21.15.18:0/2827306320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b1495ca0 msgr2=0x5585b149f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc62e000640 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b1495ca0 0x5585b149f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc62e000640 1 -- 172.21.15.18:0/2827306320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 msgr2=0x5585b14a6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc62e000640 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 0x5585b14a6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc62e000640 1 -- 172.21.15.18:0/2827306320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63810aac0 con 0x5585b14965e0 2024-09-13T16:52:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc637400640 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 0x5585b14a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc62e000640 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b149fd80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc620012b10 tx=0x7fc62000f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=115f3c7d417c0840 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.617+0000 7fc625600640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:52:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.618+0000 7fc625600640 1 -- 172.21.15.18:0/2827306320 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620017070 con 0x5585b14965e0 2024-09-13T16:52:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.618+0000 7fc625600640 1 -- 172.21.15.18:0/2827306320 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fc62000fb40 con 0x5585b14965e0 2024-09-13T16:52:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.618+0000 7fc640bee740 1 -- 172.21.15.18:0/2827306320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585b1422cd0 con 0x5585b14965e0 2024-09-13T16:52:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.618+0000 7fc625600640 1 -- 172.21.15.18:0/2827306320 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc62000fd40 con 0x5585b14965e0 2024-09-13T16:52:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.618+0000 7fc640bee740 10 client.25358 fetch_fsmap learned FSMap version 24 2024-09-13T16:52:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.618+0000 7fc640bee740 1 -- 172.21.15.18:0/2827306320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5585b13f71b0 con 0x5585b14965e0 2024-09-13T16:52:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.618+0000 7fc625600640 1 -- 172.21.15.18:0/2827306320 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5585b1422cd0 con 0x5585b14965e0 2024-09-13T16:52:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.619+0000 7fc625600640 1 -- 172.21.15.18:0/2827306320 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc620003bc0 con 0x5585b14965e0 2024-09-13T16:52:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.619+0000 7fc640bee740 10 client.25358 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.619+0000 7fc640bee740 10 client.25358 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.619+0000 7fc640bee740 20 client.25358 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.619+0000 7fc640bee740 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5585b14abdf0 0x5585b14aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.619+0000 7fc640bee740 4 client.25358 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.619+0000 7fc640bee740 1 -- 172.21.15.18:0/2827306320 --> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585b10ec3c0 con 0x5585b14abdf0 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.619+0000 7fc637400640 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5585b14abdf0 0x5585b14aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.620+0000 7fc637400640 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5585b14abdf0 0x5585b14aff50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=46d05663146ef0da server_cookie=89893492f792c41d in_seq=0 out_seq=0 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.620+0000 7fc625600640 10 client.25358 ms_handle_connect on v2:172.21.15.18:6838/152668011 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.620+0000 7fc625600640 1 -- 172.21.15.18:0/2827306320 <== mds.1 v2:172.21.15.18:6838/152668011 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5585b10ec3c0 con 0x5585b14abdf0 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.620+0000 7fc625600640 10 client.25358 handle_command_reply: tid=0 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.620+0000 7fc640bee740 1 client.25358 shutdown 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.620+0000 7fc640bee740 1 -- 172.21.15.18:0/2827306320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 msgr2=0x5585b149fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.620+0000 7fc640bee740 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b149fd80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc620012b10 tx=0x7fc62000f3c0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.621+0000 7fc640bee740 1 -- 172.21.15.18:0/2827306320 shutdown_connections 2024-09-13T16:52:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.621+0000 7fc640bee740 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5585b14abdf0 0x5585b14aff50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.621+0000 7fc640bee740 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 0x5585b14a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.621+0000 7fc640bee740 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b149fd80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.621+0000 7fc640bee740 1 --2- 172.21.15.18:0/2827306320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b1495ca0 0x5585b149f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.621+0000 7fc625600640 0 client.25358 ms_handle_reset on v2:172.21.15.18:6838/152668011 2024-09-13T16:52:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.621+0000 7fc640bee740 1 -- 172.21.15.18:0/2827306320 >> 172.21.15.18:0/2827306320 conn(0x5585b1491310 msgr2=0x5585b1490650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.621+0000 7fc640bee740 1 -- 172.21.15.18:0/2827306320 shutdown_connections 2024-09-13T16:52:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.621+0000 7fc640bee740 1 -- 172.21.15.18:0/2827306320 wait complete. 2024-09-13T16:52:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.621+0000 7fc640bee740 20 client.25358 trim_cache size 0 max 16384 2024-09-13T16:52:05.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc640bee740 1 Processor -- start 2024-09-13T16:52:05.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc640bee740 1 -- start start 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc640bee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b1496080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc640bee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 0x5585b14a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc640bee740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b149b670 0x5585b149fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc640bee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b14911d0 con 0x5585b1495ca0 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc640bee740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b1496ed0 con 0x5585b149b670 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc640bee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b13b67e0 con 0x5585b14965e0 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc637400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b1496080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc62e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 0x5585b14a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc637400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b1496080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55726/0 (socket says 172.21.15.18:55726) 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc637400640 1 -- 172.21.15.18:0/3962606478 learned_addr learned my addr 172.21.15.18:0/3962606478 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.637+0000 7fc637400640 1 --2- 172.21.15.18:0/3962606478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b149b670 0x5585b149fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.638+0000 7fc637400640 1 -- 172.21.15.18:0/3962606478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 msgr2=0x5585b14a6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.638+0000 7fc637400640 1 --2- 172.21.15.18:0/3962606478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 0x5585b14a6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.638+0000 7fc637400640 1 -- 172.21.15.18:0/3962606478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b149b670 msgr2=0x5585b149fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.638+0000 7fc637400640 1 --2- 172.21.15.18:0/3962606478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b149b670 0x5585b149fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.638+0000 7fc637400640 1 -- 172.21.15.18:0/3962606478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585b1399470 con 0x5585b1495ca0 2024-09-13T16:52:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.638+0000 7fc62e000640 1 --2- 172.21.15.18:0/3962606478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 0x5585b14a6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.638+0000 7fc637400640 1 --2- 172.21.15.18:0/3962606478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b1496080 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc630031b10 tx=0x7fc630031be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de34de94c9320a7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.638+0000 7fc62d600640 1 -- 172.21.15.18:0/3962606478 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630058ea0 con 0x5585b1495ca0 2024-09-13T16:52:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.638+0000 7fc62d600640 1 -- 172.21.15.18:0/3962606478 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc630031910 con 0x5585b1495ca0 2024-09-13T16:52:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.638+0000 7fc62d600640 1 -- 172.21.15.18:0/3962606478 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6300586d0 con 0x5585b1495ca0 2024-09-13T16:52:05.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.639+0000 7fc640bee740 1 -- 172.21.15.18:0/3962606478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 msgr2=0x5585b1496080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.639+0000 7fc640bee740 1 --2- 172.21.15.18:0/3962606478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b1496080 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc630031b10 tx=0x7fc630031be0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.639+0000 7fc640bee740 1 -- 172.21.15.18:0/3962606478 shutdown_connections 2024-09-13T16:52:05.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.639+0000 7fc640bee740 1 --2- 172.21.15.18:0/3962606478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b149b670 0x5585b149fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.639+0000 7fc640bee740 1 --2- 172.21.15.18:0/3962606478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b14965e0 0x5585b14a6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.639+0000 7fc640bee740 1 --2- 172.21.15.18:0/3962606478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b1495ca0 0x5585b1496080 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.639+0000 7fc640bee740 1 -- 172.21.15.18:0/3962606478 >> 172.21.15.18:0/3962606478 conn(0x5585b1491310 msgr2=0x5585b149f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.639+0000 7fc640bee740 1 -- 172.21.15.18:0/3962606478 shutdown_connections 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.639+0000 7fc640bee740 1 -- 172.21.15.18:0/3962606478 wait complete. 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.639+0000 7fc640bee740 1 -- start start 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc640bee740 1 Processor -- start 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc640bee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b1495ca0 0x5585b14a1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc640bee740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b14a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc640bee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 0x5585b1501c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc640bee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b14a6f00 con 0x5585b149b670 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc640bee740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b14a7070 con 0x5585b14965e0 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc640bee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585b1502150 con 0x5585b1495ca0 2024-09-13T16:52:05.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc640bee740 10 client.0 _ll_register_callbacks cb 0x7fc620009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc637400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 0x5585b1501c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc62e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b14a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc62e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b14a1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:57896/0 (socket says 172.21.15.18:57896) 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc62e000640 1 -- 172.21.15.18:0/3117353172 learned_addr learned my addr 172.21.15.18:0/3117353172 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.640+0000 7fc637400640 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b1495ca0 0x5585b14a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.641+0000 7fc62e000640 1 -- 172.21.15.18:0/3117353172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b1495ca0 msgr2=0x5585b14a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.641+0000 7fc62e000640 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b1495ca0 0x5585b14a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.641+0000 7fc62e000640 1 -- 172.21.15.18:0/3117353172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 msgr2=0x5585b1501c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.641+0000 7fc62e000640 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 0x5585b1501c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.641+0000 7fc62e000640 1 -- 172.21.15.18:0/3117353172 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585b13f71b0 con 0x5585b14965e0 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.641+0000 7fc62e000640 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b14a1ed0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc6200059f0 tx=0x7fc62000fdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73f4410901e426c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.641+0000 7fc625600640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.641+0000 7fc625600640 1 -- 172.21.15.18:0/3117353172 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62002d070 con 0x5585b14965e0 2024-09-13T16:52:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.641+0000 7fc640bee740 1 -- 172.21.15.18:0/3117353172 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc630003970 con 0x5585b14965e0 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.641+0000 7fc625600640 1 -- 172.21.15.18:0/3117353172 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fc620000e40 con 0x5585b14965e0 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc625600640 1 -- 172.21.15.18:0/3117353172 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc620017070 con 0x5585b14965e0 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc640bee740 10 client.25364 fetch_fsmap learned FSMap version 24 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc640bee740 1 -- 172.21.15.18:0/3117353172 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fc63004a040 con 0x5585b14965e0 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc625600640 1 -- 172.21.15.18:0/3117353172 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc630003970 con 0x5585b14965e0 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc625600640 1 -- 172.21.15.18:0/3117353172 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc620030020 con 0x5585b14965e0 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc640bee740 10 client.25364 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc640bee740 10 client.25364 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc640bee740 20 client.25364 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc640bee740 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5585b1506ec0 0x5585b1503840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc640bee740 4 client.25364 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc640bee740 1 -- 172.21.15.18:0/3117353172 --> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5585b10fd6c0 con 0x5585b1506ec0 2024-09-13T16:52:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.642+0000 7fc637400640 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5585b1506ec0 0x5585b1503840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.643+0000 7fc637400640 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5585b1506ec0 0x5585b1503840 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c403129e3b6d9538 server_cookie=59199131d6d8ec in_seq=0 out_seq=0 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.643+0000 7fc625600640 10 client.25364 ms_handle_connect on v2:172.21.15.18:6838/152668011 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.643+0000 7fc625600640 1 -- 172.21.15.18:0/3117353172 <== mds.1 v2:172.21.15.18:6838/152668011 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5585b10fd6c0 con 0x5585b1506ec0 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.643+0000 7fc625600640 10 client.25364 handle_command_reply: tid=0 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.643+0000 7fc640bee740 1 client.25364 shutdown 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.643+0000 7fc640bee740 1 -- 172.21.15.18:0/3117353172 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 msgr2=0x5585b14a1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.643+0000 7fc640bee740 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b14a1ed0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc6200059f0 tx=0x7fc62000fdf0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc640bee740 1 -- 172.21.15.18:0/3117353172 shutdown_connections 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc640bee740 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.18:6838/152668011,v1:172.21.15.18:6839/152668011] conn(0x5585b1506ec0 0x5585b1503840 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc640bee740 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b149b670 0x5585b1501c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc640bee740 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585b14965e0 0x5585b14a1ed0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc625600640 0 client.25364 ms_handle_reset on v2:172.21.15.18:6838/152668011 2024-09-13T16:52:05.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc640bee740 1 --2- 172.21.15.18:0/3117353172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585b1495ca0 0x5585b14a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc640bee740 1 -- 172.21.15.18:0/3117353172 >> 172.21.15.18:0/3117353172 conn(0x5585b1491310 msgr2=0x5585b14b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc640bee740 1 -- 172.21.15.18:0/3117353172 shutdown_connections 2024-09-13T16:52:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc640bee740 1 -- 172.21.15.18:0/3117353172 wait complete. 2024-09-13T16:52:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc640bee740 20 client.25364 trim_cache size 0 max 16384 2024-09-13T16:52:05.650 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T16:52:05.650 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "d8ff35a0-71ee-11ef-bceb-c7b262605968", 2024-09-13T16:52:05.650 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 1, 2024-09-13T16:52:05.650 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24566, 2024-09-13T16:52:05.650 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-13T16:52:05.650 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-13T16:52:05.651 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-13T16:52:05.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 129.86857363300001, 2024-09-13T16:52:05.651 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 24, 2024-09-13T16:52:05.651 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 93, 2024-09-13T16:52:05.651 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T16:52:05.651 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 168.736701458 2024-09-13T16:52:05.651 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T16:52:05.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc637e00640 1 -- 172.21.15.18:0/968559471 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc61c0a1110 msgr2=0x7fc61c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc637e00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc61c0a1110 0x7fc61c0a35d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc6280a21b0 tx=0x7fc6280d0a10 comp rx=0 tx=0).stop 2024-09-13T16:52:05.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc637e00640 1 -- 172.21.15.18:0/968559471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc638101d80 msgr2=0x7fc638197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.644+0000 7fc637e00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc638101d80 0x7fc638197d60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc62800e9c0 tx=0x7fc62800ee80 comp rx=0 tx=0).stop 2024-09-13T16:52:05.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.645+0000 7fc637e00640 1 -- 172.21.15.18:0/968559471 shutdown_connections 2024-09-13T16:52:05.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.645+0000 7fc637e00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc638103930 0x7fc63819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.645+0000 7fc637e00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc638102f70 0x7fc6381982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.645+0000 7fc637e00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc61c0a1110 0x7fc61c0a35d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.645+0000 7fc637e00640 1 --2- 172.21.15.18:0/968559471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc638101d80 0x7fc638197d60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.645+0000 7fc637e00640 1 -- 172.21.15.18:0/968559471 >> 172.21.15.18:0/968559471 conn(0x7fc6380fd500 msgr2=0x7fc6381063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.645+0000 7fc637e00640 1 -- 172.21.15.18:0/968559471 shutdown_connections 2024-09-13T16:52:05.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.645+0000 7fc637e00640 1 -- 172.21.15.18:0/968559471 wait complete. 2024-09-13T16:52:05.662 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T16:52:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.818+0000 7f609d600640 1 -- 172.21.15.18:0/3698477820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60980ff7a0 msgr2=0x7f60980ffc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.818+0000 7f609d600640 1 --2- 172.21.15.18:0/3698477820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60980ff7a0 0x7f60980ffc20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6084009900 tx=0x7f608402a410 comp rx=0 tx=0).stop 2024-09-13T16:52:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.819+0000 7f609d600640 1 -- 172.21.15.18:0/3698477820 shutdown_connections 2024-09-13T16:52:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.819+0000 7f609d600640 1 --2- 172.21.15.18:0/3698477820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60980ff7a0 0x7f60980ffc20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.819+0000 7f609d600640 1 --2- 172.21.15.18:0/3698477820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6098100160 0x7f6098107fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.819+0000 7f609d600640 1 --2- 172.21.15.18:0/3698477820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6098101270 0x7f6098101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.819+0000 7f609d600640 1 -- 172.21.15.18:0/3698477820 >> 172.21.15.18:0/3698477820 conn(0x7f60980fb2f0 msgr2=0x7f60980fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.819+0000 7f609d600640 1 -- 172.21.15.18:0/3698477820 shutdown_connections 2024-09-13T16:52:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.819+0000 7f609d600640 1 -- 172.21.15.18:0/3698477820 wait complete. 2024-09-13T16:52:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f609d600640 1 Processor -- start 2024-09-13T16:52:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f609d600640 1 -- start start 2024-09-13T16:52:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f609d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60980ff7a0 0x7f6098197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f609d600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6098100160 0x7f60981983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f609d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6098101270 0x7f609819f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f609d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609819f980 con 0x7f60980ff7a0 2024-09-13T16:52:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f609d600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609819faf0 con 0x7f6098100160 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f609d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609819fcb0 con 0x7f6098101270 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f6097e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60980ff7a0 0x7f6098197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f6097e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60980ff7a0 0x7f6098197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55752/0 (socket says 172.21.15.18:55752) 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f6097e00640 1 -- 172.21.15.18:0/1136972693 learned_addr learned my addr 172.21.15.18:0/1136972693 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f609cc00640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6098101270 0x7f609819f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.820+0000 7f6097400640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6098100160 0x7f60981983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f6097e00640 1 -- 172.21.15.18:0/1136972693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6098101270 msgr2=0x7f609819f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f6097e00640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6098101270 0x7f609819f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f6097e00640 1 -- 172.21.15.18:0/1136972693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6098100160 msgr2=0x7f60981983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f6097e00640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6098100160 0x7f60981983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f6097e00640 1 -- 172.21.15.18:0/1136972693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6084009560 con 0x7f60980ff7a0 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f6097400640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6098100160 0x7f60981983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f6097e00640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60980ff7a0 0x7f6098197e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f608800e9c0 tx=0x7f608800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f6094c00640 1 -- 172.21.15.18:0/1136972693 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60880096e0 con 0x7f60980ff7a0 2024-09-13T16:52:05.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f6094c00640 1 -- 172.21.15.18:0/1136972693 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60880044f0 con 0x7f60980ff7a0 2024-09-13T16:52:05.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f609d600640 1 -- 172.21.15.18:0/1136972693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609819ff90 con 0x7f60980ff7a0 2024-09-13T16:52:05.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.821+0000 7f6094c00640 1 -- 172.21.15.18:0/1136972693 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088010430 con 0x7f60980ff7a0 2024-09-13T16:52:05.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.822+0000 7f609d600640 1 -- 172.21.15.18:0/1136972693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60981a0360 con 0x7f60980ff7a0 2024-09-13T16:52:05.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.824+0000 7f60a1a4b740 1 Processor -- start 2024-09-13T16:52:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.824+0000 7f6094c00640 1 -- 172.21.15.18:0/1136972693 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f60880035f0 con 0x7f60980ff7a0 2024-09-13T16:52:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f60a1a4b740 1 -- start start 2024-09-13T16:52:05.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x5640407940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 0x5640407990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x56404079bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640406fdab0 con 0x5640407945e0 2024-09-13T16:52:05.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640406fb240 con 0x564040799670 2024-09-13T16:52:05.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640406f6b30 con 0x564040793ca0 2024-09-13T16:52:05.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f6097e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 0x5640407990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f609cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x5640407940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f609cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x5640407940a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:58762/0 (socket says 172.21.15.18:58762) 2024-09-13T16:52:05.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f609cc00640 1 -- 172.21.15.18:0/2294912427 learned_addr learned my addr 172.21.15.18:0/2294912427 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.825+0000 7f6097400640 1 --2- 172.21.15.18:0/2294912427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x56404079bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f609cc00640 1 -- 172.21.15.18:0/2294912427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 msgr2=0x56404079bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f609cc00640 1 --2- 172.21.15.18:0/2294912427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x56404079bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f609cc00640 1 -- 172.21.15.18:0/2294912427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 msgr2=0x5640407990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f609cc00640 1 --2- 172.21.15.18:0/2294912427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 0x5640407990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f609cc00640 1 -- 172.21.15.18:0/2294912427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640406c1bd0 con 0x564040793ca0 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f6097400640 1 --2- 172.21.15.18:0/2294912427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x56404079bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f609cc00640 1 --2- 172.21.15.18:0/2294912427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x5640407940a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6090009fd0 tx=0x7f60900118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1bfba465ddc52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f6094c00640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f607c0a1090 0x7f607c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f608d600640 1 -- 172.21.15.18:0/2294912427 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090004d20 con 0x564040793ca0 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f6094c00640 1 -- 172.21.15.18:0/1136972693 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f6088014070 con 0x7f60980ff7a0 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f608d600640 1 -- 172.21.15.18:0/2294912427 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6090004e80 con 0x564040793ca0 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f608d600640 1 -- 172.21.15.18:0/2294912427 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090005280 con 0x564040793ca0 2024-09-13T16:52:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.826+0000 7f6097e00640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f607c0a1090 0x7f607c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f6097e00640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f607c0a1090 0x7f607c0a3550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f60880058c0 tx=0x7f60880d0920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2294912427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 msgr2=0x5640407940a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2294912427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x5640407940a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6090009fd0 tx=0x7f60900118d0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2294912427 shutdown_connections 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2294912427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 0x5640407990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2294912427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x56404079bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2294912427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x5640407940a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2294912427 >> 172.21.15.18:0/2294912427 conn(0x56404078f310 msgr2=0x56404078f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2294912427 shutdown_connections 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2294912427 wait complete. 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.827+0000 7f60a1a4b740 1 -- start start 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f60a1a4b740 1 Processor -- start 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x56404079d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 0x56404079de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x5640407a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x564040698260 con 0x5640407945e0 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x564040697f00 con 0x564040799670 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404045df20 con 0x564040793ca0 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f60a1a4b740 10 client.0 _ll_register_callbacks cb 0x5640406f01a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f609cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x56404079d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f6097400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 0x56404079de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f609cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x56404079d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:58774/0 (socket says 172.21.15.18:58774) 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f609cc00640 1 -- 172.21.15.18:0/668663424 learned_addr learned my addr 172.21.15.18:0/668663424 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.828+0000 7f609cc00640 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x5640407a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.829+0000 7f6097400640 1 -- 172.21.15.18:0/668663424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 msgr2=0x56404079d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.829+0000 7f6097400640 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x56404079d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.829+0000 7f6097400640 1 -- 172.21.15.18:0/668663424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 msgr2=0x5640407a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.829+0000 7f6097400640 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x5640407a4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.829+0000 7f6097400640 1 -- 172.21.15.18:0/668663424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6090009c80 con 0x5640407945e0 2024-09-13T16:52:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.829+0000 7f6097400640 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 0x56404079de30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f608402aa00 tx=0x7f6084005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234017d47cb94862 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.829+0000 7f6082000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.829+0000 7f6082000640 1 -- 172.21.15.18:0/668663424 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084004ad0 con 0x5640407945e0 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.829+0000 7f60a1a4b740 1 -- 172.21.15.18:0/668663424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640403ea3c0 con 0x5640407945e0 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.829+0000 7f6082000640 1 -- 172.21.15.18:0/668663424 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f6084005520 con 0x5640407945e0 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f6082000640 1 -- 172.21.15.18:0/668663424 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6084004490 con 0x5640407945e0 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f60a1a4b740 10 client.15333 fetch_fsmap learned FSMap version 24 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f60a1a4b740 1 -- 172.21.15.18:0/668663424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5640406f51b0 con 0x5640407945e0 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f6082000640 1 -- 172.21.15.18:0/668663424 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5640403ea3c0 con 0x5640407945e0 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f6082000640 1 -- 172.21.15.18:0/668663424 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f60840315a0 con 0x5640407945e0 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f60a1a4b740 10 client.15333 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f60a1a4b740 10 client.15333 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f60a1a4b740 20 client.15333 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5640407a9c40 0x5640407add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f60a1a4b740 4 client.15333 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:52:05.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.830+0000 7f60a1a4b740 1 -- 172.21.15.18:0/668663424 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640403fb6c0 con 0x5640407a9c40 2024-09-13T16:52:05.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.831+0000 7f609cc00640 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5640407a9c40 0x5640407add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.831+0000 7f609cc00640 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5640407a9c40 0x5640407add80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cbe25f7dc66a9e3 server_cookie=35740807d3a72471 in_seq=0 out_seq=0 2024-09-13T16:52:05.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.831+0000 7f6082000640 10 client.15333 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f6082000640 1 -- 172.21.15.18:0/668663424 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5640403fb6c0 con 0x5640407a9c40 2024-09-13T16:52:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f6082000640 10 client.15333 handle_command_reply: tid=0 2024-09-13T16:52:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 client.15333 shutdown 2024-09-13T16:52:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 -- 172.21.15.18:0/668663424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 msgr2=0x56404079de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 0x56404079de30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f608402aa00 tx=0x7f6084005330 comp rx=0 tx=0).stop 2024-09-13T16:52:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 -- 172.21.15.18:0/668663424 shutdown_connections 2024-09-13T16:52:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5640407a9c40 0x5640407add80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640407945e0 0x56404079de30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x5640407a4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f6082000640 0 client.15333 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/668663424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564040793ca0 0x56404079d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 -- 172.21.15.18:0/668663424 >> 172.21.15.18:0/668663424 conn(0x56404078f310 msgr2=0x56404078e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 -- 172.21.15.18:0/668663424 shutdown_connections 2024-09-13T16:52:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 1 -- 172.21.15.18:0/668663424 wait complete. 2024-09-13T16:52:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.832+0000 7f60a1a4b740 20 client.15333 trim_cache size 0 max 16384 2024-09-13T16:52:05.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f60a1a4b740 1 Processor -- start 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f60a1a4b740 1 -- start start 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x564040790700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 0x5640407a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x564040790c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404078f1d0 con 0x564040793ca0 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404078b140 con 0x564040799670 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640407a7ec0 con 0x5640407945e0 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f609cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x564040790700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f609cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x564040790700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55776/0 (socket says 172.21.15.18:55776) 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f609cc00640 1 -- 172.21.15.18:0/2429032103 learned_addr learned my addr 172.21.15.18:0/2429032103 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f6097400640 1 --2- 172.21.15.18:0/2429032103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 0x5640407a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.848+0000 7f609cc00640 1 --2- 172.21.15.18:0/2429032103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x564040790c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.849+0000 7f609cc00640 1 -- 172.21.15.18:0/2429032103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 msgr2=0x5640407a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.849+0000 7f609cc00640 1 --2- 172.21.15.18:0/2429032103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 0x5640407a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.849+0000 7f609cc00640 1 -- 172.21.15.18:0/2429032103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 msgr2=0x564040790c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.849+0000 7f609cc00640 1 --2- 172.21.15.18:0/2429032103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x564040790c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.849+0000 7f609cc00640 1 -- 172.21.15.18:0/2429032103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564040697470 con 0x564040793ca0 2024-09-13T16:52:05.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.849+0000 7f609cc00640 1 --2- 172.21.15.18:0/2429032103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x564040790700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6090009fa0 tx=0x7f60900118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785bf57659325b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.849+0000 7f608e000640 1 -- 172.21.15.18:0/2429032103 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609002c030 con 0x564040793ca0 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.849+0000 7f608e000640 1 -- 172.21.15.18:0/2429032103 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f609000f4e0 con 0x564040793ca0 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.849+0000 7f608e000640 1 -- 172.21.15.18:0/2429032103 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090004430 con 0x564040793ca0 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2429032103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 msgr2=0x564040790700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2429032103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x564040790700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6090009fa0 tx=0x7f60900118d0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2429032103 shutdown_connections 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2429032103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x564040790c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2429032103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 0x5640407a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2429032103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x564040790700 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2429032103 >> 172.21.15.18:0/2429032103 conn(0x56404078f310 msgr2=0x56404079d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2429032103 shutdown_connections 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2429032103 wait complete. 2024-09-13T16:52:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 -- start start 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.850+0000 7f60a1a4b740 1 Processor -- start 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x56404079ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 0x5640407a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f60a1a4b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x5640407a3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640407a3a40 con 0x564040793ca0 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640407a3bb0 con 0x564040799670 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f60a1a4b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640407a3d70 con 0x5640407945e0 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f60a1a4b740 10 client.0 _ll_register_callbacks cb 0x7f60900093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f609cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x56404079ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f609cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x56404079ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55778/0 (socket says 172.21.15.18:55778) 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f609cc00640 1 -- 172.21.15.18:0/2739678476 learned_addr learned my addr 172.21.15.18:0/2739678476 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f609cc00640 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x5640407a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f6097400640 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 0x5640407a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f609cc00640 1 -- 172.21.15.18:0/2739678476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 msgr2=0x5640407a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f609cc00640 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 0x5640407a04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f609cc00640 1 -- 172.21.15.18:0/2739678476 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 msgr2=0x5640407a3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f609cc00640 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x5640407a3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f609cc00640 1 -- 172.21.15.18:0/2739678476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640406c1bd0 con 0x564040793ca0 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.851+0000 7f6097400640 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 0x5640407a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.852+0000 7f609cc00640 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x56404079ffa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6090011e70 tx=0x7f6090005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4856bb074af38e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.852+0000 7f6082000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.852+0000 7f6082000640 1 -- 172.21.15.18:0/2739678476 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609002c040 con 0x564040793ca0 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.852+0000 7f6082000640 1 -- 172.21.15.18:0/2739678476 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f6090003d90 con 0x564040793ca0 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.852+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2739678476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564040720cd0 con 0x564040793ca0 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.852+0000 7f6082000640 1 -- 172.21.15.18:0/2739678476 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f609000f650 con 0x564040793ca0 2024-09-13T16:52:05.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.852+0000 7f60a1a4b740 10 client.15339 fetch_fsmap learned FSMap version 24 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.852+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2739678476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5640406bc980 con 0x564040793ca0 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.852+0000 7f6082000640 1 -- 172.21.15.18:0/2739678476 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564040720cd0 con 0x564040793ca0 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.852+0000 7f6082000640 1 -- 172.21.15.18:0/2739678476 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6090047020 con 0x564040793ca0 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.853+0000 7f60a1a4b740 10 client.15339 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.853+0000 7f60a1a4b740 10 client.15339 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.853+0000 7f60a1a4b740 20 client.15339 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.853+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x564040804ea0 0x564040801a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.853+0000 7f60a1a4b740 4 client.15339 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.853+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2739678476 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56404044ed10 con 0x564040804ea0 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.853+0000 7f6097400640 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x564040804ea0 0x564040801a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.853+0000 7f6097400640 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x564040804ea0 0x564040801a50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d57cac2e822c51e server_cookie=cb9395b35e4781b2 in_seq=0 out_seq=0 2024-09-13T16:52:05.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.853+0000 7f6082000640 10 client.15339 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f6082000640 1 -- 172.21.15.18:0/2739678476 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x56404044ed10 con 0x564040804ea0 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f6082000640 10 client.15339 handle_command_reply: tid=0 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 client.15339 shutdown 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2739678476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 msgr2=0x56404079ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x56404079ffa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6090011e70 tx=0x7f6090005fd0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2739678476 shutdown_connections 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x564040804ea0 0x564040801a50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564040799670 0x5640407a3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640407945e0 0x5640407a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 --2- 172.21.15.18:0/2739678476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564040793ca0 0x56404079ffa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2739678476 >> 172.21.15.18:0/2739678476 conn(0x56404078f310 msgr2=0x5640407b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f6082000640 0 client.15339 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2739678476 shutdown_connections 2024-09-13T16:52:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 1 -- 172.21.15.18:0/2739678476 wait complete. 2024-09-13T16:52:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.854+0000 7f60a1a4b740 20 client.15339 trim_cache size 0 max 16384 2024-09-13T16:52:05.861 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T16:52:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "d8ff35a0-71ee-11ef-bceb-c7b262605968", 2024-09-13T16:52:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-13T16:52:05.861 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24590, 2024-09-13T16:52:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-13T16:52:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-13T16:52:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-13T16:52:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 157.770590817, 2024-09-13T16:52:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 24, 2024-09-13T16:52:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 93, 2024-09-13T16:52:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T16:52:05.862 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 162.783143376 2024-09-13T16:52:05.862 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T16:52:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 -- 172.21.15.18:0/1136972693 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f607c0a1090 msgr2=0x7f607c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f607c0a1090 0x7f607c0a3550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f60880058c0 tx=0x7f60880d0920 comp rx=0 tx=0).stop 2024-09-13T16:52:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 -- 172.21.15.18:0/1136972693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60980ff7a0 msgr2=0x7f6098197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60980ff7a0 0x7f6098197e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f608800e9c0 tx=0x7f608800ee80 comp rx=0 tx=0).stop 2024-09-13T16:52:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 -- 172.21.15.18:0/1136972693 shutdown_connections 2024-09-13T16:52:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6098101270 0x7f609819f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6098100160 0x7f60981983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f607c0a1090 0x7f607c0a3550 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 --2- 172.21.15.18:0/1136972693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60980ff7a0 0x7f6098197e90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 -- 172.21.15.18:0/1136972693 >> 172.21.15.18:0/1136972693 conn(0x7f60980fb2f0 msgr2=0x7f6098106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 -- 172.21.15.18:0/1136972693 shutdown_connections 2024-09-13T16:52:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:05.855+0000 7f609d600640 1 -- 172.21.15.18:0/1136972693 wait complete. 2024-09-13T16:52:05.870 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:05 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3073119846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:52:05.870 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:05 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1807937240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:52:05.872 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T16:52:05.882 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T16:52:05.882 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T16:52:05.883 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T16:52:05.883 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T16:52:05.924 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T16:52:05.924 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-13T16:52:05.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:05.924 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-13T16:52:05.925 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:05 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3073119846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:52:05.925 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:05 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1807937240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:52:05.961 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T16:52:05.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:05.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T16:52:06.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:05 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3073119846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:52:06.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:05 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1807937240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:52:06.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:06.058 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-13T16:52:06.400 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-13T16:52:06.400 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T16:52:06.400 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T16:52:06.401 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T16:52:06.722 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:52:06.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:06 smithi094 ceph-mon[35259]: pgmap v380: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:52:06.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:06 smithi018 ceph-mon[30981]: pgmap v380: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:52:07.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:06 smithi144 ceph-mon[35328]: pgmap v380: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:52:07.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:07 smithi018 ceph-mon[30981]: pgmap v381: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:52:08.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:07 smithi094 ceph-mon[35259]: pgmap v381: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:52:08.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:07 smithi144 ceph-mon[35328]: pgmap v381: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T16:52:08.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.826+0000 7f27d8e00640 1 -- 172.21.15.18:0/69427501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4102200 msgr2=0x7f27d41025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:08.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.826+0000 7f27d8e00640 1 --2- 172.21.15.18:0/69427501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4102200 0x7f27d41025e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009be0 tx=0x7f27c402a6c0 comp rx=0 tx=0).stop 2024-09-13T16:52:08.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.826+0000 7f27d8e00640 1 -- 172.21.15.18:0/69427501 shutdown_connections 2024-09-13T16:52:08.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.826+0000 7f27d8e00640 1 --2- 172.21.15.18:0/69427501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d4107330 0x7f27d410eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:08.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.826+0000 7f27d8e00640 1 --2- 172.21.15.18:0/69427501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d4102bb0 0x7f27d4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:08.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.826+0000 7f27d8e00640 1 --2- 172.21.15.18:0/69427501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4102200 0x7f27d41025e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:08.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.826+0000 7f27d8e00640 1 -- 172.21.15.18:0/69427501 >> 172.21.15.18:0/69427501 conn(0x7f27d40fdc40 msgr2=0x7f27d4100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:08.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.826+0000 7f27d8e00640 1 -- 172.21.15.18:0/69427501 shutdown_connections 2024-09-13T16:52:08.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.826+0000 7f27d8e00640 1 -- 172.21.15.18:0/69427501 wait complete. 2024-09-13T16:52:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.827+0000 7f27d8e00640 1 Processor -- start 2024-09-13T16:52:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.827+0000 7f27d8e00640 1 -- start start 2024-09-13T16:52:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27d8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4102200 0x7f27d4198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27d8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d4102bb0 0x7f27d4198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27d8e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d4107330 0x7f27d419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27d8e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d419d490 con 0x7f27d4102bb0 2024-09-13T16:52:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27d8e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d419d600 con 0x7f27d4107330 2024-09-13T16:52:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27d8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d419d770 con 0x7f27d4102200 2024-09-13T16:52:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27c9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d4102bb0 0x7f27d4198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4102200 0x7f27d4198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27c9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d4102bb0 0x7f27d4198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55792/0 (socket says 172.21.15.18:55792) 2024-09-13T16:52:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27c9400640 1 -- 172.21.15.18:0/1468506192 learned_addr learned my addr 172.21.15.18:0/1468506192 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.828+0000 7f27d2800640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d4107330 0x7f27d419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.829+0000 7f27c9400640 1 -- 172.21.15.18:0/1468506192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4102200 msgr2=0x7f27d4198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.829+0000 7f27c9400640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4102200 0x7f27d4198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.829+0000 7f27c9400640 1 -- 172.21.15.18:0/1468506192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d4107330 msgr2=0x7f27d419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.829+0000 7f27c9400640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d4107330 0x7f27d419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.829+0000 7f27c9400640 1 -- 172.21.15.18:0/1468506192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc009560 con 0x7f27d4102bb0 2024-09-13T16:52:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.829+0000 7f27c9400640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d4102bb0 0x7f27d4198a90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00e9f0 tx=0x7f27bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.829+0000 7f27cb400640 1 -- 172.21.15.18:0/1468506192 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc009700 con 0x7f27d4102bb0 2024-09-13T16:52:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.829+0000 7f27cb400640 1 -- 172.21.15.18:0/1468506192 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27bc00cd80 con 0x7f27d4102bb0 2024-09-13T16:52:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.829+0000 7f27cb400640 1 -- 172.21.15.18:0/1468506192 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc018860 con 0x7f27d4102bb0 2024-09-13T16:52:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.829+0000 7f27d8e00640 1 -- 172.21.15.18:0/1468506192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c4009840 con 0x7f27d4102bb0 2024-09-13T16:52:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.830+0000 7f27d8e00640 1 -- 172.21.15.18:0/1468506192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d41a5140 con 0x7f27d4102bb0 2024-09-13T16:52:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.831+0000 7f27d8e00640 1 -- 172.21.15.18:0/1468506192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d41036e0 con 0x7f27d4102bb0 2024-09-13T16:52:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.832+0000 7f27cb400640 1 -- 172.21.15.18:0/1468506192 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f27bc0189c0 con 0x7f27d4102bb0 2024-09-13T16:52:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.833+0000 7f27cb400640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27b80a1080 0x7f27b80a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.834+0000 7f27cb400640 1 -- 172.21.15.18:0/1468506192 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f27bc014070 con 0x7f27d4102bb0 2024-09-13T16:52:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.834+0000 7f27d1e00640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27b80a1080 0x7f27b80a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.835+0000 7f27d1e00640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27b80a1080 0x7f27b80a3540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f27c4000f80 tx=0x7f27c4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:08.837+0000 7f27cb400640 1 -- 172.21.15.18:0/1468506192 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f27bc052e20 con 0x7f27d4102bb0 2024-09-13T16:52:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.052+0000 7f27d8e00640 1 -- 172.21.15.18:0/1468506192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27d410a510 con 0x7f27d4102bb0 2024-09-13T16:52:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.053+0000 7f27cb400640 1 -- 172.21.15.18:0/1468506192 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+88 (secure 0 0 0) 0x7f27bc0964a0 con 0x7f27d4102bb0 2024-09-13T16:52:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T16:52:09.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.055+0000 7f27d8e00640 1 -- 172.21.15.18:0/1468506192 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27b80a1080 msgr2=0x7f27b80a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:09.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.055+0000 7f27d8e00640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27b80a1080 0x7f27b80a3540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f27c4000f80 tx=0x7f27c4005fd0 comp rx=0 tx=0).stop 2024-09-13T16:52:09.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.055+0000 7f27d8e00640 1 -- 172.21.15.18:0/1468506192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d4102bb0 msgr2=0x7f27d4198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:09.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.055+0000 7f27d8e00640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d4102bb0 0x7f27d4198a90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00e9f0 tx=0x7f27bc00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:52:09.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.055+0000 7f27d8e00640 1 -- 172.21.15.18:0/1468506192 shutdown_connections 2024-09-13T16:52:09.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.055+0000 7f27d8e00640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f27b80a1080 0x7f27b80a3540 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:09.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.055+0000 7f27d8e00640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d4102bb0 0x7f27d4198a90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:09.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.055+0000 7f27d8e00640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d4107330 0x7f27d419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:09.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.055+0000 7f27d8e00640 1 --2- 172.21.15.18:0/1468506192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4102200 0x7f27d4198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:09.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.055+0000 7f27d8e00640 1 -- 172.21.15.18:0/1468506192 >> 172.21.15.18:0/1468506192 conn(0x7f27d40fdc40 msgr2=0x7f27d40ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:09.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.056+0000 7f27d8e00640 1 -- 172.21.15.18:0/1468506192 shutdown_connections 2024-09-13T16:52:09.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:09.056+0000 7f27d8e00640 1 -- 172.21.15.18:0/1468506192 wait complete. 2024-09-13T16:52:09.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:09 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1468506192' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:52:09.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:09 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1468506192' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:52:09.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:09 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1468506192' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T16:52:09.959 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T16:52:09.960 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T16:52:09.960 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-13T16:52:09.960 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T16:52:09.960 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T16:52:09.960 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T16:52:09.960 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T16:52:09.960 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T16:52:09.960 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T16:52:09.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:09.960 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-13T16:52:09.997 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T16:52:09.997 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T16:52:09.997 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T16:52:09.997 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:52:09.997 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-13T16:52:09.997 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:52:09.997 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:52:09.997 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:52:09.998 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-13T16:52:09.998 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:52:09.998 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:52:09.998 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-13T16:52:09.998 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T16:52:09.998 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:52:09.998 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-13T16:52:09.998 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T16:52:09.998 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42092sec preferred_lft 42092sec 2024-09-13T16:52:09.998 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-13T16:52:09.999 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-13T16:52:09.999 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T16:52:09.999 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T16:52:09.999 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-13T16:52:09.999 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T16:52:09.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:09.999 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-09-13T16:52:09.999 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-13T16:52:09.999 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-09-13T16:52:10.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-09-13T16:52:10.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-09-13T16:52:10.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T16:52:10.000 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-13T16:52:10.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:10.172 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T16:52:10.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:10 smithi018 ceph-mon[30981]: pgmap v382: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:52:10.229 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-13T16:52:10.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:10.233 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-13T16:52:10.309 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-13T16:52:10.310 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T16:52:10.310 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T16:52:10.310 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T16:52:10.310 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T16:52:10.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:10.310 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-09-13T16:52:10.311 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-13T16:52:10.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T16:52:10.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T16:52:10.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T16:52:10.311 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-13T16:52:10.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:10 smithi094 ceph-mon[35259]: pgmap v382: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:52:10.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:10.457 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-13T16:52:10.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:10.493 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-13T16:52:10.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:10 smithi144 ceph-mon[35328]: pgmap v382: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:52:10.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:10.568 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-09-13T16:52:10.568 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-13T16:52:10.568 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T16:52:10.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T16:52:10.569 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-13T16:52:10.694 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T16:52:10.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:10.695 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-09-13T16:52:10.695 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-13T16:52:10.695 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T16:52:10.695 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T16:52:10.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T16:52:10.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T16:52:10.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T16:52:10.696 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-13T16:52:10.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:10.866 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-09-13T16:52:10.866 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-13T16:52:10.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-13T16:52:10.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T16:52:10.866 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-13T16:52:10.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:52:10.981 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T16:52:11.016 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T16:52:11.017 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T16:52:11.017 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T16:52:11.094 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-13T16:52:11.094 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-13T16:52:11.094 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/128af822-984c-4fe6-bcab-bd7a84f5173a 2024-09-13T16:52:11.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:11.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/128af822-984c-4fe6-bcab-bd7a84f5173a /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-09-13T16:52:11.224 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-09-13T16:52:11.225 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2024-09-13T16:52:11.225 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-13T16:52:11.915 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-09-13T16:52:11.915 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2024-09-13T16:52:11.915 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-13T16:52:11.915 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.94:6789,172.21.15.144:6789" 2024-09-13T16:52:11.915 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.94:6789,172.21.15.144:6789:/volumes/qa/sv_1/128af822-984c-4fe6-bcab-bd7a84f5173a 2024-09-13T16:52:11.915 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,key=0,fsid=d8ff35a0-71ee-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T16:52:11.917 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T16:52:11.917 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-13T16:52:11.918 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T16:52:11.918 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T16:52:11.918 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T16:52:11.921 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T16:52:11.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:11.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T16:52:11.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:11.986 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:52:12.025 INFO:teuthology.orchestra.run.smithi018.stdout:client25391 2024-09-13T16:52:12.025 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:52:12.025 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:52:12.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:12.102 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:52:12.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:11 smithi094 ceph-mon[35259]: pgmap v383: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:52:12.180 INFO:teuthology.orchestra.run.smithi018.stdout:client25391 2024-09-13T16:52:12.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:12.181 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T16:52:12.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:11 smithi018 ceph-mon[30981]: pgmap v383: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:52:12.247 INFO:teuthology.orchestra.run.smithi018.stdout:client25391 2024-09-13T16:52:12.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:52:12.247 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968.client25391/status') 2024-09-13T16:52:12.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:11 smithi144 ceph-mon[35328]: pgmap v383: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T16:52:12.342 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.25391 (3)172.21.15.18:0/3488992921 2024-09-13T16:52:12.342 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-09-13T16:52:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-09-13T16:52:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-09-13T16:52:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:71 bytes copied, 6.008e-05 s, 1.2 MB/s 2024-09-13T16:52:12.345 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T16:52:12.355 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T16:52:12.356 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T16:52:12.356 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-13T16:52:12.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.510+0000 7f84fdc00640 1 -- 172.21.15.18:0/3341413066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f8101f20 msgr2=0x7f84f8102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.510+0000 7f84fdc00640 1 --2- 172.21.15.18:0/3341413066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f8101f20 0x7f84f8102320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009900 tx=0x7f84e802a400 comp rx=0 tx=0).stop 2024-09-13T16:52:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.511+0000 7f84fdc00640 1 -- 172.21.15.18:0/3341413066 shutdown_connections 2024-09-13T16:52:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.511+0000 7f84fdc00640 1 --2- 172.21.15.18:0/3341413066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84f8103a30 0x7f84f810a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.511+0000 7f84fdc00640 1 --2- 172.21.15.18:0/3341413066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84f8103070 0x7f84f81034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.511+0000 7f84fdc00640 1 --2- 172.21.15.18:0/3341413066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f8101f20 0x7f84f8102320 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.511+0000 7f84fdc00640 1 -- 172.21.15.18:0/3341413066 >> 172.21.15.18:0/3341413066 conn(0x7f84f80fd680 msgr2=0x7f84f80ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.511+0000 7f84fdc00640 1 -- 172.21.15.18:0/3341413066 shutdown_connections 2024-09-13T16:52:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.511+0000 7f84fdc00640 1 -- 172.21.15.18:0/3341413066 wait complete. 2024-09-13T16:52:12.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.512+0000 7f84fdc00640 1 Processor -- start 2024-09-13T16:52:12.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.512+0000 7f84fdc00640 1 -- start start 2024-09-13T16:52:12.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84fdc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f8101f20 0x7f84f8197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:12.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84fdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84f8103070 0x7f84f81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84fdc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84f8103a30 0x7f84f819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84fdc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f819fa70 con 0x7f84f8101f20 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84fdc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f819fbe0 con 0x7f84f8103a30 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84fdc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f819fda0 con 0x7f84f8103070 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f8101f20 0x7f84f8197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f8101f20 0x7f84f8197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53190/0 (socket says 172.21.15.18:53190) 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f6a00640 1 -- 172.21.15.18:0/69549636 learned_addr learned my addr 172.21.15.18:0/69549636 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f7400640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84f8103a30 0x7f84f819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f6000640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84f8103070 0x7f84f81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f6a00640 1 -- 172.21.15.18:0/69549636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84f8103070 msgr2=0x7f84f81984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f6a00640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84f8103070 0x7f84f81984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f6a00640 1 -- 172.21.15.18:0/69549636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84f8103a30 msgr2=0x7f84f819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:12.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f6a00640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84f8103a30 0x7f84f819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:12.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f6a00640 1 -- 172.21.15.18:0/69549636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4009490 con 0x7f84f8101f20 2024-09-13T16:52:12.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.513+0000 7f84f6000640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84f8103070 0x7f84f81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:12.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.514+0000 7f84f6a00640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f8101f20 0x7f84f8197f80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f84e8031500 tx=0x7f84e8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:12.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.514+0000 7f84ef400640 1 -- 172.21.15.18:0/69549636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8003e00 con 0x7f84f8101f20 2024-09-13T16:52:12.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.514+0000 7f84ef400640 1 -- 172.21.15.18:0/69549636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84e8031c70 con 0x7f84f8101f20 2024-09-13T16:52:12.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.514+0000 7f84fdc00640 1 -- 172.21.15.18:0/69549636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e8009560 con 0x7f84f8101f20 2024-09-13T16:52:12.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.514+0000 7f84ef400640 1 -- 172.21.15.18:0/69549636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e803bd80 con 0x7f84f8101f20 2024-09-13T16:52:12.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.514+0000 7f84fdc00640 1 -- 172.21.15.18:0/69549636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f81a0390 con 0x7f84f8101f20 2024-09-13T16:52:12.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.515+0000 7f84fdc00640 1 -- 172.21.15.18:0/69549636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f8109340 con 0x7f84f8101f20 2024-09-13T16:52:12.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.518+0000 7f84ef400640 1 -- 172.21.15.18:0/69549636 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f84e803b460 con 0x7f84f8101f20 2024-09-13T16:52:12.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.520+0000 7f84ef400640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f84dc0a1110 0x7f84dc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:12.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.520+0000 7f84ef400640 1 -- 172.21.15.18:0/69549636 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f84e80ed600 con 0x7f84f8101f20 2024-09-13T16:52:12.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.520+0000 7f84f6000640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f84dc0a1110 0x7f84dc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:12.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.521+0000 7f84f6000640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f84dc0a1110 0x7f84dc0a35d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f84f8199490 tx=0x7f84e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:12.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.524+0000 7f84ef400640 1 -- 172.21.15.18:0/69549636 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f84e80b69d0 con 0x7f84f8101f20 2024-09-13T16:52:12.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.743+0000 7f84fdc00640 1 -- 172.21.15.18:0/69549636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) v1 -- 0x7f84f810d850 con 0x7f84f8101f20 2024-09-13T16:52:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.892+0000 7f84ef400640 1 -- 172.21.15.18:0/69549636 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) v1 ==== 117+0+0 (secure 0 0 0) 0x7f84e80b9ff0 con 0x7f84f8101f20 2024-09-13T16:52:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 -- 172.21.15.18:0/69549636 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f84dc0a1110 msgr2=0x7f84dc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f84dc0a1110 0x7f84dc0a35d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f84f8199490 tx=0x7f84e4005f90 comp rx=0 tx=0).stop 2024-09-13T16:52:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 -- 172.21.15.18:0/69549636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f8101f20 msgr2=0x7f84f8197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f8101f20 0x7f84f8197f80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f84e8031500 tx=0x7f84e8003c10 comp rx=0 tx=0).stop 2024-09-13T16:52:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 -- 172.21.15.18:0/69549636 shutdown_connections 2024-09-13T16:52:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84f8103a30 0x7f84f819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84f8103070 0x7f84f81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f84dc0a1110 0x7f84dc0a35d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 --2- 172.21.15.18:0/69549636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f8101f20 0x7f84f8197f80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 -- 172.21.15.18:0/69549636 >> 172.21.15.18:0/69549636 conn(0x7f84f80fd680 msgr2=0x7f84f8106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 -- 172.21.15.18:0/69549636 shutdown_connections 2024-09-13T16:52:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T16:52:12.895+0000 7f84fdc00640 1 -- 172.21.15.18:0/69549636 wait complete. 2024-09-13T16:52:12.912 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-13T16:52:12.947 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-13T16:52:12.955 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T16:52:12.956 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-13T16:52:12.960 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T16:52:12.973 INFO:tasks.workunit:Pulling workunits from ref 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:52:12.974 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T16:52:12.974 INFO:tasks.workunit:timeout=3h 2024-09-13T16:52:12.974 INFO:tasks.workunit:cleanup=True 2024-09-13T16:52:12.974 DEBUG:teuthology.orchestra.run.smithi018:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T16:52:13.010 INFO:teuthology.orchestra.run.smithi018.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T16:52:13.010 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T16:52:13.010 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-13T16:52:13.010 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:52:13.010 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T16:52:13.010 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-13 16:49:59.449688058 +0000 2024-09-13T16:52:13.010 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-13 16:49:59.449688058 +0000 2024-09-13T16:52:13.010 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-13 16:52:11.976152833 +0000 2024-09-13T16:52:13.010 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-13 16:49:59.449688058 +0000 2024-09-13T16:52:13.011 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T16:52:13.011 DEBUG:teuthology.orchestra.run.smithi018:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T16:52:13.116 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T16:52:13.154 INFO:tasks.workunit.client.0.smithi018.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T16:52:13.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:12 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/69549636' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T16:52:13.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:12 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/69549636' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T16:52:13.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:12 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/69549636' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T16:52:14.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:13 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/69549636' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-13T16:52:14.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:13 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:52:14.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:13 smithi094 ceph-mon[35259]: pgmap v384: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T16:52:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:13 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/69549636' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-13T16:52:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:13 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:52:14.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:13 smithi018 ceph-mon[30981]: pgmap v384: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T16:52:14.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:13 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/69549636' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-13T16:52:14.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:13 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:52:14.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:13 smithi144 ceph-mon[35328]: pgmap v384: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T16:52:16.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:15 smithi094 ceph-mon[35259]: pgmap v385: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T16:52:16.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:15 smithi018 ceph-mon[30981]: pgmap v385: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T16:52:16.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:15 smithi144 ceph-mon[35328]: pgmap v385: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T16:52:17.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:17 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:52:17.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:17 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:52:18.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:17 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:52:18.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:18 smithi094 ceph-mon[35259]: pgmap v386: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-13T16:52:18.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:18 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:18.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:18 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:18.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:18 smithi018 ceph-mon[30981]: pgmap v386: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-13T16:52:18.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:18 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:18.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:18 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:19.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:18 smithi144 ceph-mon[35328]: pgmap v386: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-13T16:52:19.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:18 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:19.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:18 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:19 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:19 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:19 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:19 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:19 smithi018 ceph-mon[30981]: pgmap v387: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-13T16:52:20.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:19 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:19 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:19 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:19 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:19 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:19 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:19 smithi144 ceph-mon[35328]: pgmap v387: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-13T16:52:20.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:19 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:19 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:19 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:19 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:19 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:19 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:19 smithi094 ceph-mon[35259]: pgmap v387: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-13T16:52:20.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:19 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:20.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:19 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:21.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:52:21.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:52:21.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:21.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:52:21.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:52:21.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:21.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:52:21.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:52:21.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:52:22.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:21 smithi144 ceph-mon[35328]: pgmap v388: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-13T16:52:22.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:21 smithi094 ceph-mon[35259]: pgmap v388: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-13T16:52:22.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:21 smithi018 ceph-mon[30981]: pgmap v388: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-13T16:52:24.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:23 smithi094 ceph-mon[35259]: pgmap v389: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-13T16:52:24.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:23 smithi018 ceph-mon[30981]: pgmap v389: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-13T16:52:24.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:23 smithi144 ceph-mon[35328]: pgmap v389: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-13T16:52:26.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:25 smithi094 ceph-mon[35259]: pgmap v390: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-13T16:52:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.160+0000 7f0e1f200640 1 -- 172.21.15.18:0/3598670382 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e18101f20 msgr2=0x7f0e18102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.160+0000 7f0e1f200640 1 --2- 172.21.15.18:0/3598670382 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e18101f20 0x7f0e18102320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009900 tx=0x7f0e0802a400 comp rx=0 tx=0).stop 2024-09-13T16:52:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.160+0000 7f0e1f200640 1 -- 172.21.15.18:0/3598670382 shutdown_connections 2024-09-13T16:52:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.160+0000 7f0e1f200640 1 --2- 172.21.15.18:0/3598670382 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e18103a30 0x7f0e1810a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.160+0000 7f0e1f200640 1 --2- 172.21.15.18:0/3598670382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e18103070 0x7f0e181034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.160+0000 7f0e1f200640 1 --2- 172.21.15.18:0/3598670382 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e18101f20 0x7f0e18102320 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.160+0000 7f0e1f200640 1 -- 172.21.15.18:0/3598670382 >> 172.21.15.18:0/3598670382 conn(0x7f0e180fd680 msgr2=0x7f0e180ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.160+0000 7f0e1f200640 1 -- 172.21.15.18:0/3598670382 shutdown_connections 2024-09-13T16:52:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.160+0000 7f0e1f200640 1 -- 172.21.15.18:0/3598670382 wait complete. 2024-09-13T16:52:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.161+0000 7f0e1f200640 1 Processor -- start 2024-09-13T16:52:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.161+0000 7f0e1f200640 1 -- start start 2024-09-13T16:52:26.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.161+0000 7f0e1f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e18101f20 0x7f0e18197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.161+0000 7f0e1f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e18103070 0x7f0e18198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.161+0000 7f0e1f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e18103a30 0x7f0e1819f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.161+0000 7f0e1f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1819fa30 con 0x7f0e18101f20 2024-09-13T16:52:26.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.161+0000 7f0e1f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1819fba0 con 0x7f0e18103a30 2024-09-13T16:52:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.161+0000 7f0e1f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1819fd60 con 0x7f0e18103070 2024-09-13T16:52:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.161+0000 7f0e17e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e18101f20 0x7f0e18197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.161+0000 7f0e0fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e18103070 0x7f0e18198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e17e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e18101f20 0x7f0e18197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43098/0 (socket says 172.21.15.18:43098) 2024-09-13T16:52:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e17e00640 1 -- 172.21.15.18:0/1903441012 learned_addr learned my addr 172.21.15.18:0/1903441012 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e0fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e18103070 0x7f0e18198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:58814/0 (socket says 172.21.15.18:58814) 2024-09-13T16:52:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e1d200640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e18103a30 0x7f0e1819f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e0fe00640 1 -- 172.21.15.18:0/1903441012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e18103a30 msgr2=0x7f0e1819f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e0fe00640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e18103a30 0x7f0e1819f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e0fe00640 1 -- 172.21.15.18:0/1903441012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e18101f20 msgr2=0x7f0e18197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e0fe00640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e18101f20 0x7f0e18197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e0fe00640 1 -- 172.21.15.18:0/1903441012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e08009560 con 0x7f0e18103070 2024-09-13T16:52:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e1d200640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e18103a30 0x7f0e1819f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e0fe00640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e18103070 0x7f0e18198480 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000e9c0 tx=0x7f0e0000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.162+0000 7f0e15600640 1 -- 172.21.15.18:0/1903441012 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0000ccc0 con 0x7f0e18103070 2024-09-13T16:52:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.163+0000 7f0e15600640 1 -- 172.21.15.18:0/1903441012 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e000044f0 con 0x7f0e18103070 2024-09-13T16:52:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.163+0000 7f0e15600640 1 -- 172.21.15.18:0/1903441012 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00010430 con 0x7f0e18103070 2024-09-13T16:52:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.163+0000 7f0e1f200640 1 -- 172.21.15.18:0/1903441012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1819ffe0 con 0x7f0e18103070 2024-09-13T16:52:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.163+0000 7f0e1f200640 1 -- 172.21.15.18:0/1903441012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e181a0470 con 0x7f0e18103070 2024-09-13T16:52:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e22087740 1 Processor -- start 2024-09-13T16:52:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e22087740 1 -- start start 2024-09-13T16:52:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e15600640 1 -- 172.21.15.18:0/1903441012 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0e00003f30 con 0x7f0e18103070 2024-09-13T16:52:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e22087740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b1a70 0x5579949b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e22087740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b23b0 0x5579949b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e22087740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b7440 0x5579949b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e22087740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579948bdbb0 con 0x5579949b1a70 2024-09-13T16:52:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e22087740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799491ba70 con 0x5579949b7440 2024-09-13T16:52:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e22087740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557994919200 con 0x5579949b23b0 2024-09-13T16:52:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e1d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b1a70 0x5579949b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e1d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b1a70 0x5579949b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43100/0 (socket says 172.21.15.18:43100) 2024-09-13T16:52:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e1d200640 1 -- 172.21.15.18:0/975060374 learned_addr learned my addr 172.21.15.18:0/975060374 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e17e00640 1 --2- 172.21.15.18:0/975060374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b23b0 0x5579949b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.166+0000 7f0e0fe00640 1 --2- 172.21.15.18:0/975060374 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b7440 0x5579949b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.167+0000 7f0e1d200640 1 -- 172.21.15.18:0/975060374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b23b0 msgr2=0x5579949b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.167+0000 7f0e1d200640 1 --2- 172.21.15.18:0/975060374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b23b0 0x5579949b6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.167+0000 7f0e1d200640 1 -- 172.21.15.18:0/975060374 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b7440 msgr2=0x5579949b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.167+0000 7f0e1d200640 1 --2- 172.21.15.18:0/975060374 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b7440 0x5579949b9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.167+0000 7f0e1d200640 1 -- 172.21.15.18:0/975060374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579948b6940 con 0x5579949b1a70 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.167+0000 7f0e0fe00640 1 --2- 172.21.15.18:0/975060374 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b7440 0x5579949b9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.167+0000 7f0e1d200640 1 --2- 172.21.15.18:0/975060374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b1a70 0x5579949b1e70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009fd0 tx=0x7f0e100108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2a7c7f37fda949 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.167+0000 7f0e0d600640 1 -- 172.21.15.18:0/975060374 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10011760 con 0x5579949b1a70 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.167+0000 7f0e15600640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0dfc0a1110 0x7f0dfc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.167+0000 7f0e0d600640 1 -- 172.21.15.18:0/975060374 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e10015070 con 0x5579949b1a70 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e0d600640 1 -- 172.21.15.18:0/975060374 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1001bd40 con 0x5579949b1a70 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e15600640 1 -- 172.21.15.18:0/1903441012 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0e00014070 con 0x7f0e18103070 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e17e00640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0dfc0a1110 0x7f0dfc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e22087740 1 -- 172.21.15.18:0/975060374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b1a70 msgr2=0x5579949b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e22087740 1 --2- 172.21.15.18:0/975060374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b1a70 0x5579949b1e70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009fd0 tx=0x7f0e100108e0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e22087740 1 -- 172.21.15.18:0/975060374 shutdown_connections 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e22087740 1 --2- 172.21.15.18:0/975060374 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b7440 0x5579949b9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e22087740 1 --2- 172.21.15.18:0/975060374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b23b0 0x5579949b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e22087740 1 --2- 172.21.15.18:0/975060374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b1a70 0x5579949b1e70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e22087740 1 -- 172.21.15.18:0/975060374 >> 172.21.15.18:0/975060374 conn(0x5579949ad0e0 msgr2=0x5579949ad4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e22087740 1 -- 172.21.15.18:0/975060374 shutdown_connections 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.168+0000 7f0e22087740 1 -- 172.21.15.18:0/975060374 wait complete. 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.169+0000 7f0e17e00640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0dfc0a1110 0x7f0dfc0a35d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5579949b2de0 tx=0x7f0e08005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.169+0000 7f0e22087740 1 -- start start 2024-09-13T16:52:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.169+0000 7f0e22087740 1 Processor -- start 2024-09-13T16:52:26.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e22087740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 0x5579949bb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e22087740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949bbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e22087740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e22087740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557994914af0 con 0x5579949b23b0 2024-09-13T16:52:26.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e22087740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579948d2f20 con 0x5579949b1a70 2024-09-13T16:52:26.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e22087740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579948d2bc0 con 0x5579949b7440 2024-09-13T16:52:26.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e22087740 10 client.0 _ll_register_callbacks cb 0x557994904a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:26.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e0fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949bbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:58824/0 (socket says 172.21.15.18:58824) 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e1d200640 1 -- 172.21.15.18:0/3172703278 learned_addr learned my addr 172.21.15.18:0/3172703278 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e17e00640 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 0x5579949bb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e1d200640 1 -- 172.21.15.18:0/3172703278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 msgr2=0x5579949bb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e1d200640 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 0x5579949bb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e1d200640 1 -- 172.21.15.18:0/3172703278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 msgr2=0x5579949bbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e1d200640 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949bbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e1d200640 1 -- 172.21.15.18:0/3172703278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e10009cb0 con 0x5579949b7440 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.170+0000 7f0e0fe00640 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949bbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.171+0000 7f0e1d200640 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949c2c90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0e10006010 tx=0x7f0e10004c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce55d0010e42076d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:26.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.171+0000 7f0e06000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.171+0000 7f0e06000640 1 -- 172.21.15.18:0/3172703278 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10021070 con 0x5579949b7440 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.171+0000 7f0e06000640 1 -- 172.21.15.18:0/3172703278 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0e10017070 con 0x5579949b7440 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.171+0000 7f0e22087740 1 -- 172.21.15.18:0/3172703278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55799493ec90 con 0x5579949b7440 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.171+0000 7f0e06000640 1 -- 172.21.15.18:0/3172703278 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e10004e90 con 0x5579949b7440 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.171+0000 7f0e22087740 10 client.25384 fetch_fsmap learned FSMap version 25 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.171+0000 7f0e22087740 1 -- 172.21.15.18:0/3172703278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x557994913170 con 0x5579949b7440 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.172+0000 7f0e06000640 1 -- 172.21.15.18:0/3172703278 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55799493ec90 con 0x5579949b7440 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.172+0000 7f0e06000640 1 -- 172.21.15.18:0/3172703278 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0e100051e0 con 0x5579949b7440 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.172+0000 7f0e22087740 10 client.25384 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.172+0000 7f0e22087740 10 client.25384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.172+0000 7f0e22087740 20 client.25384 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:26.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.172+0000 7f0e22087740 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5579949c7260 0x5579949c9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.172+0000 7f0e22087740 4 client.25384 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.172+0000 7f0e22087740 1 -- 172.21.15.18:0/3172703278 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5579949077d0 con 0x5579949c7260 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.172+0000 7f0e17e00640 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5579949c7260 0x5579949c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.173+0000 7f0e17e00640 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5579949c7260 0x5579949c9680 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dafd4b3beabae476 server_cookie=95cc4b3f5791a40e in_seq=0 out_seq=0 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.173+0000 7f0e06000640 10 client.25384 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e06000640 1 -- 172.21.15.18:0/3172703278 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5579949077d0 con 0x5579949c7260 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e06000640 10 client.25384 handle_command_reply: tid=0 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 client.25384 shutdown 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 -- 172.21.15.18:0/3172703278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 msgr2=0x5579949c2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949c2c90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0e10006010 tx=0x7f0e10004c70 comp rx=0 tx=0).stop 2024-09-13T16:52:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 -- 172.21.15.18:0/3172703278 shutdown_connections 2024-09-13T16:52:26.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5579949c7260 0x5579949c9680 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949bbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949c2c90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 --2- 172.21.15.18:0/3172703278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 0x5579949bb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 -- 172.21.15.18:0/3172703278 >> 172.21.15.18:0/3172703278 conn(0x5579949ad0e0 msgr2=0x5579949ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:26.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e06000640 0 client.25384 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:26.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 -- 172.21.15.18:0/3172703278 shutdown_connections 2024-09-13T16:52:26.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 1 -- 172.21.15.18:0/3172703278 wait complete. 2024-09-13T16:52:26.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.174+0000 7f0e22087740 20 client.25384 trim_cache size 0 max 16384 2024-09-13T16:52:26.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.187+0000 7f0e22087740 1 Processor -- start 2024-09-13T16:52:26.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e22087740 1 -- start start 2024-09-13T16:52:26.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e22087740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 0x5579949b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e22087740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e22087740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e22087740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799467be60 con 0x5579949b23b0 2024-09-13T16:52:26.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e22087740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579949aca20 con 0x5579949b1a70 2024-09-13T16:52:26.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e22087740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579949a8950 con 0x5579949b7440 2024-09-13T16:52:26.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e0fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e0fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949c2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43124/0 (socket says 172.21.15.18:43124) 2024-09-13T16:52:26.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949b6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:58826/0 (socket says 172.21.15.18:58826) 2024-09-13T16:52:26.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e17e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 0x5579949b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e0fe00640 1 -- 172.21.15.18:0/2247072901 learned_addr learned my addr 172.21.15.18:0/2247072901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e1d200640 1 -- 172.21.15.18:0/2247072901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 msgr2=0x5579949b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e1d200640 1 --2- 172.21.15.18:0/2247072901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 0x5579949b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e1d200640 1 -- 172.21.15.18:0/2247072901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 msgr2=0x5579949c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e1d200640 1 --2- 172.21.15.18:0/2247072901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e1d200640 1 -- 172.21.15.18:0/2247072901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579948b5180 con 0x5579949b7440 2024-09-13T16:52:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e0fe00640 1 --2- 172.21.15.18:0/2247072901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.188+0000 7f0e17e00640 1 --2- 172.21.15.18:0/2247072901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 0x5579949b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.189+0000 7f0e1d200640 1 --2- 172.21.15.18:0/2247072901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949b6df0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005c10 tx=0x7f0e10009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2e57953836e8783 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.189+0000 7f0e0e000640 1 -- 172.21.15.18:0/2247072901 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10021070 con 0x5579949b7440 2024-09-13T16:52:26.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.189+0000 7f0e0e000640 1 -- 172.21.15.18:0/2247072901 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e10009ed0 con 0x5579949b7440 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.189+0000 7f0e0e000640 1 -- 172.21.15.18:0/2247072901 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10004ce0 con 0x5579949b7440 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 -- 172.21.15.18:0/2247072901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 msgr2=0x5579949b6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 --2- 172.21.15.18:0/2247072901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949b6df0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005c10 tx=0x7f0e10009650 comp rx=0 tx=0).stop 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 -- 172.21.15.18:0/2247072901 shutdown_connections 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 --2- 172.21.15.18:0/2247072901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b23b0 0x5579949c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 --2- 172.21.15.18:0/2247072901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b7440 0x5579949b6df0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 --2- 172.21.15.18:0/2247072901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b1a70 0x5579949b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 -- 172.21.15.18:0/2247072901 >> 172.21.15.18:0/2247072901 conn(0x5579949ad0e0 msgr2=0x5579949cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 -- 172.21.15.18:0/2247072901 shutdown_connections 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 -- 172.21.15.18:0/2247072901 wait complete. 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 -- start start 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.190+0000 7f0e22087740 1 Processor -- start 2024-09-13T16:52:26.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e22087740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b1a70 0x5579949c0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e22087740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b23b0 0x5579949c1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e22087740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b7440 0x5579949c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e22087740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579949c26c0 con 0x5579949b7440 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e22087740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579949c2830 con 0x5579949b23b0 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e22087740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579949c29f0 con 0x5579949b1a70 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e22087740 10 client.0 _ll_register_callbacks cb 0x7f0e10009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b1a70 0x5579949c0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b1a70 0x5579949c0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:58828/0 (socket says 172.21.15.18:58828) 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e17e00640 1 -- 172.21.15.18:0/2194198231 learned_addr learned my addr 172.21.15.18:0/2194198231 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e0fe00640 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b23b0 0x5579949c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e1d200640 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b7440 0x5579949c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e17e00640 1 -- 172.21.15.18:0/2194198231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b23b0 msgr2=0x5579949c1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e17e00640 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b23b0 0x5579949c1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e17e00640 1 -- 172.21.15.18:0/2194198231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b7440 msgr2=0x5579949c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e17e00640 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b7440 0x5579949c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.191+0000 7f0e17e00640 1 -- 172.21.15.18:0/2194198231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1810ac80 con 0x5579949b1a70 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.192+0000 7f0e17e00640 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b1a70 0x5579949c0c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0e08031500 tx=0x7f0e08009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea90dd44ef1e07b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.192+0000 7f0e06000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.192+0000 7f0e06000640 1 -- 172.21.15.18:0/2194198231 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0804d040 con 0x5579949b1a70 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.192+0000 7f0e22087740 1 -- 172.21.15.18:0/2194198231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e10015070 con 0x5579949b1a70 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.192+0000 7f0e06000640 1 -- 172.21.15.18:0/2194198231 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0e080538b0 con 0x5579949b1a70 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.192+0000 7f0e06000640 1 -- 172.21.15.18:0/2194198231 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e080315a0 con 0x5579949b1a70 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.192+0000 7f0e22087740 10 client.25390 fetch_fsmap learned FSMap version 25 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.192+0000 7f0e22087740 1 -- 172.21.15.18:0/2194198231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f0e181a0470 con 0x5579949b1a70 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.192+0000 7f0e06000640 1 -- 172.21.15.18:0/2194198231 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e10015070 con 0x5579949b1a70 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.192+0000 7f0e06000640 1 -- 172.21.15.18:0/2194198231 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0e0803d830 con 0x5579949b1a70 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.193+0000 7f0e22087740 10 client.25390 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:52:26.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.193+0000 7f0e22087740 10 client.25390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:52:26.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.193+0000 7f0e22087740 20 client.25390 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:26.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.193+0000 7f0e22087740 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557994a1ea40 0x557994a20e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:26.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.193+0000 7f0e22087740 4 client.25390 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:52:26.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.193+0000 7f0e22087740 1 -- 172.21.15.18:0/2194198231 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557994608300 con 0x557994a1ea40 2024-09-13T16:52:26.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.193+0000 7f0e0fe00640 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557994a1ea40 0x557994a20e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:26.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.193+0000 7f0e0fe00640 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557994a1ea40 0x557994a20e60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f521164149f7c103 server_cookie=5f2cd3f6736dd0fa in_seq=0 out_seq=0 2024-09-13T16:52:26.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.193+0000 7f0e06000640 10 client.25390 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e06000640 1 -- 172.21.15.18:0/2194198231 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557994608300 con 0x557994a1ea40 2024-09-13T16:52:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e06000640 10 client.25390 handle_command_reply: tid=0 2024-09-13T16:52:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e22087740 1 client.25390 shutdown 2024-09-13T16:52:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e22087740 1 -- 172.21.15.18:0/2194198231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b1a70 msgr2=0x5579949c0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e22087740 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b1a70 0x5579949c0c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0e08031500 tx=0x7f0e08009260 comp rx=0 tx=0).stop 2024-09-13T16:52:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e22087740 1 -- 172.21.15.18:0/2194198231 shutdown_connections 2024-09-13T16:52:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e22087740 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557994a1ea40 0x557994a20e60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e22087740 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579949b7440 0x5579949c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e22087740 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5579949b23b0 0x5579949c1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e22087740 1 --2- 172.21.15.18:0/2194198231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5579949b1a70 0x5579949c0c30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e06000640 0 client.25390 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e22087740 1 -- 172.21.15.18:0/2194198231 >> 172.21.15.18:0/2194198231 conn(0x5579949ad0e0 msgr2=0x5579949b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.206+0000 7f0e22087740 1 -- 172.21.15.18:0/2194198231 shutdown_connections 2024-09-13T16:52:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e22087740 1 -- 172.21.15.18:0/2194198231 wait complete. 2024-09-13T16:52:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e22087740 20 client.25390 trim_cache size 0 max 16384 2024-09-13T16:52:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:52:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:52:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:52:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:52:26.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:25 smithi018 ceph-mon[30981]: pgmap v390: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-13T16:52:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e1f200640 1 -- 172.21.15.18:0/1903441012 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0dfc0a1110 msgr2=0x7f0dfc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e1f200640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0dfc0a1110 0x7f0dfc0a35d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5579949b2de0 tx=0x7f0e08005780 comp rx=0 tx=0).stop 2024-09-13T16:52:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e1f200640 1 -- 172.21.15.18:0/1903441012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e18103070 msgr2=0x7f0e18198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e1f200640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e18103070 0x7f0e18198480 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000e9c0 tx=0x7f0e0000ee80 comp rx=0 tx=0).stop 2024-09-13T16:52:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e1f200640 1 -- 172.21.15.18:0/1903441012 shutdown_connections 2024-09-13T16:52:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e1f200640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e18103a30 0x7f0e1819f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e1f200640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e18103070 0x7f0e18198480 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e1f200640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0dfc0a1110 0x7f0dfc0a35d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e1f200640 1 --2- 172.21.15.18:0/1903441012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e18101f20 0x7f0e18197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.207+0000 7f0e1f200640 1 -- 172.21.15.18:0/1903441012 >> 172.21.15.18:0/1903441012 conn(0x7f0e180fd680 msgr2=0x7f0e18106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.208+0000 7f0e1f200640 1 -- 172.21.15.18:0/1903441012 shutdown_connections 2024-09-13T16:52:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:26.208+0000 7f0e1f200640 1 -- 172.21.15.18:0/1903441012 wait complete. 2024-09-13T16:52:26.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:25 smithi144 ceph-mon[35328]: pgmap v390: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-13T16:52:28.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:27 smithi094 ceph-mon[35259]: pgmap v391: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:52:28.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:27 smithi018 ceph-mon[30981]: pgmap v391: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:52:28.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:27 smithi144 ceph-mon[35328]: pgmap v391: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:52:30.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:29 smithi094 ceph-mon[35259]: pgmap v392: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-13T16:52:30.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:29 smithi018 ceph-mon[30981]: pgmap v392: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-13T16:52:30.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:29 smithi144 ceph-mon[35328]: pgmap v392: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-13T16:52:32.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:31 smithi094 ceph-mon[35259]: pgmap v393: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-13T16:52:32.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:31 smithi018 ceph-mon[30981]: pgmap v393: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-13T16:52:32.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:31 smithi144 ceph-mon[35328]: pgmap v393: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-13T16:52:34.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:33 smithi094 ceph-mon[35259]: pgmap v394: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:34.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:33 smithi018 ceph-mon[30981]: pgmap v394: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:34.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:33 smithi144 ceph-mon[35328]: pgmap v394: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:36.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:35 smithi094 ceph-mon[35259]: pgmap v395: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:35 smithi018 ceph-mon[30981]: pgmap v395: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:36.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:35 smithi144 ceph-mon[35328]: pgmap v395: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:37 smithi094 ceph-mon[35259]: pgmap v396: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:38.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:37 smithi018 ceph-mon[30981]: pgmap v396: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:38.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:37 smithi144 ceph-mon[35328]: pgmap v396: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.328+0000 7f2550a00640 1 -- 172.21.15.18:0/1908466236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f254c0744f0 msgr2=0x7f254c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.328+0000 7f2550a00640 1 --2- 172.21.15.18:0/1908466236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f254c0744f0 0x7f254c072940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f253c009900 tx=0x7f253c02a410 comp rx=0 tx=0).stop 2024-09-13T16:52:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.329+0000 7f2550a00640 1 -- 172.21.15.18:0/1908466236 shutdown_connections 2024-09-13T16:52:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.329+0000 7f2550a00640 1 --2- 172.21.15.18:0/1908466236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f254c10c2e0 0x7f254c10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.329+0000 7f2550a00640 1 --2- 172.21.15.18:0/1908466236 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f254c072f10 0x7f254c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.329+0000 7f2550a00640 1 --2- 172.21.15.18:0/1908466236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f254c0744f0 0x7f254c072940 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.329+0000 7f2550a00640 1 -- 172.21.15.18:0/1908466236 >> 172.21.15.18:0/1908466236 conn(0x7f254c0fb4b0 msgr2=0x7f254c0fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.329+0000 7f2550a00640 1 -- 172.21.15.18:0/1908466236 shutdown_connections 2024-09-13T16:52:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.329+0000 7f2550a00640 1 -- 172.21.15.18:0/1908466236 wait complete. 2024-09-13T16:52:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f2550a00640 1 Processor -- start 2024-09-13T16:52:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f2550a00640 1 -- start start 2024-09-13T16:52:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f2550a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f254c072f10 0x7f254c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f2550a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f254c0744f0 0x7f254c19c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f2550a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f254c10c2e0 0x7f254c1a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f2550a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c1a3e20 con 0x7f254c10c2e0 2024-09-13T16:52:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f2550a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c1a3f90 con 0x7f254c072f10 2024-09-13T16:52:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f2550a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c1a4150 con 0x7f254c0744f0 2024-09-13T16:52:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f254a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f254c10c2e0 0x7f254c1a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f2549e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f254c072f10 0x7f254c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f254a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f254c10c2e0 0x7f254c1a38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37438/0 (socket says 172.21.15.18:37438) 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.330+0000 7f254a800640 1 -- 172.21.15.18:0/1899033450 learned_addr learned my addr 172.21.15.18:0/1899033450 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.331+0000 7f2549400640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f254c0744f0 0x7f254c19c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.331+0000 7f2549e00640 1 -- 172.21.15.18:0/1899033450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f254c0744f0 msgr2=0x7f254c19c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.331+0000 7f2549e00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f254c0744f0 0x7f254c19c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.331+0000 7f2549e00640 1 -- 172.21.15.18:0/1899033450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f254c10c2e0 msgr2=0x7f254c1a38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.331+0000 7f2549e00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f254c10c2e0 0x7f254c1a38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.331+0000 7f2549e00640 1 -- 172.21.15.18:0/1899033450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c009560 con 0x7f254c072f10 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.331+0000 7f2549e00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f254c072f10 0x7f254c19c330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f253c02a930 tx=0x7f253c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.331+0000 7f2542a00640 1 -- 172.21.15.18:0/1899033450 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c003e00 con 0x7f254c072f10 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.332+0000 7f2550a00640 1 -- 172.21.15.18:0/1899033450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c1a43d0 con 0x7f254c072f10 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.332+0000 7f2550a00640 1 -- 172.21.15.18:0/1899033450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c1a48a0 con 0x7f254c072f10 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.332+0000 7f2542a00640 1 -- 172.21.15.18:0/1899033450 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f253c031c70 con 0x7f254c072f10 2024-09-13T16:52:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.332+0000 7f2542a00640 1 -- 172.21.15.18:0/1899033450 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c03bb70 con 0x7f254c072f10 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.335+0000 7f255383b740 1 Processor -- start 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.335+0000 7f255383b740 1 -- start start 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.335+0000 7f2542a00640 1 -- 172.21.15.18:0/1899033450 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f253c03bcd0 con 0x7f254c072f10 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.335+0000 7f255383b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d34e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.335+0000 7f255383b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 0x5633f6d39e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.335+0000 7f255383b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d3c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.335+0000 7f255383b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6c40bb0 con 0x5633f6d34a70 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.335+0000 7f255383b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6c9ea70 con 0x5633f6d3a440 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.335+0000 7f255383b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6c9c200 con 0x5633f6d353b0 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.335+0000 7f254a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d34e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.336+0000 7f254a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d34e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37450/0 (socket says 172.21.15.18:37450) 2024-09-13T16:52:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.336+0000 7f254a800640 1 -- 172.21.15.18:0/2744646364 learned_addr learned my addr 172.21.15.18:0/2744646364 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.336+0000 7f2549e00640 1 --2- 172.21.15.18:0/2744646364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 0x5633f6d39e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.336+0000 7f2549400640 1 --2- 172.21.15.18:0/2744646364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d3c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.336+0000 7f254a800640 1 -- 172.21.15.18:0/2744646364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 msgr2=0x5633f6d39e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.336+0000 7f254a800640 1 --2- 172.21.15.18:0/2744646364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 0x5633f6d39e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.336+0000 7f254a800640 1 -- 172.21.15.18:0/2744646364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 msgr2=0x5633f6d3c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.336+0000 7f254a800640 1 --2- 172.21.15.18:0/2744646364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d3c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.336+0000 7f254a800640 1 -- 172.21.15.18:0/2744646364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633f6c39940 con 0x5633f6d34a70 2024-09-13T16:52:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.336+0000 7f254a800640 1 --2- 172.21.15.18:0/2744646364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d34e70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2544011570 tx=0x7f2544011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb43c65bb01bec68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.337+0000 7f2537400640 1 -- 172.21.15.18:0/2744646364 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544004b20 con 0x5633f6d34a70 2024-09-13T16:52:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.337+0000 7f2537400640 1 -- 172.21.15.18:0/2744646364 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2544004c80 con 0x5633f6d34a70 2024-09-13T16:52:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.337+0000 7f2537400640 1 -- 172.21.15.18:0/2744646364 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544005420 con 0x5633f6d34a70 2024-09-13T16:52:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.337+0000 7f2542a00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25300a1110 0x7f25300a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.337+0000 7f255383b740 1 -- 172.21.15.18:0/2744646364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 msgr2=0x5633f6d34e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.337+0000 7f255383b740 1 --2- 172.21.15.18:0/2744646364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d34e70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2544011570 tx=0x7f2544011a30 comp rx=0 tx=0).stop 2024-09-13T16:52:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.337+0000 7f2542a00640 1 -- 172.21.15.18:0/1899033450 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f253c0ecff0 con 0x7f254c072f10 2024-09-13T16:52:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.337+0000 7f2549e00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25300a1110 0x7f25300a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.338+0000 7f255383b740 1 -- 172.21.15.18:0/2744646364 shutdown_connections 2024-09-13T16:52:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.338+0000 7f255383b740 1 --2- 172.21.15.18:0/2744646364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d3c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.338+0000 7f255383b740 1 --2- 172.21.15.18:0/2744646364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 0x5633f6d39e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.338+0000 7f255383b740 1 --2- 172.21.15.18:0/2744646364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d34e70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.338+0000 7f255383b740 1 -- 172.21.15.18:0/2744646364 >> 172.21.15.18:0/2744646364 conn(0x5633f6d300e0 msgr2=0x5633f6d304e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.338+0000 7f255383b740 1 -- 172.21.15.18:0/2744646364 shutdown_connections 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.338+0000 7f255383b740 1 -- 172.21.15.18:0/2744646364 wait complete. 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.338+0000 7f2549e00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25300a1110 0x7f25300a35d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f253c0b6bc0 tx=0x7f253c0f0a10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.338+0000 7f255383b740 1 -- start start 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.338+0000 7f255383b740 1 Processor -- start 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f255383b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d3e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f255383b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 0x5633f6d3ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f255383b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d45c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f255383b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6c97af0 con 0x5633f6d34a70 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f255383b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6c55f20 con 0x5633f6d3a440 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f255383b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6c55bc0 con 0x5633f6d353b0 2024-09-13T16:52:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f255383b740 10 client.0 _ll_register_callbacks cb 0x5633f6c87a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f254a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d3e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f254a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d3e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37458/0 (socket says 172.21.15.18:37458) 2024-09-13T16:52:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f254a800640 1 -- 172.21.15.18:0/3490934876 learned_addr learned my addr 172.21.15.18:0/3490934876 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f2549400640 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 0x5633f6d3ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.339+0000 7f254a800640 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d45c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f2549400640 1 -- 172.21.15.18:0/3490934876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 msgr2=0x5633f6d45c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f2549400640 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d45c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f2549400640 1 -- 172.21.15.18:0/3490934876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 msgr2=0x5633f6d3e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f2549400640 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d3e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f2549400640 1 -- 172.21.15.18:0/3490934876 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2544009d50 con 0x5633f6d353b0 2024-09-13T16:52:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f254a800640 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d3e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f2549400640 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 0x5633f6d3ebe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f254c19d840 tx=0x7f2538012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d60d907ed0e23b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f252be00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:52:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f252be00640 1 -- 172.21.15.18:0/3490934876 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538017070 con 0x5633f6d353b0 2024-09-13T16:52:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f255383b740 1 -- 172.21.15.18:0/3490934876 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633f6cc1c90 con 0x5633f6d353b0 2024-09-13T16:52:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.340+0000 7f252be00640 1 -- 172.21.15.18:0/3490934876 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f253800f920 con 0x5633f6d353b0 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f252be00640 1 -- 172.21.15.18:0/3490934876 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f253800fae0 con 0x5633f6d353b0 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f255383b740 10 client.25402 fetch_fsmap learned FSMap version 25 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f255383b740 1 -- 172.21.15.18:0/3490934876 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5633f6c96170 con 0x5633f6d353b0 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f252be00640 1 -- 172.21.15.18:0/3490934876 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5633f6cc1c90 con 0x5633f6d353b0 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f252be00640 1 -- 172.21.15.18:0/3490934876 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2538010c60 con 0x5633f6d353b0 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f255383b740 10 client.25402 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f255383b740 10 client.25402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f255383b740 20 client.25402 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f255383b740 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5633f6d4a3c0 0x5633f6d4c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f255383b740 4 client.25402 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:52:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.341+0000 7f255383b740 1 -- 172.21.15.18:0/3490934876 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633f6c8a7d0 con 0x5633f6d4a3c0 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.342+0000 7f254a800640 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5633f6d4a3c0 0x5633f6d4c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.342+0000 7f254a800640 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5633f6d4a3c0 0x5633f6d4c7e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ab02742db31ed1 server_cookie=9f8553b75666194 in_seq=0 out_seq=0 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.342+0000 7f252be00640 10 client.25402 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f252be00640 1 -- 172.21.15.18:0/3490934876 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5633f6c8a7d0 con 0x5633f6d4a3c0 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f252be00640 10 client.25402 handle_command_reply: tid=0 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 client.25402 shutdown 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 -- 172.21.15.18:0/3490934876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 msgr2=0x5633f6d3ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 0x5633f6d3ebe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f254c19d840 tx=0x7f2538012b60 comp rx=0 tx=0).stop 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 -- 172.21.15.18:0/3490934876 shutdown_connections 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5633f6d4a3c0 0x5633f6d4c7e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d45c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d353b0 0x5633f6d3ebe0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 --2- 172.21.15.18:0/3490934876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d34a70 0x5633f6d3e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f252be00640 0 client.25402 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 -- 172.21.15.18:0/3490934876 >> 172.21.15.18:0/3490934876 conn(0x5633f6d300e0 msgr2=0x5633f6d318f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 -- 172.21.15.18:0/3490934876 shutdown_connections 2024-09-13T16:52:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.343+0000 7f255383b740 1 -- 172.21.15.18:0/3490934876 wait complete. 2024-09-13T16:52:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.344+0000 7f255383b740 20 client.25402 trim_cache size 0 max 16384 2024-09-13T16:52:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f255383b740 1 Processor -- start 2024-09-13T16:52:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f255383b740 1 -- start start 2024-09-13T16:52:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f255383b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d34a70 0x5633f6d3e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f255383b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 0x5633f6d3eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f255383b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d45be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f255383b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f69fee60 con 0x5633f6d353b0 2024-09-13T16:52:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f255383b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6d48950 con 0x5633f6d3a440 2024-09-13T16:52:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f255383b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6d345f0 con 0x5633f6d34a70 2024-09-13T16:52:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f2549400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 0x5633f6d3eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f254a800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d45be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f254a800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d45be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:40888/0 (socket says 172.21.15.18:40888) 2024-09-13T16:52:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f254a800640 1 -- 172.21.15.18:0/923847094 learned_addr learned my addr 172.21.15.18:0/923847094 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.357+0000 7f254a800640 1 --2- 172.21.15.18:0/923847094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d34a70 0x5633f6d3e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.358+0000 7f254a800640 1 -- 172.21.15.18:0/923847094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d34a70 msgr2=0x5633f6d3e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.358+0000 7f254a800640 1 --2- 172.21.15.18:0/923847094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d34a70 0x5633f6d3e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.358+0000 7f254a800640 1 -- 172.21.15.18:0/923847094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 msgr2=0x5633f6d3eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.358+0000 7f254a800640 1 --2- 172.21.15.18:0/923847094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 0x5633f6d3eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.358+0000 7f254a800640 1 -- 172.21.15.18:0/923847094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633f6c38180 con 0x5633f6d3a440 2024-09-13T16:52:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.358+0000 7f254a800640 1 --2- 172.21.15.18:0/923847094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d45be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2544014040 tx=0x7f2544005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15104139e813e006 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.358+0000 7f2537e00640 1 -- 172.21.15.18:0/923847094 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400fae0 con 0x5633f6d3a440 2024-09-13T16:52:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.358+0000 7f2537e00640 1 -- 172.21.15.18:0/923847094 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2544032040 con 0x5633f6d3a440 2024-09-13T16:52:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.358+0000 7f2537e00640 1 -- 172.21.15.18:0/923847094 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25440276a0 con 0x5633f6d3a440 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.359+0000 7f255383b740 1 -- 172.21.15.18:0/923847094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 msgr2=0x5633f6d45be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.359+0000 7f255383b740 1 --2- 172.21.15.18:0/923847094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d45be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2544014040 tx=0x7f2544005bd0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.359+0000 7f255383b740 1 -- 172.21.15.18:0/923847094 shutdown_connections 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.359+0000 7f255383b740 1 --2- 172.21.15.18:0/923847094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 0x5633f6d3eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.359+0000 7f255383b740 1 --2- 172.21.15.18:0/923847094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d3a440 0x5633f6d45be0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.359+0000 7f255383b740 1 --2- 172.21.15.18:0/923847094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d34a70 0x5633f6d3e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.359+0000 7f255383b740 1 -- 172.21.15.18:0/923847094 >> 172.21.15.18:0/923847094 conn(0x5633f6d300e0 msgr2=0x5633f6d39830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.359+0000 7f255383b740 1 -- 172.21.15.18:0/923847094 shutdown_connections 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.359+0000 7f255383b740 1 -- 172.21.15.18:0/923847094 wait complete. 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.359+0000 7f255383b740 1 -- start start 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.360+0000 7f255383b740 1 Processor -- start 2024-09-13T16:52:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.360+0000 7f255383b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d34a70 0x5633f6d456e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.360+0000 7f255383b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 0x5633f6d42180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.360+0000 7f255383b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d3a440 0x5633f6d426c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.360+0000 7f255383b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6d42dc0 con 0x5633f6d353b0 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.360+0000 7f255383b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6d45d40 con 0x5633f6d34a70 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.360+0000 7f255383b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6d45f00 con 0x5633f6d3a440 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.360+0000 7f255383b740 10 client.0 _ll_register_callbacks cb 0x7f2538009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.360+0000 7f2549400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 0x5633f6d42180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f254a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d3a440 0x5633f6d426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f254a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d3a440 0x5633f6d426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:59022/0 (socket says 172.21.15.18:59022) 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f254a800640 1 -- 172.21.15.18:0/1212817007 learned_addr learned my addr 172.21.15.18:0/1212817007 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f254a800640 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d34a70 0x5633f6d456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f2549400640 1 -- 172.21.15.18:0/1212817007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d3a440 msgr2=0x5633f6d426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f2549400640 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d3a440 0x5633f6d426c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f2549400640 1 -- 172.21.15.18:0/1212817007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d34a70 msgr2=0x5633f6d456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f2549400640 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d34a70 0x5633f6d456e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f2549400640 1 -- 172.21.15.18:0/1212817007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633f6c39940 con 0x5633f6d353b0 2024-09-13T16:52:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f2549400640 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 0x5633f6d42180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f253801c420 tx=0x7f253800fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eba58b5fd4490d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.361+0000 7f252be00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.362+0000 7f252be00640 1 -- 172.21.15.18:0/1212817007 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538017030 con 0x5633f6d353b0 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.362+0000 7f252be00640 1 -- 172.21.15.18:0/1212817007 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f2538009e30 con 0x5633f6d353b0 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.362+0000 7f255383b740 1 -- 172.21.15.18:0/1212817007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2544004c80 con 0x5633f6d353b0 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.362+0000 7f252be00640 1 -- 172.21.15.18:0/1212817007 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f253801ce20 con 0x5633f6d353b0 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.362+0000 7f255383b740 10 client.15387 fetch_fsmap learned FSMap version 25 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.362+0000 7f255383b740 1 -- 172.21.15.18:0/1212817007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5633f6c5d560 con 0x5633f6d353b0 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.362+0000 7f252be00640 1 -- 172.21.15.18:0/1212817007 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2544004c80 con 0x5633f6d353b0 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.362+0000 7f252be00640 1 -- 172.21.15.18:0/1212817007 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2538003660 con 0x5633f6d353b0 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.362+0000 7f255383b740 10 client.15387 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.362+0000 7f255383b740 10 client.15387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:52:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.363+0000 7f255383b740 20 client.15387 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.363+0000 7f255383b740 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5633f6da2100 0x5633f6da4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.363+0000 7f255383b740 4 client.15387 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:52:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.363+0000 7f255383b740 1 -- 172.21.15.18:0/1212817007 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5633f698b300 con 0x5633f6da2100 2024-09-13T16:52:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.363+0000 7f254a800640 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5633f6da2100 0x5633f6da4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.363+0000 7f254a800640 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5633f6da2100 0x5633f6da4520 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdfc679613fac513 server_cookie=c2311e4344b2600c in_seq=0 out_seq=0 2024-09-13T16:52:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.363+0000 7f252be00640 10 client.15387 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.369+0000 7f252be00640 1 -- 172.21.15.18:0/1212817007 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5633f698b300 con 0x5633f6da2100 2024-09-13T16:52:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.369+0000 7f252be00640 10 client.15387 handle_command_reply: tid=0 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.369+0000 7f255383b740 1 client.15387 shutdown 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 1 -- 172.21.15.18:0/1212817007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 msgr2=0x5633f6d42180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 0x5633f6d42180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f253801c420 tx=0x7f253800fb50 comp rx=0 tx=0).stop 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 1 -- 172.21.15.18:0/1212817007 shutdown_connections 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5633f6da2100 0x5633f6da4520 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633f6d353b0 0x5633f6d42180 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f252be00640 0 client.15387 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5633f6d3a440 0x5633f6d426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 1 --2- 172.21.15.18:0/1212817007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5633f6d34a70 0x5633f6d456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 1 -- 172.21.15.18:0/1212817007 >> 172.21.15.18:0/1212817007 conn(0x5633f6d300e0 msgr2=0x5633f6d361f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 1 -- 172.21.15.18:0/1212817007 shutdown_connections 2024-09-13T16:52:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 1 -- 172.21.15.18:0/1212817007 wait complete. 2024-09-13T16:52:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.370+0000 7f255383b740 20 client.15387 trim_cache size 0 max 16384 2024-09-13T16:52:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:52:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:52:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:52:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:52:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 -- 172.21.15.18:0/1899033450 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25300a1110 msgr2=0x7f25300a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25300a1110 0x7f25300a35d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f253c0b6bc0 tx=0x7f253c0f0a10 comp rx=0 tx=0).stop 2024-09-13T16:52:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 -- 172.21.15.18:0/1899033450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f254c072f10 msgr2=0x7f254c19c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f254c072f10 0x7f254c19c330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f253c02a930 tx=0x7f253c003c10 comp rx=0 tx=0).stop 2024-09-13T16:52:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 -- 172.21.15.18:0/1899033450 shutdown_connections 2024-09-13T16:52:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f25300a1110 0x7f25300a35d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f254c10c2e0 0x7f254c1a38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f254c0744f0 0x7f254c19c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 --2- 172.21.15.18:0/1899033450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f254c072f10 0x7f254c19c330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 -- 172.21.15.18:0/1899033450 >> 172.21.15.18:0/1899033450 conn(0x7f254c0fb4b0 msgr2=0x7f254c0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 -- 172.21.15.18:0/1899033450 shutdown_connections 2024-09-13T16:52:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:39.371+0000 7f2550a00640 1 -- 172.21.15.18:0/1899033450 wait complete. 2024-09-13T16:52:40.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:39 smithi094 ceph-mon[35259]: pgmap v397: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:40.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:39 smithi018 ceph-mon[30981]: pgmap v397: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:40.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:39 smithi144 ceph-mon[35328]: pgmap v397: 129 pgs: 129 active+clean; 655 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T16:52:42.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:41 smithi094 ceph-mon[35259]: pgmap v398: 129 pgs: 129 active+clean; 656 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-13T16:52:42.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:41 smithi018 ceph-mon[30981]: pgmap v398: 129 pgs: 129 active+clean; 656 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-13T16:52:42.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:41 smithi144 ceph-mon[35328]: pgmap v398: 129 pgs: 129 active+clean; 656 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-13T16:52:44.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:43 smithi094 ceph-mon[35259]: pgmap v399: 129 pgs: 129 active+clean; 656 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T16:52:44.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:43 smithi018 ceph-mon[30981]: pgmap v399: 129 pgs: 129 active+clean; 656 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T16:52:44.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:43 smithi144 ceph-mon[35328]: pgmap v399: 129 pgs: 129 active+clean; 656 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T16:52:46.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:45 smithi094 ceph-mon[35259]: pgmap v400: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-13T16:52:46.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:45 smithi018 ceph-mon[30981]: pgmap v400: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-13T16:52:46.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:45 smithi144 ceph-mon[35328]: pgmap v400: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-13T16:52:48.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:47 smithi094 ceph-mon[35259]: pgmap v401: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T16:52:48.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:47 smithi018 ceph-mon[30981]: pgmap v401: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T16:52:48.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:47 smithi144 ceph-mon[35328]: pgmap v401: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T16:52:50.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:49 smithi094 ceph-mon[35259]: pgmap v402: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T16:52:50.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:49 smithi018 ceph-mon[30981]: pgmap v402: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T16:52:50.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:49 smithi144 ceph-mon[35328]: pgmap v402: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T16:52:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:51 smithi094 ceph-mon[35259]: pgmap v403: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-13T16:52:52.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:51 smithi018 ceph-mon[30981]: pgmap v403: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-13T16:52:52.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:51 smithi144 ceph-mon[35328]: pgmap v403: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-13T16:52:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.554+0000 7f9f37200640 1 -- 172.21.15.18:0/1442954421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f38072f10 msgr2=0x7f9f38073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.554+0000 7f9f37200640 1 --2- 172.21.15.18:0/1442954421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f38072f10 0x7f9f38073370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009900 tx=0x7f9f2402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.555+0000 7f9f37200640 1 -- 172.21.15.18:0/1442954421 shutdown_connections 2024-09-13T16:52:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.555+0000 7f9f37200640 1 --2- 172.21.15.18:0/1442954421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f3810c120 0x7f9f3810e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.555+0000 7f9f37200640 1 --2- 172.21.15.18:0/1442954421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f38072f10 0x7f9f38073370 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.555+0000 7f9f37200640 1 --2- 172.21.15.18:0/1442954421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f380744f0 0x7f9f38072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.555+0000 7f9f37200640 1 -- 172.21.15.18:0/1442954421 >> 172.21.15.18:0/1442954421 conn(0x7f9f380fb2f0 msgr2=0x7f9f380fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.555+0000 7f9f37200640 1 -- 172.21.15.18:0/1442954421 shutdown_connections 2024-09-13T16:52:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.555+0000 7f9f37200640 1 -- 172.21.15.18:0/1442954421 wait complete. 2024-09-13T16:52:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.556+0000 7f9f37200640 1 Processor -- start 2024-09-13T16:52:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.556+0000 7f9f37200640 1 -- start start 2024-09-13T16:52:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f37200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f38072f10 0x7f9f3819c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f37200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f380744f0 0x7f9f3819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f37200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f3810c120 0x7f9f381a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f37200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381a3bb0 con 0x7f9f38072f10 2024-09-13T16:52:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f37200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381a3d20 con 0x7f9f380744f0 2024-09-13T16:52:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f37200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381a3ee0 con 0x7f9f3810c120 2024-09-13T16:52:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f35400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f380744f0 0x7f9f3819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f35400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f380744f0 0x7f9f3819c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:46506/0 (socket says 172.21.15.18:46506) 2024-09-13T16:52:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f35400640 1 -- 172.21.15.18:0/1891490876 learned_addr learned my addr 172.21.15.18:0/1891490876 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f36800640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f3810c120 0x7f9f381a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.557+0000 7f9f35e00640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f38072f10 0x7f9f3819c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.558+0000 7f9f35400640 1 -- 172.21.15.18:0/1891490876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f3810c120 msgr2=0x7f9f381a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.558+0000 7f9f35400640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f3810c120 0x7f9f381a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.558+0000 7f9f35400640 1 -- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f38072f10 msgr2=0x7f9f3819c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.558+0000 7f9f35400640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f38072f10 0x7f9f3819c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.558+0000 7f9f35400640 1 -- 172.21.15.18:0/1891490876 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f28009490 con 0x7f9f380744f0 2024-09-13T16:52:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.558+0000 7f9f35e00640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f38072f10 0x7f9f3819c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.558+0000 7f9f35400640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f380744f0 0x7f9f3819c600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9f24031500 tx=0x7f9f24003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.559+0000 7f9f2ea00640 1 -- 172.21.15.18:0/1891490876 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24005d50 con 0x7f9f380744f0 2024-09-13T16:52:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.559+0000 7f9f2ea00640 1 -- 172.21.15.18:0/1891490876 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f24003e00 con 0x7f9f380744f0 2024-09-13T16:52:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.559+0000 7f9f2ea00640 1 -- 172.21.15.18:0/1891490876 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2403bb50 con 0x7f9f380744f0 2024-09-13T16:52:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.559+0000 7f9f37200640 1 -- 172.21.15.18:0/1891490876 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f30009840 con 0x7f9f380744f0 2024-09-13T16:52:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.559+0000 7f9f37200640 1 -- 172.21.15.18:0/1891490876 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f24009560 con 0x7f9f380744f0 2024-09-13T16:52:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.564+0000 7f9f4006e740 1 Processor -- start 2024-09-13T16:52:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.564+0000 7f9f2ea00640 1 -- 172.21.15.18:0/1891490876 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9f2403bcb0 con 0x7f9f380744f0 2024-09-13T16:52:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.564+0000 7f9f4006e740 1 -- start start 2024-09-13T16:52:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b4c80 0x5562f85b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b55c0 0x5562f85ba080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 0x5562f85bcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f4006e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f84c0bb0 con 0x5562f85b55c0 2024-09-13T16:52:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f4006e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f851ea70 con 0x5562f85b4c80 2024-09-13T16:52:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f4006e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f851c200 con 0x5562f85ba650 2024-09-13T16:52:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f36800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b4c80 0x5562f85b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f36800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b4c80 0x5562f85b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:46516/0 (socket says 172.21.15.18:46516) 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f36800640 1 -- 172.21.15.18:0/2053981258 learned_addr learned my addr 172.21.15.18:0/2053981258 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f35e00640 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b55c0 0x5562f85ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.565+0000 7f9f35400640 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 0x5562f85bcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.566+0000 7f9f35400640 1 -- 172.21.15.18:0/2053981258 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b4c80 msgr2=0x5562f85b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.566+0000 7f9f35400640 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b4c80 0x5562f85b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.566+0000 7f9f35400640 1 -- 172.21.15.18:0/2053981258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b55c0 msgr2=0x5562f85ba080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.566+0000 7f9f35400640 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b55c0 0x5562f85ba080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.566+0000 7f9f35400640 1 -- 172.21.15.18:0/2053981258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562f84b9940 con 0x5562f85ba650 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.566+0000 7f9f36800640 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b4c80 0x5562f85b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.566+0000 7f9f35e00640 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b55c0 0x5562f85ba080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:52:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.566+0000 7f9f2ea00640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f1c0a11b0 0x7f9f1c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.567+0000 7f9f35400640 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 0x5562f85bcb10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9f240eaca0 tx=0x7f9f240f3580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=755219aeece1ba2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.567+0000 7f9f2ea00640 1 -- 172.21.15.18:0/1891490876 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9f240ed5c0 con 0x7f9f380744f0 2024-09-13T16:52:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.567+0000 7f9f23400640 1 -- 172.21.15.18:0/2053981258 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240a3ea0 con 0x5562f85ba650 2024-09-13T16:52:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.567+0000 7f9f23400640 1 -- 172.21.15.18:0/2053981258 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f240b6990 con 0x5562f85ba650 2024-09-13T16:52:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.567+0000 7f9f23400640 1 -- 172.21.15.18:0/2053981258 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240ba190 con 0x5562f85ba650 2024-09-13T16:52:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.567+0000 7f9f36800640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f1c0a11b0 0x7f9f1c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.568+0000 7f9f4006e740 1 -- 172.21.15.18:0/2053981258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 msgr2=0x5562f85bcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.568+0000 7f9f4006e740 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 0x5562f85bcb10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9f240eaca0 tx=0x7f9f240f3580 comp rx=0 tx=0).stop 2024-09-13T16:52:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.568+0000 7f9f36800640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f1c0a11b0 0x7f9f1c0a3670 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009fd0 tx=0x7f9f30009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.568+0000 7f9f4006e740 1 -- 172.21.15.18:0/2053981258 shutdown_connections 2024-09-13T16:52:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.568+0000 7f9f4006e740 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b55c0 0x5562f85ba080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.568+0000 7f9f4006e740 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 0x5562f85bcb10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.568+0000 7f9f4006e740 1 --2- 172.21.15.18:0/2053981258 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b4c80 0x5562f85b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.568+0000 7f9f4006e740 1 -- 172.21.15.18:0/2053981258 >> 172.21.15.18:0/2053981258 conn(0x5562f85b02f0 msgr2=0x5562f85b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.569+0000 7f9f4006e740 1 -- 172.21.15.18:0/2053981258 shutdown_connections 2024-09-13T16:52:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.569+0000 7f9f4006e740 1 -- 172.21.15.18:0/2053981258 wait complete. 2024-09-13T16:52:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.569+0000 7f9f4006e740 1 -- start start 2024-09-13T16:52:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.570+0000 7f9f4006e740 1 Processor -- start 2024-09-13T16:52:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.570+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85be6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.570+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b55c0 0x5562f85bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.570+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85ba650 0x5562f85c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.570+0000 7f9f4006e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f8517af0 con 0x5562f85b4c80 2024-09-13T16:52:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.570+0000 7f9f4006e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f84d5f20 con 0x5562f85ba650 2024-09-13T16:52:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.570+0000 7f9f4006e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f84d5bc0 con 0x5562f85b55c0 2024-09-13T16:52:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.570+0000 7f9f4006e740 10 client.0 _ll_register_callbacks cb 0x5562f8507a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f35400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b55c0 0x5562f85bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f35400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b55c0 0x5562f85bec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:44554/0 (socket says 172.21.15.18:44554) 2024-09-13T16:52:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f35400640 1 -- 172.21.15.18:0/3554461598 learned_addr learned my addr 172.21.15.18:0/3554461598 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f35e00640 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85be6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f36800640 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85ba650 0x5562f85c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f35400640 1 -- 172.21.15.18:0/3554461598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85ba650 msgr2=0x5562f85c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f35400640 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85ba650 0x5562f85c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f35400640 1 -- 172.21.15.18:0/3554461598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 msgr2=0x5562f85be6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f35400640 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85be6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f35400640 1 -- 172.21.15.18:0/3554461598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f24009560 con 0x5562f85b55c0 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.571+0000 7f9f35e00640 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85be6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.572+0000 7f9f35400640 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b55c0 0x5562f85bec10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9f240eacd0 tx=0x7f9f2402a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fde77a82d8b498e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.572+0000 7f9f17e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.572+0000 7f9f17e00640 1 -- 172.21.15.18:0/3554461598 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240a3ea0 con 0x5562f85b55c0 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.572+0000 7f9f4006e740 1 -- 172.21.15.18:0/3554461598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562f8541c90 con 0x5562f85b55c0 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.572+0000 7f9f17e00640 1 -- 172.21.15.18:0/3554461598 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9f240bad50 con 0x5562f85b55c0 2024-09-13T16:52:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.572+0000 7f9f17e00640 1 -- 172.21.15.18:0/3554461598 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f240f0af0 con 0x5562f85b55c0 2024-09-13T16:52:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.572+0000 7f9f4006e740 10 client.25420 fetch_fsmap learned FSMap version 25 2024-09-13T16:52:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.572+0000 7f9f4006e740 1 -- 172.21.15.18:0/3554461598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5562f8516170 con 0x5562f85b55c0 2024-09-13T16:52:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.573+0000 7f9f17e00640 1 -- 172.21.15.18:0/3554461598 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5562f8541c90 con 0x5562f85b55c0 2024-09-13T16:52:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.573+0000 7f9f17e00640 1 -- 172.21.15.18:0/3554461598 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9f240ed2c0 con 0x5562f85b55c0 2024-09-13T16:52:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.573+0000 7f9f4006e740 10 client.25420 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:52:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.573+0000 7f9f4006e740 10 client.25420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:52:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.573+0000 7f9f4006e740 20 client.25420 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.573+0000 7f9f4006e740 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562f85c9df0 0x5562f85cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.573+0000 7f9f4006e740 4 client.25420 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:52:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.573+0000 7f9f4006e740 1 -- 172.21.15.18:0/3554461598 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562f850a7d0 con 0x5562f85c9df0 2024-09-13T16:52:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.573+0000 7f9f35e00640 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562f85c9df0 0x5562f85cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.574+0000 7f9f35e00640 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562f85c9df0 0x5562f85cc1e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f41fd3a8da9283e server_cookie=942e8a2f262c6220 in_seq=0 out_seq=0 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.574+0000 7f9f17e00640 10 client.25420 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f17e00640 1 -- 172.21.15.18:0/3554461598 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5562f850a7d0 con 0x5562f85c9df0 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f17e00640 10 client.25420 handle_command_reply: tid=0 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f4006e740 1 client.25420 shutdown 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f4006e740 1 -- 172.21.15.18:0/3554461598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b55c0 msgr2=0x5562f85bec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f4006e740 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b55c0 0x5562f85bec10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9f240eacd0 tx=0x7f9f2402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f4006e740 1 -- 172.21.15.18:0/3554461598 shutdown_connections 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f4006e740 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562f85c9df0 0x5562f85cc1e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f4006e740 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85ba650 0x5562f85c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f4006e740 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b55c0 0x5562f85bec10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f17e00640 0 client.25420 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.575+0000 7f9f4006e740 1 --2- 172.21.15.18:0/3554461598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85be6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.576+0000 7f9f4006e740 1 -- 172.21.15.18:0/3554461598 >> 172.21.15.18:0/3554461598 conn(0x5562f85b02f0 msgr2=0x5562f85b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.576+0000 7f9f4006e740 1 -- 172.21.15.18:0/3554461598 shutdown_connections 2024-09-13T16:52:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.576+0000 7f9f4006e740 1 -- 172.21.15.18:0/3554461598 wait complete. 2024-09-13T16:52:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.576+0000 7f9f4006e740 20 client.25420 trim_cache size 0 max 16384 2024-09-13T16:52:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.602+0000 7f9f4006e740 1 Processor -- start 2024-09-13T16:52:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.602+0000 7f9f4006e740 1 -- start start 2024-09-13T16:52:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.602+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.602+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b55c0 0x5562f85b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.602+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 0x5562f85c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.602+0000 7f9f4006e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f827ee60 con 0x5562f85b4c80 2024-09-13T16:52:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.602+0000 7f9f4006e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f85be210 con 0x5562f85b55c0 2024-09-13T16:52:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.602+0000 7f9f4006e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f85b21b0 con 0x5562f85ba650 2024-09-13T16:52:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.603+0000 7f9f35e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.603+0000 7f9f35e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58626/0 (socket says 172.21.15.18:58626) 2024-09-13T16:52:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.603+0000 7f9f35e00640 1 -- 172.21.15.18:0/1974393912 learned_addr learned my addr 172.21.15.18:0/1974393912 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.603+0000 7f9f35400640 1 --2- 172.21.15.18:0/1974393912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b55c0 0x5562f85b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.603+0000 7f9f36800640 1 --2- 172.21.15.18:0/1974393912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 0x5562f85c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.603+0000 7f9f35e00640 1 -- 172.21.15.18:0/1974393912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 msgr2=0x5562f85c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.603+0000 7f9f35e00640 1 --2- 172.21.15.18:0/1974393912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 0x5562f85c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.603+0000 7f9f35e00640 1 -- 172.21.15.18:0/1974393912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b55c0 msgr2=0x5562f85b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.603+0000 7f9f35e00640 1 --2- 172.21.15.18:0/1974393912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b55c0 0x5562f85b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.603+0000 7f9f35e00640 1 -- 172.21.15.18:0/1974393912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562f84b8180 con 0x5562f85b4c80 2024-09-13T16:52:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.604+0000 7f9f35e00640 1 --2- 172.21.15.18:0/1974393912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85b64e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009f00 tx=0x7f9f280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85e8321886ec614 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.604+0000 7f9f23e00640 1 -- 172.21.15.18:0/1974393912 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28004220 con 0x5562f85b4c80 2024-09-13T16:52:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.604+0000 7f9f23e00640 1 -- 172.21.15.18:0/1974393912 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f28018040 con 0x5562f85b4c80 2024-09-13T16:52:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.604+0000 7f9f23e00640 1 -- 172.21.15.18:0/1974393912 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28003970 con 0x5562f85b4c80 2024-09-13T16:52:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.605+0000 7f9f4006e740 1 -- 172.21.15.18:0/1974393912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 msgr2=0x5562f85b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.605+0000 7f9f4006e740 1 --2- 172.21.15.18:0/1974393912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85b64e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009f00 tx=0x7f9f280046c0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.605+0000 7f9f4006e740 1 -- 172.21.15.18:0/1974393912 shutdown_connections 2024-09-13T16:52:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.605+0000 7f9f4006e740 1 --2- 172.21.15.18:0/1974393912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85ba650 0x5562f85c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.605+0000 7f9f4006e740 1 --2- 172.21.15.18:0/1974393912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b55c0 0x5562f85b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.605+0000 7f9f4006e740 1 --2- 172.21.15.18:0/1974393912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85b4c80 0x5562f85b64e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.605+0000 7f9f4006e740 1 -- 172.21.15.18:0/1974393912 >> 172.21.15.18:0/1974393912 conn(0x5562f85b02f0 msgr2=0x5562f85b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.606+0000 7f9f4006e740 1 -- 172.21.15.18:0/1974393912 shutdown_connections 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.606+0000 7f9f4006e740 1 -- 172.21.15.18:0/1974393912 wait complete. 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.606+0000 7f9f4006e740 1 -- start start 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.606+0000 7f9f4006e740 1 Processor -- start 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b4c80 0x5562f85c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b55c0 0x5562f85c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f4006e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85ba650 0x5562f85c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f4006e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f85c2ef0 con 0x5562f85ba650 2024-09-13T16:52:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f4006e740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f85c5e70 con 0x5562f85b55c0 2024-09-13T16:52:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f4006e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f85c6030 con 0x5562f85b4c80 2024-09-13T16:52:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f4006e740 10 client.0 _ll_register_callbacks cb 0x7f9f240f0e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:52:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f35e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b4c80 0x5562f85c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f35e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b4c80 0x5562f85c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:44574/0 (socket says 172.21.15.18:44574) 2024-09-13T16:52:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f35e00640 1 -- 172.21.15.18:0/2575275143 learned_addr learned my addr 172.21.15.18:0/2575275143 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:52:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.607+0000 7f9f35400640 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b55c0 0x5562f85c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.608+0000 7f9f36800640 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85ba650 0x5562f85c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.608+0000 7f9f35e00640 1 -- 172.21.15.18:0/2575275143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b55c0 msgr2=0x5562f85c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.608+0000 7f9f35e00640 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b55c0 0x5562f85c22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.608+0000 7f9f35e00640 1 -- 172.21.15.18:0/2575275143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85ba650 msgr2=0x5562f85c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:52:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.608+0000 7f9f35e00640 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85ba650 0x5562f85c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.608+0000 7f9f35e00640 1 -- 172.21.15.18:0/2575275143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562f84dd560 con 0x5562f85b4c80 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.608+0000 7f9f36800640 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85ba650 0x5562f85c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.608+0000 7f9f35e00640 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b4c80 0x5562f85c5810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f28000c00 tx=0x7f9f280040f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee5fa4ee590f7f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.608+0000 7f9f17e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.609+0000 7f9f17e00640 1 -- 172.21.15.18:0/2575275143 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2802d070 con 0x5562f85b4c80 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.609+0000 7f9f17e00640 1 -- 172.21.15.18:0/2575275143 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9f28004350 con 0x5562f85b4c80 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.609+0000 7f9f4006e740 1 -- 172.21.15.18:0/2575275143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f240b6990 con 0x5562f85b4c80 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.609+0000 7f9f17e00640 1 -- 172.21.15.18:0/2575275143 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f28005050 con 0x5562f85b4c80 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.609+0000 7f9f4006e740 10 client.25426 fetch_fsmap learned FSMap version 25 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.609+0000 7f9f4006e740 1 -- 172.21.15.18:0/2575275143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5562f84c4180 con 0x5562f85b4c80 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.610+0000 7f9f17e00640 1 -- 172.21.15.18:0/2575275143 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f240b6990 con 0x5562f85b4c80 2024-09-13T16:52:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.610+0000 7f9f17e00640 1 -- 172.21.15.18:0/2575275143 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9f28004730 con 0x5562f85b4c80 2024-09-13T16:52:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.610+0000 7f9f4006e740 10 client.25426 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:52:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.610+0000 7f9f4006e740 10 client.25426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:52:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.610+0000 7f9f4006e740 20 client.25426 populate_metadata read hostname 'smithi018' 2024-09-13T16:52:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.610+0000 7f9f4006e740 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562f8621b20 0x5562f8623f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:52:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.610+0000 7f9f4006e740 4 client.25426 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:52:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.610+0000 7f9f4006e740 1 -- 172.21.15.18:0/2575275143 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5562f820b300 con 0x5562f8621b20 2024-09-13T16:52:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.611+0000 7f9f35400640 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562f8621b20 0x5562f8623f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:52:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.611+0000 7f9f35400640 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562f8621b20 0x5562f8623f40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0f9812a753b2a92 server_cookie=4a5e1d162817fd3d in_seq=0 out_seq=0 2024-09-13T16:52:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.611+0000 7f9f17e00640 10 client.25426 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f17e00640 1 -- 172.21.15.18:0/2575275143 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5562f820b300 con 0x5562f8621b20 2024-09-13T16:52:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f17e00640 10 client.25426 handle_command_reply: tid=0 2024-09-13T16:52:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 client.25426 shutdown 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 -- 172.21.15.18:0/2575275143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b4c80 msgr2=0x5562f85c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b4c80 0x5562f85c5810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f28000c00 tx=0x7f9f280040f0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 -- 172.21.15.18:0/2575275143 shutdown_connections 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562f8621b20 0x5562f8623f40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562f85ba650 0x5562f85c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5562f85b55c0 0x5562f85c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 --2- 172.21.15.18:0/2575275143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562f85b4c80 0x5562f85c5810 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 -- 172.21.15.18:0/2575275143 >> 172.21.15.18:0/2575275143 conn(0x5562f85b02f0 msgr2=0x5562f85b9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f17e00640 0 client.25426 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 -- 172.21.15.18:0/2575275143 shutdown_connections 2024-09-13T16:52:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.620+0000 7f9f4006e740 1 -- 172.21.15.18:0/2575275143 wait complete. 2024-09-13T16:52:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f4006e740 20 client.25426 trim_cache size 0 max 16384 2024-09-13T16:52:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:52:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:52:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:52:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:52:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f37200640 1 -- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f1c0a11b0 msgr2=0x7f9f1c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f37200640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f1c0a11b0 0x7f9f1c0a3670 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009fd0 tx=0x7f9f30009500 comp rx=0 tx=0).stop 2024-09-13T16:52:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f37200640 1 -- 172.21.15.18:0/1891490876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f380744f0 msgr2=0x7f9f3819c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:52:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f37200640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f380744f0 0x7f9f3819c600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9f24031500 tx=0x7f9f24003c10 comp rx=0 tx=0).stop 2024-09-13T16:52:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f37200640 1 -- 172.21.15.18:0/1891490876 shutdown_connections 2024-09-13T16:52:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f37200640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f3810c120 0x7f9f381a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f37200640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f380744f0 0x7f9f3819c600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f37200640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9f1c0a11b0 0x7f9f1c0a3670 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f37200640 1 --2- 172.21.15.18:0/1891490876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f38072f10 0x7f9f3819c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:52:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.621+0000 7f9f37200640 1 -- 172.21.15.18:0/1891490876 >> 172.21.15.18:0/1891490876 conn(0x7f9f380fb2f0 msgr2=0x7f9f380fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:52:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.622+0000 7f9f37200640 1 -- 172.21.15.18:0/1891490876 shutdown_connections 2024-09-13T16:52:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:52:52.622+0000 7f9f37200640 1 -- 172.21.15.18:0/1891490876 wait complete. 2024-09-13T16:52:54.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:53 smithi094 ceph-mon[35259]: pgmap v404: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-13T16:52:54.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:53 smithi018 ceph-mon[30981]: pgmap v404: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-13T16:52:54.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:53 smithi144 ceph-mon[35328]: pgmap v404: 129 pgs: 129 active+clean; 665 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-13T16:52:56.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:55 smithi094 ceph-mon[35259]: pgmap v405: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-13T16:52:56.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:55 smithi018 ceph-mon[30981]: pgmap v405: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-13T16:52:56.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:55 smithi144 ceph-mon[35328]: pgmap v405: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-13T16:52:58.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:57 smithi094 ceph-mon[35259]: pgmap v406: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T16:52:58.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:57 smithi018 ceph-mon[30981]: pgmap v406: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T16:52:58.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:57 smithi144 ceph-mon[35328]: pgmap v406: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T16:53:00.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:52:59 smithi094 ceph-mon[35259]: pgmap v407: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T16:53:00.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:52:59 smithi018 ceph-mon[30981]: pgmap v407: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T16:53:00.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:52:59 smithi144 ceph-mon[35328]: pgmap v407: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T16:53:02.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:01 smithi094 ceph-mon[35259]: pgmap v408: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-13T16:53:02.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:01 smithi018 ceph-mon[30981]: pgmap v408: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-13T16:53:02.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:01 smithi144 ceph-mon[35328]: pgmap v408: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-13T16:53:04.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:03 smithi094 ceph-mon[35259]: pgmap v409: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-13T16:53:04.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:03 smithi018 ceph-mon[30981]: pgmap v409: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-13T16:53:04.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:03 smithi144 ceph-mon[35328]: pgmap v409: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-13T16:53:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.768+0000 7fd6ddc00640 1 -- 172.21.15.18:0/1963064190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6d80ff730 msgr2=0x7fd6d80ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.768+0000 7fd6ddc00640 1 --2- 172.21.15.18:0/1963064190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6d80ff730 0x7fd6d80ffbe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009ca0 tx=0x7fd6d002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.768+0000 7fd6ddc00640 1 -- 172.21.15.18:0/1963064190 shutdown_connections 2024-09-13T16:53:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.768+0000 7fd6ddc00640 1 --2- 172.21.15.18:0/1963064190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d80fed90 0x7fd6d80ff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.768+0000 7fd6ddc00640 1 --2- 172.21.15.18:0/1963064190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6d80ff730 0x7fd6d80ffbe0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.768+0000 7fd6ddc00640 1 --2- 172.21.15.18:0/1963064190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6d80fe450 0x7fd6d80fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.768+0000 7fd6ddc00640 1 -- 172.21.15.18:0/1963064190 >> 172.21.15.18:0/1963064190 conn(0x7fd6d80fa1c0 msgr2=0x7fd6d80fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.768+0000 7fd6ddc00640 1 -- 172.21.15.18:0/1963064190 shutdown_connections 2024-09-13T16:53:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.768+0000 7fd6ddc00640 1 -- 172.21.15.18:0/1963064190 wait complete. 2024-09-13T16:53:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.769+0000 7fd6ddc00640 1 Processor -- start 2024-09-13T16:53:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.770+0000 7fd6ddc00640 1 -- start start 2024-09-13T16:53:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.770+0000 7fd6ddc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d80fe450 0x7fd6d8197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.770+0000 7fd6ddc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6d80fed90 0x7fd6d8198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.770+0000 7fd6ddc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6d80ff730 0x7fd6d819f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.770+0000 7fd6ddc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d819f800 con 0x7fd6d80fe450 2024-09-13T16:53:05.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.770+0000 7fd6ddc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d819f970 con 0x7fd6d80ff730 2024-09-13T16:53:05.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.770+0000 7fd6ddc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d819fb30 con 0x7fd6d80fed90 2024-09-13T16:53:05.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.770+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d80fe450 0x7fd6d8197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6d80fed90 0x7fd6d8198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d80fe450 0x7fd6d8197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49642/0 (socket says 172.21.15.18:49642) 2024-09-13T16:53:05.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6d7e00640 1 -- 172.21.15.18:0/2045488723 learned_addr learned my addr 172.21.15.18:0/2045488723 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:05.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6d80fed90 0x7fd6d8198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:46534/0 (socket says 172.21.15.18:46534) 2024-09-13T16:53:05.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6dd200640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6d80ff730 0x7fd6d819f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6d7e00640 1 -- 172.21.15.18:0/2045488723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6d80fed90 msgr2=0x7fd6d8198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6d80fed90 0x7fd6d8198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6d7e00640 1 -- 172.21.15.18:0/2045488723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6d80ff730 msgr2=0x7fd6d819f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6d80ff730 0x7fd6d819f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6d7e00640 1 -- 172.21.15.18:0/2045488723 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0009900 con 0x7fd6d80fe450 2024-09-13T16:53:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.771+0000 7fd6d7400640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6d80fed90 0x7fd6d8198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:53:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.772+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d80fe450 0x7fd6d8197d20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800e9f0 tx=0x7fd6c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.772+0000 7fd6d4c00640 1 -- 172.21.15.18:0/2045488723 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8009700 con 0x7fd6d80fe450 2024-09-13T16:53:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.772+0000 7fd6d4c00640 1 -- 172.21.15.18:0/2045488723 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6c800cd80 con 0x7fd6d80fe450 2024-09-13T16:53:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.772+0000 7fd6d4c00640 1 -- 172.21.15.18:0/2045488723 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8018860 con 0x7fd6d80fe450 2024-09-13T16:53:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.772+0000 7fd6ddc00640 1 -- 172.21.15.18:0/2045488723 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d819fe10 con 0x7fd6d80fe450 2024-09-13T16:53:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.772+0000 7fd6ddc00640 1 -- 172.21.15.18:0/2045488723 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d81a01e0 con 0x7fd6d80fe450 2024-09-13T16:53:05.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.775+0000 7fd6d4c00640 1 -- 172.21.15.18:0/2045488723 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd6c80189c0 con 0x7fd6d80fe450 2024-09-13T16:53:05.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.776+0000 7fd6e204f740 1 Processor -- start 2024-09-13T16:53:05.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.777+0000 7fd6e204f740 1 -- start start 2024-09-13T16:53:05.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.777+0000 7fd6d4c00640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6bc0a11b0 0x7fd6bc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.777+0000 7fd6d4c00640 1 -- 172.21.15.18:0/2045488723 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fd6c8014070 con 0x7fd6d80fe450 2024-09-13T16:53:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.777+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb858c80 0x55b4eb859080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.777+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb8595c0 0x55b4eb85e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.777+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 0x55b4eb860b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.777+0000 7fd6e204f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb764bb0 con 0x55b4eb858c80 2024-09-13T16:53:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.777+0000 7fd6e204f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb7c2a70 con 0x55b4eb8595c0 2024-09-13T16:53:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.777+0000 7fd6e204f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb7c0200 con 0x55b4eb85e650 2024-09-13T16:53:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.778+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb8595c0 0x55b4eb85e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.778+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb8595c0 0x55b4eb85e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:40088/0 (socket says 172.21.15.18:40088) 2024-09-13T16:53:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.778+0000 7fd6d7400640 1 -- 172.21.15.18:0/1493231790 learned_addr learned my addr 172.21.15.18:0/1493231790 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.778+0000 7fd6d7400640 1 -- 172.21.15.18:0/1493231790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 msgr2=0x55b4eb860b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:53:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.778+0000 7fd6d7400640 1 --2- 172.21.15.18:0/1493231790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 0x55b4eb860b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.778+0000 7fd6d7400640 1 -- 172.21.15.18:0/1493231790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb858c80 msgr2=0x55b4eb859080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.778+0000 7fd6d7400640 1 --2- 172.21.15.18:0/1493231790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb858c80 0x55b4eb859080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.778+0000 7fd6dd200640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6bc0a11b0 0x7fd6bc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.778+0000 7fd6d7400640 1 -- 172.21.15.18:0/1493231790 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4eb75d940 con 0x55b4eb8595c0 2024-09-13T16:53:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.779+0000 7fd6d7400640 1 --2- 172.21.15.18:0/1493231790 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb8595c0 0x55b4eb85e080 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4011570 tx=0x7fd6c4011a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=124f7c6ef7a71985 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.779+0000 7fd6cd600640 1 -- 172.21.15.18:0/1493231790 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400f840 con 0x55b4eb8595c0 2024-09-13T16:53:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.779+0000 7fd6cd600640 1 -- 172.21.15.18:0/1493231790 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6c400fe60 con 0x55b4eb8595c0 2024-09-13T16:53:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.779+0000 7fd6cd600640 1 -- 172.21.15.18:0/1493231790 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40293c0 con 0x55b4eb8595c0 2024-09-13T16:53:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.780+0000 7fd6e204f740 1 -- 172.21.15.18:0/1493231790 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb8595c0 msgr2=0x55b4eb85e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.780+0000 7fd6e204f740 1 --2- 172.21.15.18:0/1493231790 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb8595c0 0x55b4eb85e080 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4011570 tx=0x7fd6c4011a30 comp rx=0 tx=0).stop 2024-09-13T16:53:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.780+0000 7fd6dd200640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6bc0a11b0 0x7fd6bc0a3670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0006010 tx=0x7fd6d0031be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.780+0000 7fd6e204f740 1 -- 172.21.15.18:0/1493231790 shutdown_connections 2024-09-13T16:53:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.780+0000 7fd6e204f740 1 --2- 172.21.15.18:0/1493231790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 0x55b4eb860b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.780+0000 7fd6e204f740 1 --2- 172.21.15.18:0/1493231790 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb8595c0 0x55b4eb85e080 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.780+0000 7fd6e204f740 1 --2- 172.21.15.18:0/1493231790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb858c80 0x55b4eb859080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.780+0000 7fd6e204f740 1 -- 172.21.15.18:0/1493231790 >> 172.21.15.18:0/1493231790 conn(0x55b4eb8542f0 msgr2=0x55b4eb8546f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.781+0000 7fd6e204f740 1 -- 172.21.15.18:0/1493231790 shutdown_connections 2024-09-13T16:53:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.781+0000 7fd6e204f740 1 -- 172.21.15.18:0/1493231790 wait complete. 2024-09-13T16:53:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.781+0000 7fd6e204f740 1 -- start start 2024-09-13T16:53:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.781+0000 7fd6e204f740 1 Processor -- start 2024-09-13T16:53:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb858c80 0x55b4eb8629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb8595c0 0x55b4eb862ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb85e650 0x55b4eb867f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6e204f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb7bbaf0 con 0x55b4eb858c80 2024-09-13T16:53:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6e204f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb779f20 con 0x55b4eb85e650 2024-09-13T16:53:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6e204f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb779bc0 con 0x55b4eb8595c0 2024-09-13T16:53:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6e204f740 10 client.0 _ll_register_callbacks cb 0x55b4eb7aba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:53:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb8595c0 0x55b4eb862ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb8595c0 0x55b4eb862ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:46536/0 (socket says 172.21.15.18:46536) 2024-09-13T16:53:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6d7400640 1 -- 172.21.15.18:0/2395705041 learned_addr learned my addr 172.21.15.18:0/2395705041 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.782+0000 7fd6dd200640 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb85e650 0x55b4eb867f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.783+0000 7fd6d7400640 1 -- 172.21.15.18:0/2395705041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb85e650 msgr2=0x55b4eb867f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.783+0000 7fd6d7400640 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb85e650 0x55b4eb867f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.783+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb858c80 0x55b4eb8629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.783+0000 7fd6d7400640 1 -- 172.21.15.18:0/2395705041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb858c80 msgr2=0x55b4eb8629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.783+0000 7fd6d7400640 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb858c80 0x55b4eb8629a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.783+0000 7fd6d7400640 1 -- 172.21.15.18:0/2395705041 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c4009d40 con 0x55b4eb8595c0 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.783+0000 7fd6dd200640 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb85e650 0x55b4eb867f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.783+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb858c80 0x55b4eb8629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.783+0000 7fd6d7400640 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb8595c0 0x55b4eb862ee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4011540 tx=0x7fd6c402bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47690d5be6354071 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.783+0000 7fd6c2000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:53:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.784+0000 7fd6c2000640 1 -- 172.21.15.18:0/2395705041 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4004440 con 0x55b4eb8595c0 2024-09-13T16:53:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.784+0000 7fd6e204f740 1 -- 172.21.15.18:0/2395705041 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4eb7e5c90 con 0x55b4eb8595c0 2024-09-13T16:53:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.784+0000 7fd6c2000640 1 -- 172.21.15.18:0/2395705041 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fd6c4005040 con 0x55b4eb8595c0 2024-09-13T16:53:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.784+0000 7fd6c2000640 1 -- 172.21.15.18:0/2395705041 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6c4005200 con 0x55b4eb8595c0 2024-09-13T16:53:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.784+0000 7fd6e204f740 10 client.25435 fetch_fsmap learned FSMap version 25 2024-09-13T16:53:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.784+0000 7fd6e204f740 1 -- 172.21.15.18:0/2395705041 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b4eb7ba170 con 0x55b4eb8595c0 2024-09-13T16:53:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.784+0000 7fd6c2000640 1 -- 172.21.15.18:0/2395705041 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b4eb7e5c90 con 0x55b4eb8595c0 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.785+0000 7fd6c2000640 1 -- 172.21.15.18:0/2395705041 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd6c403b020 con 0x55b4eb8595c0 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.785+0000 7fd6e204f740 10 client.25435 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.785+0000 7fd6e204f740 10 client.25435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.785+0000 7fd6e204f740 20 client.25435 populate_metadata read hostname 'smithi018' 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.785+0000 7fd6e204f740 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b4eb86e5d0 0x55b4eb8709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.785+0000 7fd6e204f740 4 client.25435 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.785+0000 7fd6e204f740 1 -- 172.21.15.18:0/2395705041 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4eb7ae7d0 con 0x55b4eb86e5d0 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.785+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b4eb86e5d0 0x55b4eb8709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.786+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b4eb86e5d0 0x55b4eb8709f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96faddf4045731a server_cookie=c9ac161ddb131e07 in_seq=0 out_seq=0 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.786+0000 7fd6c2000640 10 client.25435 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.786+0000 7fd6c2000640 1 -- 172.21.15.18:0/2395705041 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b4eb7ae7d0 con 0x55b4eb86e5d0 2024-09-13T16:53:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.786+0000 7fd6c2000640 10 client.25435 handle_command_reply: tid=0 2024-09-13T16:53:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.786+0000 7fd6e204f740 1 client.25435 shutdown 2024-09-13T16:53:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 1 -- 172.21.15.18:0/2395705041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb8595c0 msgr2=0x55b4eb862ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb8595c0 0x55b4eb862ee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4011540 tx=0x7fd6c402bd00 comp rx=0 tx=0).stop 2024-09-13T16:53:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 1 -- 172.21.15.18:0/2395705041 shutdown_connections 2024-09-13T16:53:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b4eb86e5d0 0x55b4eb8709f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb85e650 0x55b4eb867f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb8595c0 0x55b4eb862ee0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 1 --2- 172.21.15.18:0/2395705041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb858c80 0x55b4eb8629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 1 -- 172.21.15.18:0/2395705041 >> 172.21.15.18:0/2395705041 conn(0x55b4eb8542f0 msgr2=0x55b4eb855b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6c2000640 0 client.25435 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 1 -- 172.21.15.18:0/2395705041 shutdown_connections 2024-09-13T16:53:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 1 -- 172.21.15.18:0/2395705041 wait complete. 2024-09-13T16:53:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.787+0000 7fd6e204f740 20 client.25435 trim_cache size 0 max 16384 2024-09-13T16:53:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.800+0000 7fd6e204f740 1 Processor -- start 2024-09-13T16:53:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.800+0000 7fd6e204f740 1 -- start start 2024-09-13T16:53:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb858c80 0x55b4eb875310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 0x55b4eb87e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb875850 0x55b4eb87ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6e204f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb522e60 con 0x55b4eb875850 2024-09-13T16:53:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6e204f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb84e900 con 0x55b4eb858c80 2024-09-13T16:53:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6e204f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb85e3c0 con 0x55b4eb85e650 2024-09-13T16:53:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 0x55b4eb87e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb858c80 0x55b4eb875310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 0x55b4eb87e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:46548/0 (socket says 172.21.15.18:46548) 2024-09-13T16:53:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6d7400640 1 -- 172.21.15.18:0/3936374185 learned_addr learned my addr 172.21.15.18:0/3936374185 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6dd200640 1 --2- 172.21.15.18:0/3936374185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb875850 0x55b4eb87ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6d7400640 1 -- 172.21.15.18:0/3936374185 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb858c80 msgr2=0x55b4eb875310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6d7400640 1 --2- 172.21.15.18:0/3936374185 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb858c80 0x55b4eb875310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6d7400640 1 -- 172.21.15.18:0/3936374185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb875850 msgr2=0x55b4eb87ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6d7400640 1 --2- 172.21.15.18:0/3936374185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb875850 0x55b4eb87ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6d7400640 1 -- 172.21.15.18:0/3936374185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4eb75c180 con 0x55b4eb85e650 2024-09-13T16:53:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.801+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/3936374185 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb858c80 0x55b4eb875310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:53:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.802+0000 7fd6d7400640 1 --2- 172.21.15.18:0/3936374185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 0x55b4eb87e850 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4011570 tx=0x7fd6c402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=274b4b566351b61c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.802+0000 7fd6ce000640 1 -- 172.21.15.18:0/3936374185 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400f3c0 con 0x55b4eb85e650 2024-09-13T16:53:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.802+0000 7fd6ce000640 1 -- 172.21.15.18:0/3936374185 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6c402a730 con 0x55b4eb85e650 2024-09-13T16:53:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.802+0000 7fd6ce000640 1 -- 172.21.15.18:0/3936374185 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40044a0 con 0x55b4eb85e650 2024-09-13T16:53:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.803+0000 7fd6e204f740 1 -- 172.21.15.18:0/3936374185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 msgr2=0x55b4eb87e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.803+0000 7fd6e204f740 1 --2- 172.21.15.18:0/3936374185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 0x55b4eb87e850 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4011570 tx=0x7fd6c402bf30 comp rx=0 tx=0).stop 2024-09-13T16:53:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.803+0000 7fd6e204f740 1 -- 172.21.15.18:0/3936374185 shutdown_connections 2024-09-13T16:53:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.803+0000 7fd6e204f740 1 --2- 172.21.15.18:0/3936374185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb875850 0x55b4eb87ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.803+0000 7fd6e204f740 1 --2- 172.21.15.18:0/3936374185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb85e650 0x55b4eb87e850 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.803+0000 7fd6e204f740 1 --2- 172.21.15.18:0/3936374185 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb858c80 0x55b4eb875310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.803+0000 7fd6e204f740 1 -- 172.21.15.18:0/3936374185 >> 172.21.15.18:0/3936374185 conn(0x55b4eb8542f0 msgr2=0x55b4eb8546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.803+0000 7fd6e204f740 1 -- 172.21.15.18:0/3936374185 shutdown_connections 2024-09-13T16:53:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.803+0000 7fd6e204f740 1 -- 172.21.15.18:0/3936374185 wait complete. 2024-09-13T16:53:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.804+0000 7fd6e204f740 1 -- start start 2024-09-13T16:53:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.804+0000 7fd6e204f740 1 Processor -- start 2024-09-13T16:53:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb858c80 0x55b4eb87c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb85e650 0x55b4eb87cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6e204f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb875850 0x55b4eb87db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6e204f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb87e0a0 con 0x55b4eb85e650 2024-09-13T16:53:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6e204f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb87e210 con 0x55b4eb875850 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6e204f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb87e3d0 con 0x55b4eb858c80 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6e204f740 10 client.0 _ll_register_callbacks cb 0x7fd6c4009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb85e650 0x55b4eb87cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6dd200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb875850 0x55b4eb87db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb85e650 0x55b4eb87cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49662/0 (socket says 172.21.15.18:49662) 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6d7400640 1 -- 172.21.15.18:0/579546718 learned_addr learned my addr 172.21.15.18:0/579546718 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb858c80 0x55b4eb87c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.805+0000 7fd6dd200640 1 -- 172.21.15.18:0/579546718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb858c80 msgr2=0x55b4eb87c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.806+0000 7fd6dd200640 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb858c80 0x55b4eb87c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.806+0000 7fd6dd200640 1 -- 172.21.15.18:0/579546718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb85e650 msgr2=0x55b4eb87cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.806+0000 7fd6dd200640 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb85e650 0x55b4eb87cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.806+0000 7fd6dd200640 1 -- 172.21.15.18:0/579546718 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d81a01e0 con 0x55b4eb875850 2024-09-13T16:53:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.806+0000 7fd6dd200640 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb875850 0x55b4eb87db60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd6d002aeb0 tx=0x7fd6d002a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a82f99c0fca4fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.806+0000 7fd6c2000640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:53:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.806+0000 7fd6c2000640 1 -- 172.21.15.18:0/579546718 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d004d040 con 0x55b4eb875850 2024-09-13T16:53:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.806+0000 7fd6c2000640 1 -- 172.21.15.18:0/579546718 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fd6d0004240 con 0x55b4eb875850 2024-09-13T16:53:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.806+0000 7fd6e204f740 1 -- 172.21.15.18:0/579546718 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd6c400fe60 con 0x55b4eb875850 2024-09-13T16:53:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.807+0000 7fd6c2000640 1 -- 172.21.15.18:0/579546718 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6d0004400 con 0x55b4eb875850 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.807+0000 7fd6e204f740 10 client.25469 fetch_fsmap learned FSMap version 25 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.807+0000 7fd6e204f740 1 -- 172.21.15.18:0/579546718 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b4eb7ba170 con 0x55b4eb875850 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.807+0000 7fd6c2000640 1 -- 172.21.15.18:0/579546718 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6c400fe60 con 0x55b4eb875850 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.808+0000 7fd6c2000640 1 -- 172.21.15.18:0/579546718 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd6d0059070 con 0x55b4eb875850 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.808+0000 7fd6e204f740 10 client.25469 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.808+0000 7fd6e204f740 10 client.25469 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.808+0000 7fd6e204f740 20 client.25469 populate_metadata read hostname 'smithi018' 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.808+0000 7fd6e204f740 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b4eb8c6040 0x55b4eb8c8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.808+0000 7fd6e204f740 4 client.25469 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.808+0000 7fd6e204f740 1 -- 172.21.15.18:0/579546718 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b4eb4af300 con 0x55b4eb8c6040 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.808+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b4eb8c6040 0x55b4eb8c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.809+0000 7fd6c2000640 10 client.25469 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.809+0000 7fd6d7e00640 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b4eb8c6040 0x55b4eb8c8460 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70f77ce04c72b684 server_cookie=9d25bc9e3c700e0e in_seq=0 out_seq=0 2024-09-13T16:53:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.812+0000 7fd6c2000640 1 -- 172.21.15.18:0/579546718 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b4eb4af300 con 0x55b4eb8c6040 2024-09-13T16:53:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.812+0000 7fd6c2000640 10 client.25469 handle_command_reply: tid=0 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.812+0000 7fd6e204f740 1 client.25469 shutdown 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 1 -- 172.21.15.18:0/579546718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb875850 msgr2=0x55b4eb87db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb875850 0x55b4eb87db60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd6d002aeb0 tx=0x7fd6d002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 1 -- 172.21.15.18:0/579546718 shutdown_connections 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b4eb8c6040 0x55b4eb8c8460 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6c2000640 0 client.25469 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4eb85e650 0x55b4eb87cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b4eb875850 0x55b4eb87db60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 1 --2- 172.21.15.18:0/579546718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4eb858c80 0x55b4eb87c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 1 -- 172.21.15.18:0/579546718 >> 172.21.15.18:0/579546718 conn(0x55b4eb8542f0 msgr2=0x55b4eb862960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 1 -- 172.21.15.18:0/579546718 shutdown_connections 2024-09-13T16:53:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 1 -- 172.21.15.18:0/579546718 wait complete. 2024-09-13T16:53:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.813+0000 7fd6e204f740 20 client.25469 trim_cache size 0 max 16384 2024-09-13T16:53:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:53:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:53:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:53:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:53:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.814+0000 7fd6ddc00640 1 -- 172.21.15.18:0/2045488723 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6bc0a11b0 msgr2=0x7fd6bc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.814+0000 7fd6ddc00640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6bc0a11b0 0x7fd6bc0a3670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0006010 tx=0x7fd6d0031be0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.814+0000 7fd6ddc00640 1 -- 172.21.15.18:0/2045488723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d80fe450 msgr2=0x7fd6d8197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.814+0000 7fd6ddc00640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d80fe450 0x7fd6d8197d20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800e9f0 tx=0x7fd6c800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.814+0000 7fd6ddc00640 1 -- 172.21.15.18:0/2045488723 shutdown_connections 2024-09-13T16:53:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.814+0000 7fd6ddc00640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6d80ff730 0x7fd6d819f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.814+0000 7fd6ddc00640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6d80fed90 0x7fd6d8198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.814+0000 7fd6ddc00640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6bc0a11b0 0x7fd6bc0a3670 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.814+0000 7fd6ddc00640 1 --2- 172.21.15.18:0/2045488723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d80fe450 0x7fd6d8197d20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.814+0000 7fd6ddc00640 1 -- 172.21.15.18:0/2045488723 >> 172.21.15.18:0/2045488723 conn(0x7fd6d80fa1c0 msgr2=0x7fd6d80fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.815+0000 7fd6ddc00640 1 -- 172.21.15.18:0/2045488723 shutdown_connections 2024-09-13T16:53:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:05.815+0000 7fd6ddc00640 1 -- 172.21.15.18:0/2045488723 wait complete. 2024-09-13T16:53:06.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:05 smithi094 ceph-mon[35259]: pgmap v410: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-13T16:53:06.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:05 smithi018 ceph-mon[30981]: pgmap v410: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-13T16:53:06.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:05 smithi144 ceph-mon[35328]: pgmap v410: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-13T16:53:08.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:07 smithi094 ceph-mon[35259]: pgmap v411: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T16:53:08.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:07 smithi018 ceph-mon[30981]: pgmap v411: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T16:53:08.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:07 smithi144 ceph-mon[35328]: pgmap v411: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T16:53:10.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:09 smithi094 ceph-mon[35259]: pgmap v412: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:53:10.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:09 smithi018 ceph-mon[30981]: pgmap v412: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:53:10.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:09 smithi144 ceph-mon[35328]: pgmap v412: 129 pgs: 129 active+clean; 666 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T16:53:12.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:11 smithi094 ceph-mon[35259]: pgmap v413: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:53:12.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:11 smithi018 ceph-mon[30981]: pgmap v413: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:53:12.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:11 smithi144 ceph-mon[35328]: pgmap v413: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T16:53:14.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:13 smithi094 ceph-mon[35259]: pgmap v414: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:14.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:13 smithi018 ceph-mon[30981]: pgmap v414: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:14.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:13 smithi144 ceph-mon[35328]: pgmap v414: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:16.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:15 smithi094 ceph-mon[35259]: pgmap v415: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:16.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:15 smithi018 ceph-mon[30981]: pgmap v415: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:16.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:15 smithi144 ceph-mon[35328]: pgmap v415: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:18.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:17 smithi094 ceph-mon[35259]: pgmap v416: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:53:18.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:17 smithi018 ceph-mon[30981]: pgmap v416: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:53:18.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:17 smithi144 ceph-mon[35328]: pgmap v416: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T16:53:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.940+0000 7f9fec800640 1 -- 172.21.15.18:0/3113795504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fe41018c0 msgr2=0x7f9fe4108150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.940+0000 7f9fec800640 1 --2- 172.21.15.18:0/3113795504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fe41018c0 0x7f9fe4108150 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009be0 tx=0x7f9fe002a6c0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.940+0000 7f9fec800640 1 -- 172.21.15.18:0/3113795504 shutdown_connections 2024-09-13T16:53:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.940+0000 7f9fec800640 1 --2- 172.21.15.18:0/3113795504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fe41018c0 0x7f9fe4108150 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.940+0000 7f9fec800640 1 --2- 172.21.15.18:0/3113795504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fe4100f00 0x7f9fe4101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.940+0000 7f9fec800640 1 --2- 172.21.15.18:0/3113795504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fe40ffd10 0x7f9fe4100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.940+0000 7f9fec800640 1 -- 172.21.15.18:0/3113795504 >> 172.21.15.18:0/3113795504 conn(0x7f9fe40fb4b0 msgr2=0x7f9fe40fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.941+0000 7f9fec800640 1 -- 172.21.15.18:0/3113795504 shutdown_connections 2024-09-13T16:53:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.941+0000 7f9fec800640 1 -- 172.21.15.18:0/3113795504 wait complete. 2024-09-13T16:53:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fec800640 1 Processor -- start 2024-09-13T16:53:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fec800640 1 -- start start 2024-09-13T16:53:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fec800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fe40ffd10 0x7f9fe4074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fec800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fe4100f00 0x7f9fe40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fec800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fe41018c0 0x7f9fe4072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fec800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4073540 con 0x7f9fe41018c0 2024-09-13T16:53:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fec800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe40736b0 con 0x7f9fe40ffd10 2024-09-13T16:53:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fec800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe419fdb0 con 0x7f9fe4100f00 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fe9e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fe40ffd10 0x7f9fe4074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fea800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fe41018c0 0x7f9fe4072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fe9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fe4100f00 0x7f9fe40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fe9e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fe40ffd10 0x7f9fe4074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:57626/0 (socket says 172.21.15.18:57626) 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.942+0000 7f9fe9e00640 1 -- 172.21.15.18:0/3255013865 learned_addr learned my addr 172.21.15.18:0/3255013865 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fe9e00640 1 -- 172.21.15.18:0/3255013865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fe4100f00 msgr2=0x7f9fe40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fe4100f00 0x7f9fe40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fe9e00640 1 -- 172.21.15.18:0/3255013865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fe41018c0 msgr2=0x7f9fe4072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fe41018c0 0x7f9fe4072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fe9e00640 1 -- 172.21.15.18:0/3255013865 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8009560 con 0x7f9fe40ffd10 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fe9400640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fe4100f00 0x7f9fe40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fe40ffd10 0x7f9fe4074260 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800e9d0 tx=0x7f9fd800ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fdea00640 1 -- 172.21.15.18:0/3255013865 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800cde0 con 0x7f9fe40ffd10 2024-09-13T16:53:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fec800640 1 -- 172.21.15.18:0/3255013865 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe0009840 con 0x7f9fe40ffd10 2024-09-13T16:53:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fdea00640 1 -- 172.21.15.18:0/3255013865 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fd80108f0 con 0x7f9fe40ffd10 2024-09-13T16:53:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.943+0000 7f9fdea00640 1 -- 172.21.15.18:0/3255013865 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80188e0 con 0x7f9fe40ffd10 2024-09-13T16:53:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.944+0000 7f9fec800640 1 -- 172.21.15.18:0/3255013865 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe41a03e0 con 0x7f9fe40ffd10 2024-09-13T16:53:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.946+0000 7f9fef5d5740 1 Processor -- start 2024-09-13T16:53:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fef5d5740 1 -- start start 2024-09-13T16:53:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa76ea70 0x5573aa76ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76f3b0 0x5573aa773e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa776900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa67abb0 con 0x5573aa774440 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa6d8a70 con 0x5573aa76ea70 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa6d6200 con 0x5573aa76f3b0 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fdea00640 1 -- 172.21.15.18:0/3255013865 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9fd8010a60 con 0x7f9fe40ffd10 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fe9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa776900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fe9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa776900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57122/0 (socket says 172.21.15.18:57122) 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fe9400640 1 -- 172.21.15.18:0/2604259680 learned_addr learned my addr 172.21.15.18:0/2604259680 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.947+0000 7f9fea800640 1 --2- 172.21.15.18:0/2604259680 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa76ea70 0x5573aa76ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/2604259680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76f3b0 0x5573aa773e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fe9400640 1 -- 172.21.15.18:0/2604259680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76f3b0 msgr2=0x5573aa773e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fe9400640 1 --2- 172.21.15.18:0/2604259680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76f3b0 0x5573aa773e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fe9400640 1 -- 172.21.15.18:0/2604259680 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa76ea70 msgr2=0x5573aa76ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fe9400640 1 --2- 172.21.15.18:0/2604259680 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa76ea70 0x5573aa76ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fe9400640 1 -- 172.21.15.18:0/2604259680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573aa673940 con 0x5573aa774440 2024-09-13T16:53:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/2604259680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76f3b0 0x5573aa773e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:53:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fe9400640 1 --2- 172.21.15.18:0/2604259680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa776900 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40114f0 tx=0x7f9fd40119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aed5fa0408f305b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fd3400640 1 -- 172.21.15.18:0/2604259680 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4004030 con 0x5573aa774440 2024-09-13T16:53:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fd3400640 1 -- 172.21.15.18:0/2604259680 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fd40035f0 con 0x5573aa774440 2024-09-13T16:53:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.948+0000 7f9fd3400640 1 -- 172.21.15.18:0/2604259680 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400f860 con 0x5573aa774440 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fdea00640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9fcc0a1090 0x7f9fcc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fdea00640 1 -- 172.21.15.18:0/3255013865 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9fd8014070 con 0x7f9fe40ffd10 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2604259680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 msgr2=0x5573aa776900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fea800640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9fcc0a1090 0x7f9fcc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2604259680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa776900 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40114f0 tx=0x7f9fd40119b0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2604259680 shutdown_connections 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2604259680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa776900 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2604259680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76f3b0 0x5573aa773e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2604259680 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa76ea70 0x5573aa76ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2604259680 >> 172.21.15.18:0/2604259680 conn(0x5573aa76a0e0 msgr2=0x5573aa76a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2604259680 shutdown_connections 2024-09-13T16:53:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.949+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2604259680 wait complete. 2024-09-13T16:53:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.950+0000 7f9fef5d5740 1 -- start start 2024-09-13T16:53:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.950+0000 7f9fea800640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9fcc0a1090 0x7f9fcc0a3550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9fe002abe0 tx=0x7f9fe0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.950+0000 7f9fef5d5740 1 Processor -- start 2024-09-13T16:53:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa7786d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa778c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 0x5573aa77fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa6d1af0 con 0x5573aa76f3b0 2024-09-13T16:53:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa68ff20 con 0x5573aa774440 2024-09-13T16:53:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa68fbc0 con 0x5573aa76ea70 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fef5d5740 10 client.0 _ll_register_callbacks cb 0x5573aa6c1a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fe9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa778c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fe9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa778c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57136/0 (socket says 172.21.15.18:57136) 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fe9400640 1 -- 172.21.15.18:0/540852998 learned_addr learned my addr 172.21.15.18:0/540852998 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa7786d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fea800640 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 0x5573aa77fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fe9400640 1 -- 172.21.15.18:0/540852998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 msgr2=0x5573aa7786d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fe9400640 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa7786d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fe9400640 1 -- 172.21.15.18:0/540852998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 msgr2=0x5573aa77fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fe9400640 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 0x5573aa77fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fe9400640 1 -- 172.21.15.18:0/540852998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd4009cc0 con 0x5573aa76f3b0 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.951+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa7786d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.952+0000 7f9fe9400640 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa778c10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40114c0 tx=0x7f9fd4003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca898f74f04a628 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.952+0000 7f9fc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.952+0000 7f9fc7e00640 1 -- 172.21.15.18:0/540852998 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4005040 con 0x5573aa76f3b0 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.952+0000 7f9fc7e00640 1 -- 172.21.15.18:0/540852998 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9fd40051a0 con 0x5573aa76f3b0 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.952+0000 7f9fef5d5740 1 -- 172.21.15.18:0/540852998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573aa6fbc90 con 0x5573aa76f3b0 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.952+0000 7f9fc7e00640 1 -- 172.21.15.18:0/540852998 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fd4005360 con 0x5573aa76f3b0 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.952+0000 7f9fef5d5740 10 client.15429 fetch_fsmap learned FSMap version 25 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.952+0000 7f9fef5d5740 1 -- 172.21.15.18:0/540852998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5573aa6d0170 con 0x5573aa76f3b0 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.953+0000 7f9fc7e00640 1 -- 172.21.15.18:0/540852998 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5573aa6fbc90 con 0x5573aa76f3b0 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.953+0000 7f9fc7e00640 1 -- 172.21.15.18:0/540852998 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9fd400f630 con 0x5573aa76f3b0 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.953+0000 7f9fef5d5740 10 client.15429 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.953+0000 7f9fef5d5740 10 client.15429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.953+0000 7f9fef5d5740 20 client.15429 populate_metadata read hostname 'smithi018' 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.953+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5573aa784190 0x5573aa786580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.953+0000 7f9fef5d5740 4 client.15429 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:53:18.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.953+0000 7f9fef5d5740 1 -- 172.21.15.18:0/540852998 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573aa6c47d0 con 0x5573aa784190 2024-09-13T16:53:18.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.953+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5573aa784190 0x5573aa786580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.954+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5573aa784190 0x5573aa786580 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d21370d6ac631ef server_cookie=9e458af05635a8e9 in_seq=0 out_seq=0 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.954+0000 7f9fc7e00640 10 client.15429 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fc7e00640 1 -- 172.21.15.18:0/540852998 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5573aa6c47d0 con 0x5573aa784190 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fc7e00640 10 client.15429 handle_command_reply: tid=0 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 client.15429 shutdown 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 -- 172.21.15.18:0/540852998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 msgr2=0x5573aa778c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa778c10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40114c0 tx=0x7f9fd4003990 comp rx=0 tx=0).stop 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 -- 172.21.15.18:0/540852998 shutdown_connections 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5573aa784190 0x5573aa786580 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa778c10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 0x5573aa77fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/540852998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa7786d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fc7e00640 0 client.15429 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 -- 172.21.15.18:0/540852998 >> 172.21.15.18:0/540852998 conn(0x5573aa76a0e0 msgr2=0x5573aa76b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 -- 172.21.15.18:0/540852998 shutdown_connections 2024-09-13T16:53:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 1 -- 172.21.15.18:0/540852998 wait complete. 2024-09-13T16:53:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.955+0000 7f9fef5d5740 20 client.15429 trim_cache size 0 max 16384 2024-09-13T16:53:18.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.968+0000 7f9fef5d5740 1 Processor -- start 2024-09-13T16:53:18.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.968+0000 7f9fef5d5740 1 -- start start 2024-09-13T16:53:18.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa773870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa76f3b0 0x5573aa773db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa77fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa438e60 con 0x5573aa774440 2024-09-13T16:53:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa783d30 con 0x5573aa76f3b0 2024-09-13T16:53:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa76bf70 con 0x5573aa76ea70 2024-09-13T16:53:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fea800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa77fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fea800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa77fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57146/0 (socket says 172.21.15.18:57146) 2024-09-13T16:53:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fea800640 1 -- 172.21.15.18:0/2653141211 learned_addr learned my addr 172.21.15.18:0/2653141211 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fe9400640 1 --2- 172.21.15.18:0/2653141211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa76f3b0 0x5573aa773db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/2653141211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa773870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fea800640 1 -- 172.21.15.18:0/2653141211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 msgr2=0x5573aa773870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:18.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fea800640 1 --2- 172.21.15.18:0/2653141211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa773870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fea800640 1 -- 172.21.15.18:0/2653141211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa76f3b0 msgr2=0x5573aa773db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:18.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.969+0000 7f9fea800640 1 --2- 172.21.15.18:0/2653141211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa76f3b0 0x5573aa773db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.970+0000 7f9fea800640 1 -- 172.21.15.18:0/2653141211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573aa672180 con 0x5573aa774440 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.970+0000 7f9fea800640 1 --2- 172.21.15.18:0/2653141211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa77fc10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0033000 tx=0x7f9fe0041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d657dce7eb73ff6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.970+0000 7f9fd3e00640 1 -- 172.21.15.18:0/2653141211 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe004f070 con 0x5573aa774440 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.970+0000 7f9fd3e00640 1 -- 172.21.15.18:0/2653141211 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fe0004040 con 0x5573aa774440 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.970+0000 7f9fd3e00640 1 -- 172.21.15.18:0/2653141211 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0041070 con 0x5573aa774440 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2653141211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 msgr2=0x5573aa77fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2653141211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa77fc10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0033000 tx=0x7f9fe0041000 comp rx=0 tx=0).stop 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2653141211 shutdown_connections 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2653141211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa774440 0x5573aa77fc10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2653141211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa76f3b0 0x5573aa773db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2653141211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa773870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2653141211 >> 172.21.15.18:0/2653141211 conn(0x5573aa76a0e0 msgr2=0x5573aa78aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2653141211 shutdown_connections 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2653141211 wait complete. 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 -- start start 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.971+0000 7f9fef5d5740 1 Processor -- start 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa77bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa77c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fef5d5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 0x5573aa77f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa77f810 con 0x5573aa76f3b0 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa77f980 con 0x5573aa774440 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fef5d5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aa77fb40 con 0x5573aa76ea70 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fef5d5740 10 client.0 _ll_register_callbacks cb 0x7f9fd4009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fe9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa77c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fe9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa77c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57154/0 (socket says 172.21.15.18:57154) 2024-09-13T16:53:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fe9400640 1 -- 172.21.15.18:0/2791212647 learned_addr learned my addr 172.21.15.18:0/2791212647 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa77bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fea800640 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 0x5573aa77f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fe9400640 1 -- 172.21.15.18:0/2791212647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 msgr2=0x5573aa77bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fe9400640 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa77bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fe9400640 1 -- 172.21.15.18:0/2791212647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 msgr2=0x5573aa77f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fe9400640 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 0x5573aa77f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fe9400640 1 -- 172.21.15.18:0/2791212647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe4108a50 con 0x5573aa76f3b0 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.972+0000 7f9fea800640 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 0x5573aa77f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.973+0000 7f9fe9400640 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa77c2b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4004560 tx=0x7f9fd400fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a320c4f2ec49a01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.973+0000 7f9fc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.973+0000 7f9fc7e00640 1 -- 172.21.15.18:0/2791212647 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4003fc0 con 0x5573aa76f3b0 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.973+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2791212647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9fd40035f0 con 0x5573aa76f3b0 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.973+0000 7f9fc7e00640 1 -- 172.21.15.18:0/2791212647 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9fd4000e40 con 0x5573aa76f3b0 2024-09-13T16:53:18.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.973+0000 7f9fc7e00640 1 -- 172.21.15.18:0/2791212647 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fd400f7d0 con 0x5573aa76f3b0 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.973+0000 7f9fef5d5740 10 client.15435 fetch_fsmap learned FSMap version 25 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.973+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2791212647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5573aa697560 con 0x5573aa76f3b0 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.974+0000 7f9fc7e00640 1 -- 172.21.15.18:0/2791212647 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fd40035f0 con 0x5573aa76f3b0 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.974+0000 7f9fc7e00640 1 -- 172.21.15.18:0/2791212647 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9fd4019450 con 0x5573aa76f3b0 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.974+0000 7f9fef5d5740 10 client.15435 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.974+0000 7f9fef5d5740 10 client.15435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.974+0000 7f9fef5d5740 20 client.15435 populate_metadata read hostname 'smithi018' 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.974+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5573aa7db680 0x5573aa7dda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.974+0000 7f9fef5d5740 4 client.15435 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.974+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2791212647 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5573aa3c5300 con 0x5573aa7db680 2024-09-13T16:53:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.974+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5573aa7db680 0x5573aa7dda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.975+0000 7f9fc7e00640 10 client.15435 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.975+0000 7f9fe9e00640 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5573aa7db680 0x5573aa7dda70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42e0a37548956a04 server_cookie=12ab67411b627097 in_seq=0 out_seq=0 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fc7e00640 1 -- 172.21.15.18:0/2791212647 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5573aa3c5300 con 0x5573aa7db680 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fc7e00640 10 client.15435 handle_command_reply: tid=0 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 client.15435 shutdown 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2791212647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 msgr2=0x5573aa77c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa77c2b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4004560 tx=0x7f9fd400fbc0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2791212647 shutdown_connections 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5573aa7db680 0x5573aa7dda70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573aa76f3b0 0x5573aa77c2b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5573aa774440 0x5573aa77f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 --2- 172.21.15.18:0/2791212647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573aa76ea70 0x5573aa77bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fc7e00640 0 client.15435 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2791212647 >> 172.21.15.18:0/2791212647 conn(0x5573aa76a0e0 msgr2=0x5573aa770230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2791212647 shutdown_connections 2024-09-13T16:53:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.978+0000 7f9fef5d5740 1 -- 172.21.15.18:0/2791212647 wait complete. 2024-09-13T16:53:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fef5d5740 20 client.15435 trim_cache size 0 max 16384 2024-09-13T16:53:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:53:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:53:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:53:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:53:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 -- 172.21.15.18:0/3255013865 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9fcc0a1090 msgr2=0x7f9fcc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9fcc0a1090 0x7f9fcc0a3550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9fe002abe0 tx=0x7f9fe0005fd0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 -- 172.21.15.18:0/3255013865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fe40ffd10 msgr2=0x7f9fe4074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fe40ffd10 0x7f9fe4074260 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800e9d0 tx=0x7f9fd800ee90 comp rx=0 tx=0).stop 2024-09-13T16:53:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 -- 172.21.15.18:0/3255013865 shutdown_connections 2024-09-13T16:53:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9fcc0a1090 0x7f9fcc0a3550 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fe41018c0 0x7f9fe4072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fe4100f00 0x7f9fe40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 --2- 172.21.15.18:0/3255013865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fe40ffd10 0x7f9fe4074260 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 -- 172.21.15.18:0/3255013865 >> 172.21.15.18:0/3255013865 conn(0x7f9fe40fb4b0 msgr2=0x7f9fe41043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 -- 172.21.15.18:0/3255013865 shutdown_connections 2024-09-13T16:53:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:18.979+0000 7f9fec800640 1 -- 172.21.15.18:0/3255013865 wait complete. 2024-09-13T16:53:21.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:20 smithi094 ceph-mon[35259]: pgmap v417: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:21.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:20 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:53:21.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:20 smithi018 ceph-mon[30981]: pgmap v417: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:21.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:20 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:53:21.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:20 smithi144 ceph-mon[35328]: pgmap v417: 129 pgs: 129 active+clean; 667 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:21.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:20 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:53:21.428 INFO:tasks.workunit.client.0.smithi018.stderr:Updating files: 59% (7503/12697) Updating files: 60% (7619/12697) Updating files: 61% (7746/12697) Updating files: 62% (7873/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 95% (12131/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T16:53:22.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:53:22.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:53:22.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:21 smithi144 ceph-mon[35328]: pgmap v418: 129 pgs: 129 active+clean; 668 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-13T16:53:22.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:53:22.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:53:22.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:21 smithi094 ceph-mon[35259]: pgmap v418: 129 pgs: 129 active+clean; 668 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-13T16:53:22.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:53:22.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:53:22.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:53:22.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:21 smithi018 ceph-mon[30981]: pgmap v418: 129 pgs: 129 active+clean; 668 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-13T16:53:22.629 INFO:tasks.workunit.client.0.smithi018.stderr:Note: switching to '50bbe7f395997dcd871813949c49addbbf630361'. 2024-09-13T16:53:22.629 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-13T16:53:22.629 INFO:tasks.workunit.client.0.smithi018.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T16:53:22.629 INFO:tasks.workunit.client.0.smithi018.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T16:53:22.629 INFO:tasks.workunit.client.0.smithi018.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T16:53:22.629 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr: git switch -c 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr:Or undo this operation with: 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr: git switch - 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-13T16:53:22.630 INFO:tasks.workunit.client.0.smithi018.stderr:HEAD is now at 50bbe7f3959 Merge PR #58789 into wip-rishabh-testing-20240910.095512-reef 2024-09-13T16:53:22.647 DEBUG:teuthology.orchestra.run.smithi018:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T16:53:22.731 INFO:tasks.workunit.client.0.smithi018.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T16:53:22.736 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T16:53:22.736 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T16:53:23.496 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T16:53:23.593 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T16:53:23.659 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T16:53:23.663 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T16:53:23.663 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T16:53:23.728 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T16:53:23.735 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T16:53:23.735 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T16:53:23.811 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-13T16:53:23.813 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-13T16:53:23.813 DEBUG:teuthology.orchestra.run.smithi018:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=50bbe7f395997dcd871813949c49addbbf630361 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-13T16:53:23.902 INFO:tasks.workunit.client.0.smithi018.stdout:getting blogbench 2024-09-13T16:53:23.941 INFO:tasks.workunit.client.0.smithi018.stderr:--2024-09-13 16:53:23-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-13T16:53:23.941 INFO:tasks.workunit.client.0.smithi018.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-13T16:53:23.963 INFO:tasks.workunit.client.0.smithi018.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-13T16:53:23.984 INFO:tasks.workunit.client.0.smithi018.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-13T16:53:23.985 INFO:tasks.workunit.client.0.smithi018.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-13T16:53:23.986 INFO:tasks.workunit.client.0.smithi018.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-13T16:53:23.990 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-13T16:53:24.026 INFO:tasks.workunit.client.0.smithi018.stderr: 0K .......... .......... .......... .......... .......... 49% 1.25M 0s 2024-09-13T16:53:24.046 INFO:tasks.workunit.client.0.smithi018.stderr: 50K .......... .......... .......... .......... .......... 99% 2.37M 0s 2024-09-13T16:53:24.046 INFO:tasks.workunit.client.0.smithi018.stderr: 100K 100% 1.74T=0.06s 2024-09-13T16:53:24.046 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-13T16:53:24.047 INFO:tasks.workunit.client.0.smithi018.stderr:2024-09-13 16:53:24 (1.65 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-13T16:53:24.047 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-13T16:53:24.092 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/ 2024-09-13T16:53:24.094 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/m4/ 2024-09-13T16:53:24.095 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-13T16:53:24.097 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/man/ 2024-09-13T16:53:24.099 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/man/blogbench.8 2024-09-13T16:53:24.100 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/man/Makefile.am 2024-09-13T16:53:24.102 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/man/Makefile.in 2024-09-13T16:53:24.103 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/ 2024-09-13T16:53:24.104 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-13T16:53:24.106 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-13T16:53:24.107 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/blogbench.c 2024-09-13T16:53:24.109 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/blogbench.h 2024-09-13T16:53:24.110 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-13T16:53:24.111 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-13T16:53:24.113 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-13T16:53:24.114 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-13T16:53:24.115 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-13T16:53:24.117 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/Makefile.am 2024-09-13T16:53:24.118 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/Makefile.in 2024-09-13T16:53:24.119 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/process.c 2024-09-13T16:53:24.121 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/globals.h 2024-09-13T16:53:24.122 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/commenter.c 2024-09-13T16:53:24.123 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/rewriter.c 2024-09-13T16:53:24.124 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/reader.c 2024-09-13T16:53:24.125 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/writer.c 2024-09-13T16:53:24.127 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/helpers.c 2024-09-13T16:53:24.128 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/NEWS 2024-09-13T16:53:24.129 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/compile 2024-09-13T16:53:24.130 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/depcomp 2024-09-13T16:53:24.131 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/aclocal.m4 2024-09-13T16:53:24.131 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/README 2024-09-13T16:53:24.132 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/configure 2024-09-13T16:53:24.137 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/configure.ac 2024-09-13T16:53:24.138 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/config.guess 2024-09-13T16:53:24.139 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/install-sh 2024-09-13T16:53:24.140 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/config.sub 2024-09-13T16:53:24.140 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/missing 2024-09-13T16:53:24.141 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/mkinstalldirs 2024-09-13T16:53:24.142 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/Makefile.am 2024-09-13T16:53:24.143 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/Makefile.in 2024-09-13T16:53:24.144 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/config.h.in 2024-09-13T16:53:24.145 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/AUTHORS 2024-09-13T16:53:24.146 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/INSTALL 2024-09-13T16:53:24.147 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/ChangeLog 2024-09-13T16:53:24.148 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/COPYING 2024-09-13T16:53:24.149 INFO:tasks.workunit.client.0.smithi018.stdout:making blogbench 2024-09-13T16:53:24.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:23 smithi094 ceph-mon[35259]: pgmap v419: 129 pgs: 129 active+clean; 668 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:24.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:23 smithi018 ceph-mon[30981]: pgmap v419: 129 pgs: 129 active+clean; 668 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:24.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:23 smithi144 ceph-mon[35328]: pgmap v419: 129 pgs: 129 active+clean; 668 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T16:53:24.367 INFO:tasks.workunit.client.0.smithi018.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-13T16:53:25.380 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether build environment is sane... yes 2024-09-13T16:53:25.397 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gawk... gawk 2024-09-13T16:53:25.422 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether make sets $(MAKE)... yes 2024-09-13T16:53:25.441 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc... gcc 2024-09-13T16:53:25.530 INFO:tasks.workunit.client.0.smithi018.stdout:checking for C compiler default output file name... a.out 2024-09-13T16:53:25.534 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether the C compiler works... yes 2024-09-13T16:53:25.537 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether we are cross compiling... no 2024-09-13T16:53:25.596 INFO:tasks.workunit.client.0.smithi018.stdout:checking for suffix of executables... 2024-09-13T16:53:25.655 INFO:tasks.workunit.client.0.smithi018.stdout:checking for suffix of object files... o 2024-09-13T16:53:25.712 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether we are using the GNU C compiler... yes 2024-09-13T16:53:25.770 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether gcc accepts -g... yes 2024-09-13T16:53:25.917 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-13T16:53:25.976 INFO:tasks.workunit.client.0.smithi018.stdout:checking for style of include used by make... GNU 2024-09-13T16:53:26.097 INFO:tasks.workunit.client.0.smithi018.stdout:checking dependency style of gcc... gcc3 2024-09-13T16:53:26.097 INFO:tasks.workunit.client.0.smithi018.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-13T16:53:26.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:25 smithi094 ceph-mon[35259]: pgmap v420: 129 pgs: 129 active+clean; 794 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-13T16:53:26.179 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to run the C preprocessor... gcc -E 2024-09-13T16:53:26.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:25 smithi018 ceph-mon[30981]: pgmap v420: 129 pgs: 129 active+clean; 794 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-13T16:53:26.253 INFO:tasks.workunit.client.0.smithi018.stdout:checking for egrep... grep -E 2024-09-13T16:53:26.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:25 smithi144 ceph-mon[35328]: pgmap v420: 129 pgs: 129 active+clean; 794 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-13T16:53:26.272 INFO:tasks.workunit.client.0.smithi018.stdout:checking for AIX... no 2024-09-13T16:53:26.368 INFO:tasks.workunit.client.0.smithi018.stdout:checking for library containing strerror... none required 2024-09-13T16:53:26.607 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ANSI C header files... yes 2024-09-13T16:53:26.672 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-13T16:53:26.751 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/types.h... yes 2024-09-13T16:53:26.835 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/stat.h... yes 2024-09-13T16:53:26.917 INFO:tasks.workunit.client.0.smithi018.stdout:checking for stdlib.h... yes 2024-09-13T16:53:27.002 INFO:tasks.workunit.client.0.smithi018.stdout:checking for string.h... yes 2024-09-13T16:53:27.087 INFO:tasks.workunit.client.0.smithi018.stdout:checking for memory.h... yes 2024-09-13T16:53:27.175 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strings.h... yes 2024-09-13T16:53:27.262 INFO:tasks.workunit.client.0.smithi018.stdout:checking for inttypes.h... yes 2024-09-13T16:53:27.347 INFO:tasks.workunit.client.0.smithi018.stdout:checking for stdint.h... yes 2024-09-13T16:53:27.436 INFO:tasks.workunit.client.0.smithi018.stdout:checking for unistd.h... yes 2024-09-13T16:53:27.456 INFO:tasks.workunit.client.0.smithi018.stdout:checking for memory.h... (cached) yes 2024-09-13T16:53:27.469 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strings.h... (cached) yes 2024-09-13T16:53:27.483 INFO:tasks.workunit.client.0.smithi018.stdout:checking for unistd.h... (cached) yes 2024-09-13T16:53:27.565 INFO:tasks.workunit.client.0.smithi018.stdout:checking locale.h usability... yes 2024-09-13T16:53:27.600 INFO:tasks.workunit.client.0.smithi018.stdout:checking locale.h presence... yes 2024-09-13T16:53:27.602 INFO:tasks.workunit.client.0.smithi018.stdout:checking for locale.h... yes 2024-09-13T16:53:27.624 INFO:tasks.workunit.client.0.smithi018.stdout:checking for stdlib.h... (cached) yes 2024-09-13T16:53:27.637 INFO:tasks.workunit.client.0.smithi018.stdout:checking for string.h... (cached) yes 2024-09-13T16:53:27.726 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/socket.h usability... yes 2024-09-13T16:53:27.765 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/socket.h presence... yes 2024-09-13T16:53:27.767 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/socket.h... yes 2024-09-13T16:53:27.855 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/time.h usability... yes 2024-09-13T16:53:27.892 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/time.h presence... yes 2024-09-13T16:53:27.893 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/time.h... yes 2024-09-13T16:53:27.984 INFO:tasks.workunit.client.0.smithi018.stdout:checking fcntl.h usability... yes 2024-09-13T16:53:28.021 INFO:tasks.workunit.client.0.smithi018.stdout:checking fcntl.h presence... yes 2024-09-13T16:53:28.022 INFO:tasks.workunit.client.0.smithi018.stdout:checking for fcntl.h... yes 2024-09-13T16:53:28.114 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fcntl.h usability... yes 2024-09-13T16:53:28.150 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fcntl.h presence... yes 2024-09-13T16:53:28.151 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/fcntl.h... yes 2024-09-13T16:53:28.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:27 smithi094 ceph-mon[35259]: pgmap v421: 129 pgs: 129 active+clean; 794 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-13T16:53:28.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:27 smithi018 ceph-mon[30981]: pgmap v421: 129 pgs: 129 active+clean; 794 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-13T16:53:28.264 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/param.h usability... yes 2024-09-13T16:53:28.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:27 smithi144 ceph-mon[35328]: pgmap v421: 129 pgs: 129 active+clean; 794 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-13T16:53:28.305 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/param.h presence... yes 2024-09-13T16:53:28.307 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/param.h... yes 2024-09-13T16:53:28.382 INFO:tasks.workunit.client.0.smithi018.stdout:checking ioctl.h usability... no 2024-09-13T16:53:28.418 INFO:tasks.workunit.client.0.smithi018.stdout:checking ioctl.h presence... no 2024-09-13T16:53:28.420 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ioctl.h... no 2024-09-13T16:53:28.502 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/ioctl.h usability... yes 2024-09-13T16:53:28.538 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/ioctl.h presence... yes 2024-09-13T16:53:28.539 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/ioctl.h... yes 2024-09-13T16:53:28.623 INFO:tasks.workunit.client.0.smithi018.stdout:checking return type of signal handlers... void 2024-09-13T16:53:28.699 INFO:tasks.workunit.client.0.smithi018.stdout:checking for size_t... yes 2024-09-13T16:53:28.765 INFO:tasks.workunit.client.0.smithi018.stdout:checking for dev_t... yes 2024-09-13T16:53:28.840 INFO:tasks.workunit.client.0.smithi018.stdout:checking for short... yes 2024-09-13T16:53:28.954 INFO:tasks.workunit.client.0.smithi018.stdout:checking size of short... 2 2024-09-13T16:53:29.031 INFO:tasks.workunit.client.0.smithi018.stdout:checking for int... yes 2024-09-13T16:53:29.135 INFO:tasks.workunit.client.0.smithi018.stdout:checking size of int... 4 2024-09-13T16:53:29.220 INFO:tasks.workunit.client.0.smithi018.stdout:checking for long... yes 2024-09-13T16:53:29.337 INFO:tasks.workunit.client.0.smithi018.stdout:checking size of long... 8 2024-09-13T16:53:29.414 INFO:tasks.workunit.client.0.smithi018.stdout:checking for long long... yes 2024-09-13T16:53:29.569 INFO:tasks.workunit.client.0.smithi018.stdout:checking size of long long... 8 2024-09-13T16:53:29.643 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ssize_t... yes 2024-09-13T16:53:29.712 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sig_atomic_t... yes 2024-09-13T16:53:29.790 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether gcc needs -traditional... no 2024-09-13T16:53:29.851 INFO:tasks.workunit.client.0.smithi018.stdout:checking for an ANSI C-conforming const... yes 2024-09-13T16:53:29.900 INFO:tasks.workunit.client.0.smithi018.stdout:checking for inline... inline 2024-09-13T16:53:29.989 INFO:tasks.workunit.client.0.smithi018.stdout:checking for working alloca.h... yes 2024-09-13T16:53:30.071 INFO:tasks.workunit.client.0.smithi018.stdout:checking for alloca... yes 2024-09-13T16:53:30.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:29 smithi094 ceph-mon[35259]: pgmap v422: 129 pgs: 129 active+clean; 895 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-09-13T16:53:30.171 INFO:tasks.workunit.client.0.smithi018.stdout:checking for working memcmp... yes 2024-09-13T16:53:30.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:29 smithi018 ceph-mon[30981]: pgmap v422: 129 pgs: 129 active+clean; 895 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-09-13T16:53:30.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:29 smithi144 ceph-mon[35328]: pgmap v422: 129 pgs: 129 active+clean; 895 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-09-13T16:53:30.295 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strftime... yes 2024-09-13T16:53:30.415 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-13T16:53:30.512 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether stat accepts an empty string... no 2024-09-13T16:53:30.607 INFO:tasks.workunit.client.0.smithi018.stdout:checking for vprintf... yes 2024-09-13T16:53:30.700 INFO:tasks.workunit.client.0.smithi018.stdout:checking for _doprnt... no 2024-09-13T16:53:30.750 INFO:tasks.workunit.client.0.smithi018.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-13T16:53:30.778 INFO:tasks.workunit.client.0.smithi018.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-13T16:53:30.894 INFO:tasks.workunit.client.0.smithi018.stdout:checking for the pthreads library -lpthreads... no 2024-09-13T16:53:30.985 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether pthreads work without any flags... yes 2024-09-13T16:53:31.067 INFO:tasks.workunit.client.0.smithi018.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-13T16:53:31.067 INFO:tasks.workunit.client.0.smithi018.stdout:checking if more special flags are required for pthreads... no 2024-09-13T16:53:31.067 INFO:tasks.workunit.client.0.smithi018.stdout:checking for cc_r... gcc 2024-09-13T16:53:31.175 INFO:tasks.workunit.client.0.smithi018.stdout:checking for setrlimit... yes 2024-09-13T16:53:31.274 INFO:tasks.workunit.client.0.smithi018.stdout:checking for setproctitle... no 2024-09-13T16:53:31.372 INFO:tasks.workunit.client.0.smithi018.stdout:checking for getopt_long... yes 2024-09-13T16:53:31.476 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strtoull... yes 2024-09-13T16:53:31.580 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strtoq... yes 2024-09-13T16:53:31.685 INFO:tasks.workunit.client.0.smithi018.stdout:checking for snprintf... yes 2024-09-13T16:53:31.789 INFO:tasks.workunit.client.0.smithi018.stdout:checking for vsnprintf... yes 2024-09-13T16:53:31.893 INFO:tasks.workunit.client.0.smithi018.stdout:checking for vfprintf... yes 2024-09-13T16:53:31.998 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gethostname... yes 2024-09-13T16:53:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.096+0000 7fd649600640 1 -- 172.21.15.18:0/1381480209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd644100d40 msgr2=0x7fd6441011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.096+0000 7fd649600640 1 --2- 172.21.15.18:0/1381480209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd644100d40 0x7fd6441011c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd630009900 tx=0x7fd63002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.096+0000 7fd649600640 1 -- 172.21.15.18:0/1381480209 shutdown_connections 2024-09-13T16:53:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.096+0000 7fd649600640 1 --2- 172.21.15.18:0/1381480209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd644100d40 0x7fd6441011c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.096+0000 7fd649600640 1 --2- 172.21.15.18:0/1381480209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd644101700 0x7fd644107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.096+0000 7fd649600640 1 --2- 172.21.15.18:0/1381480209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6440ffb50 0x7fd6440fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.096+0000 7fd649600640 1 -- 172.21.15.18:0/1381480209 >> 172.21.15.18:0/1381480209 conn(0x7fd6440fb2f0 msgr2=0x7fd6440fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.096+0000 7fd649600640 1 -- 172.21.15.18:0/1381480209 shutdown_connections 2024-09-13T16:53:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.096+0000 7fd649600640 1 -- 172.21.15.18:0/1381480209 wait complete. 2024-09-13T16:53:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.097+0000 7fd649600640 1 Processor -- start 2024-09-13T16:53:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.097+0000 7fd649600640 1 -- start start 2024-09-13T16:53:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.097+0000 7fd649600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6440ffb50 0x7fd644197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.097+0000 7fd649600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd644100d40 0x7fd644198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.097+0000 7fd649600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd644101700 0x7fd64419f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.097+0000 7fd649600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64419f7e0 con 0x7fd644100d40 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.097+0000 7fd649600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64419f950 con 0x7fd6440ffb50 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.097+0000 7fd649600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64419fb10 con 0x7fd644101700 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd644100d40 0x7fd644198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6440ffb50 0x7fd644197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd644100d40 0x7fd644198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52750/0 (socket says 172.21.15.18:52750) 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643400640 1 -- 172.21.15.18:0/3445933125 learned_addr learned my addr 172.21.15.18:0/3445933125 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd648c00640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd644101700 0x7fd64419f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643400640 1 -- 172.21.15.18:0/3445933125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd644101700 msgr2=0x7fd64419f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643400640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd644101700 0x7fd64419f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643400640 1 -- 172.21.15.18:0/3445933125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6440ffb50 msgr2=0x7fd644197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643400640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6440ffb50 0x7fd644197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643400640 1 -- 172.21.15.18:0/3445933125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd630009560 con 0x7fd644100d40 2024-09-13T16:53:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643e00640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6440ffb50 0x7fd644197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:53:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.098+0000 7fd643400640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd644100d40 0x7fd644198240 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd630031500 tx=0x7fd630003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.099+0000 7fd640c00640 1 -- 172.21.15.18:0/3445933125 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630003e00 con 0x7fd644100d40 2024-09-13T16:53:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.099+0000 7fd640c00640 1 -- 172.21.15.18:0/3445933125 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd630031c70 con 0x7fd644100d40 2024-09-13T16:53:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.099+0000 7fd649600640 1 -- 172.21.15.18:0/3445933125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64419fd90 con 0x7fd644100d40 2024-09-13T16:53:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.099+0000 7fd640c00640 1 -- 172.21.15.18:0/3445933125 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63003bd80 con 0x7fd644100d40 2024-09-13T16:53:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.099+0000 7fd649600640 1 -- 172.21.15.18:0/3445933125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6441a01d0 con 0x7fd644100d40 2024-09-13T16:53:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.102+0000 7fd64dac6740 1 Processor -- start 2024-09-13T16:53:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.102+0000 7fd64dac6740 1 -- start start 2024-09-13T16:53:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.102+0000 7fd640c00640 1 -- 172.21.15.18:0/3445933125 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd63003b460 con 0x7fd644100d40 2024-09-13T16:53:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.102+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59d3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.102+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59d8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d8650 0x5585e59dab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd64dac6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e58debb0 con 0x5585e59d8650 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd64dac6740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e593ca70 con 0x5585e59d2c80 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd64dac6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e593a200 con 0x5585e59d35c0 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd648c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd648c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59d3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42388/0 (socket says 172.21.15.18:42388) 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd648c00640 1 -- 172.21.15.18:0/3125167553 learned_addr learned my addr 172.21.15.18:0/3125167553 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd643e00640 1 --2- 172.21.15.18:0/3125167553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59d8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd643400640 1 --2- 172.21.15.18:0/3125167553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d8650 0x5585e59dab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd648c00640 1 -- 172.21.15.18:0/3125167553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 msgr2=0x5585e59d8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd648c00640 1 --2- 172.21.15.18:0/3125167553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59d8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd648c00640 1 -- 172.21.15.18:0/3125167553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d8650 msgr2=0x5585e59dab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd648c00640 1 --2- 172.21.15.18:0/3125167553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d8650 0x5585e59dab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.103+0000 7fd648c00640 1 -- 172.21.15.18:0/3125167553 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e58d7940 con 0x5585e59d2c80 2024-09-13T16:53:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.104+0000 7fd648c00640 1 --2- 172.21.15.18:0/3125167553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59d3080 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009fd0 tx=0x7fd63c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ec103c608bac09d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.104+0000 7fd639600640 1 -- 172.21.15.18:0/3125167553 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c004d20 con 0x5585e59d2c80 2024-09-13T16:53:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.104+0000 7fd639600640 1 -- 172.21.15.18:0/3125167553 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd63c004e80 con 0x5585e59d2c80 2024-09-13T16:53:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.104+0000 7fd639600640 1 -- 172.21.15.18:0/3125167553 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c005280 con 0x5585e59d2c80 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.104+0000 7fd640c00640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6280a11b0 0x7fd6280a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.104+0000 7fd640c00640 1 -- 172.21.15.18:0/3445933125 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fd6300ed580 con 0x7fd644100d40 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.104+0000 7fd643e00640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6280a11b0 0x7fd6280a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.104+0000 7fd64dac6740 1 -- 172.21.15.18:0/3125167553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 msgr2=0x5585e59d3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.105+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3125167553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59d3080 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009fd0 tx=0x7fd63c0118d0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.105+0000 7fd64dac6740 1 -- 172.21.15.18:0/3125167553 shutdown_connections 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.105+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3125167553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d8650 0x5585e59dab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.105+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3125167553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59d8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.105+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3125167553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59d3080 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.105+0000 7fd64dac6740 1 -- 172.21.15.18:0/3125167553 >> 172.21.15.18:0/3125167553 conn(0x5585e59ce2f0 msgr2=0x5585e59ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.105+0000 7fd64dac6740 1 -- 172.21.15.18:0/3125167553 shutdown_connections 2024-09-13T16:53:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.105+0000 7fd64dac6740 1 -- 172.21.15.18:0/3125167553 wait complete. 2024-09-13T16:53:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.105+0000 7fd643e00640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6280a11b0 0x7fd6280a3670 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5585e59d3ff0 tx=0x7fd63400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.105+0000 7fd64dac6740 1 -- start start 2024-09-13T16:53:32.109 INFO:tasks.workunit.client.0.smithi018.stdout:checking for setlocale... yes 2024-09-13T16:53:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd64dac6740 1 Processor -- start 2024-09-13T16:53:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d2c80 0x5585e59dc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59dce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 0x5585e59e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd64dac6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e5935af0 con 0x5585e59d2c80 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd64dac6740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e58f3f20 con 0x5585e59d8650 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd64dac6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e58f3bc0 con 0x5585e59d35c0 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd64dac6740 10 client.0 _ll_register_callbacks cb 0x5585e5925a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd643e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d2c80 0x5585e59dc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd643e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d2c80 0x5585e59dc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52764/0 (socket says 172.21.15.18:52764) 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd643e00640 1 -- 172.21.15.18:0/3868733291 learned_addr learned my addr 172.21.15.18:0/3868733291 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.106+0000 7fd648c00640 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 0x5585e59e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.107+0000 7fd643400640 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59dce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.107+0000 7fd643e00640 1 -- 172.21.15.18:0/3868733291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 msgr2=0x5585e59dce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.107+0000 7fd643e00640 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59dce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.107+0000 7fd643e00640 1 -- 172.21.15.18:0/3868733291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 msgr2=0x5585e59e3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.107+0000 7fd643e00640 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 0x5585e59e3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.107+0000 7fd643e00640 1 -- 172.21.15.18:0/3868733291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c009c80 con 0x5585e59d2c80 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.107+0000 7fd643e00640 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d2c80 0x5585e59dc950 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd634004010 tx=0x7fd6340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1536c628a93c589e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.107+0000 7fd62e000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.107+0000 7fd62e000640 1 -- 172.21.15.18:0/3868733291 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634016070 con 0x5585e59d2c80 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.108+0000 7fd62e000640 1 -- 172.21.15.18:0/3868733291 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fd634011710 con 0x5585e59d2c80 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.108+0000 7fd64dac6740 1 -- 172.21.15.18:0/3868733291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585e59287d0 con 0x5585e59d2c80 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.108+0000 7fd62e000640 1 -- 172.21.15.18:0/3868733291 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6340118d0 con 0x5585e59d2c80 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.108+0000 7fd64dac6740 10 client.15447 fetch_fsmap learned FSMap version 25 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.108+0000 7fd64dac6740 1 -- 172.21.15.18:0/3868733291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5585e5934170 con 0x5585e59d2c80 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.108+0000 7fd62e000640 1 -- 172.21.15.18:0/3868733291 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5585e59287d0 con 0x5585e59d2c80 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.108+0000 7fd62e000640 1 -- 172.21.15.18:0/3868733291 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd634027b00 con 0x5585e59d2c80 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.108+0000 7fd64dac6740 10 client.15447 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.108+0000 7fd64dac6740 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:53:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.109+0000 7fd64dac6740 20 client.15447 populate_metadata read hostname 'smithi018' 2024-09-13T16:53:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.109+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5585e59e8640 0x5585e59eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.109+0000 7fd64dac6740 4 client.15447 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:53:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.109+0000 7fd64dac6740 1 -- 172.21.15.18:0/3868733291 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585e5629300 con 0x5585e59e8640 2024-09-13T16:53:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.109+0000 7fd643400640 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5585e59e8640 0x5585e59eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.109+0000 7fd643400640 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5585e59e8640 0x5585e59eaa60 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3668ae5f4bb3168 server_cookie=6a9860374949aa7b in_seq=0 out_seq=0 2024-09-13T16:53:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.109+0000 7fd62e000640 10 client.15447 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd62e000640 1 -- 172.21.15.18:0/3868733291 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5585e5629300 con 0x5585e59e8640 2024-09-13T16:53:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd62e000640 10 client.15447 handle_command_reply: tid=0 2024-09-13T16:53:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 client.15447 shutdown 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 -- 172.21.15.18:0/3868733291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d2c80 msgr2=0x5585e59dc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d2c80 0x5585e59dc950 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd634004010 tx=0x7fd6340046c0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 -- 172.21.15.18:0/3868733291 shutdown_connections 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5585e59e8640 0x5585e59eaa60 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 0x5585e59e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59dce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3868733291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d2c80 0x5585e59dc950 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 -- 172.21.15.18:0/3868733291 >> 172.21.15.18:0/3868733291 conn(0x5585e59ce2f0 msgr2=0x5585e59cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd62e000640 0 client.15447 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 -- 172.21.15.18:0/3868733291 shutdown_connections 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.110+0000 7fd64dac6740 1 -- 172.21.15.18:0/3868733291 wait complete. 2024-09-13T16:53:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.111+0000 7fd64dac6740 20 client.15447 trim_cache size 0 max 16384 2024-09-13T16:53:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd64dac6740 1 Processor -- start 2024-09-13T16:53:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd64dac6740 1 -- start start 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d2c80 0x5585e59dc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d35c0 0x5585e59e3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 0x5585e59dcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd64dac6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e569ce60 con 0x5585e59d35c0 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd64dac6740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e59dc4c0 con 0x5585e59d8650 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd64dac6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e59e6c50 con 0x5585e59d2c80 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd643400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d35c0 0x5585e59e3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd648c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 0x5585e59dcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd643400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d35c0 0x5585e59e3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52780/0 (socket says 172.21.15.18:52780) 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd648c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 0x5585e59dcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42408/0 (socket says 172.21.15.18:42408) 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd643400640 1 -- 172.21.15.18:0/3362723760 learned_addr learned my addr 172.21.15.18:0/3362723760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.124+0000 7fd643e00640 1 --2- 172.21.15.18:0/3362723760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d2c80 0x5585e59dc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.125+0000 7fd648c00640 1 -- 172.21.15.18:0/3362723760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d2c80 msgr2=0x5585e59dc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:32.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.125+0000 7fd648c00640 1 --2- 172.21.15.18:0/3362723760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d2c80 0x5585e59dc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.125+0000 7fd648c00640 1 -- 172.21.15.18:0/3362723760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d35c0 msgr2=0x5585e59e3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:32.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.125+0000 7fd648c00640 1 --2- 172.21.15.18:0/3362723760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d35c0 0x5585e59e3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.125+0000 7fd648c00640 1 -- 172.21.15.18:0/3362723760 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e58d6180 con 0x5585e59d8650 2024-09-13T16:53:32.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.125+0000 7fd648c00640 1 --2- 172.21.15.18:0/3362723760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 0x5585e59dcc40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd63c000f80 tx=0x7fd63c004120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=963cc93d888f09ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:32.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.125+0000 7fd63a000640 1 -- 172.21.15.18:0/3362723760 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c003c30 con 0x5585e59d8650 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.125+0000 7fd63a000640 1 -- 172.21.15.18:0/3362723760 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd63c0043d0 con 0x5585e59d8650 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.125+0000 7fd63a000640 1 -- 172.21.15.18:0/3362723760 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c00f8a0 con 0x5585e59d8650 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.126+0000 7fd64dac6740 1 -- 172.21.15.18:0/3362723760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 msgr2=0x5585e59dcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.126+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3362723760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 0x5585e59dcc40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd63c000f80 tx=0x7fd63c004120 comp rx=0 tx=0).stop 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.126+0000 7fd64dac6740 1 -- 172.21.15.18:0/3362723760 shutdown_connections 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.126+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3362723760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d35c0 0x5585e59e3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.126+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3362723760 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d8650 0x5585e59dcc40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.126+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3362723760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d2c80 0x5585e59dc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.126+0000 7fd64dac6740 1 -- 172.21.15.18:0/3362723760 >> 172.21.15.18:0/3362723760 conn(0x5585e59ce2f0 msgr2=0x5585e59d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.126+0000 7fd64dac6740 1 -- 172.21.15.18:0/3362723760 shutdown_connections 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.126+0000 7fd64dac6740 1 -- 172.21.15.18:0/3362723760 wait complete. 2024-09-13T16:53:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.127+0000 7fd64dac6740 1 -- start start 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.127+0000 7fd64dac6740 1 Processor -- start 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59e0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59e1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd64dac6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d8650 0x5585e5a3eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd64dac6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e59e1750 con 0x5585e59d8650 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd64dac6740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e59e18c0 con 0x5585e59d2c80 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd64dac6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e5a3f110 con 0x5585e59d35c0 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd64dac6740 10 client.0 _ll_register_callbacks cb 0x7fd63c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd643e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59e0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd643e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59e0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42414/0 (socket says 172.21.15.18:42414) 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd643e00640 1 -- 172.21.15.18:0/3996204270 learned_addr learned my addr 172.21.15.18:0/3996204270 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd643400640 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59e1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd648c00640 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d8650 0x5585e5a3eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd643e00640 1 -- 172.21.15.18:0/3996204270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 msgr2=0x5585e59e1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd643e00640 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59e1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd643e00640 1 -- 172.21.15.18:0/3996204270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d8650 msgr2=0x5585e5a3eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd643e00640 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d8650 0x5585e5a3eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.128+0000 7fd643e00640 1 -- 172.21.15.18:0/3996204270 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585e58d7940 con 0x5585e59d2c80 2024-09-13T16:53:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.129+0000 7fd643e00640 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59e0c50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd634012010 tx=0x7fd63400bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=490b7ead7f26b82d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.129+0000 7fd62e000640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:53:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.129+0000 7fd62e000640 1 -- 172.21.15.18:0/3996204270 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634016030 con 0x5585e59d2c80 2024-09-13T16:53:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.129+0000 7fd62e000640 1 -- 172.21.15.18:0/3996204270 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fd634003dd0 con 0x5585e59d2c80 2024-09-13T16:53:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.129+0000 7fd64dac6740 1 -- 172.21.15.18:0/3996204270 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585e595fc90 con 0x5585e59d2c80 2024-09-13T16:53:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.129+0000 7fd62e000640 1 -- 172.21.15.18:0/3996204270 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd63400be30 con 0x5585e59d2c80 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.129+0000 7fd64dac6740 10 client.25505 fetch_fsmap learned FSMap version 25 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.129+0000 7fd64dac6740 1 -- 172.21.15.18:0/3996204270 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5585e58fb560 con 0x5585e59d2c80 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd62e000640 1 -- 172.21.15.18:0/3996204270 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5585e595fc90 con 0x5585e59d2c80 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd62e000640 1 -- 172.21.15.18:0/3996204270 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd63402f040 con 0x5585e59d2c80 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd64dac6740 10 client.25505 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd64dac6740 10 client.25505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd64dac6740 20 client.25505 populate_metadata read hostname 'smithi018' 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5585e5a40bd0 0x5585e5a42ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd64dac6740 4 client.25505 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd64dac6740 1 -- 172.21.15.18:0/3996204270 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5585e563a600 con 0x5585e5a40bd0 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd643400640 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5585e5a40bd0 0x5585e5a42ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd62e000640 10 client.25505 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.130+0000 7fd643400640 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5585e5a40bd0 0x5585e5a42ff0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d7fc34567dc6918 server_cookie=b7f5d1f3778114c6 in_seq=0 out_seq=0 2024-09-13T16:53:32.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:31 smithi094 ceph-mon[35259]: pgmap v423: 129 pgs: 129 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 186 KiB/s wr, 23 op/s 2024-09-13T16:53:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd62e000640 1 -- 172.21.15.18:0/3996204270 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5585e563a600 con 0x5585e5a40bd0 2024-09-13T16:53:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd62e000640 10 client.25505 handle_command_reply: tid=0 2024-09-13T16:53:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd64dac6740 1 client.25505 shutdown 2024-09-13T16:53:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd64dac6740 1 -- 172.21.15.18:0/3996204270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 msgr2=0x5585e59e0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59e0c50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd634012010 tx=0x7fd63400bf90 comp rx=0 tx=0).stop 2024-09-13T16:53:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd64dac6740 1 -- 172.21.15.18:0/3996204270 shutdown_connections 2024-09-13T16:53:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5585e5a40bd0 0x5585e5a42ff0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585e59d8650 0x5585e5a3eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585e59d35c0 0x5585e59e1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd64dac6740 1 --2- 172.21.15.18:0/3996204270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5585e59d2c80 0x5585e59e0c50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd62e000640 0 client.25505 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.201+0000 7fd64dac6740 1 -- 172.21.15.18:0/3996204270 >> 172.21.15.18:0/3996204270 conn(0x5585e59ce2f0 msgr2=0x5585e59dc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd64dac6740 1 -- 172.21.15.18:0/3996204270 shutdown_connections 2024-09-13T16:53:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd64dac6740 1 -- 172.21.15.18:0/3996204270 wait complete. 2024-09-13T16:53:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd64dac6740 20 client.25505 trim_cache size 0 max 16384 2024-09-13T16:53:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:53:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:53:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:53:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:53:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd649600640 1 -- 172.21.15.18:0/3445933125 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6280a11b0 msgr2=0x7fd6280a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd649600640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6280a11b0 0x7fd6280a3670 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5585e59d3ff0 tx=0x7fd63400b390 comp rx=0 tx=0).stop 2024-09-13T16:53:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd649600640 1 -- 172.21.15.18:0/3445933125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd644100d40 msgr2=0x7fd644198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd649600640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd644100d40 0x7fd644198240 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd630031500 tx=0x7fd630003c10 comp rx=0 tx=0).stop 2024-09-13T16:53:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd649600640 1 -- 172.21.15.18:0/3445933125 shutdown_connections 2024-09-13T16:53:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd649600640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fd6280a11b0 0x7fd6280a3670 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd649600640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd644100d40 0x7fd644198240 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd649600640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd644101700 0x7fd64419f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd649600640 1 --2- 172.21.15.18:0/3445933125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6440ffb50 0x7fd644197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.202+0000 7fd649600640 1 -- 172.21.15.18:0/3445933125 >> 172.21.15.18:0/3445933125 conn(0x7fd6440fb2f0 msgr2=0x7fd6440726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.203+0000 7fd649600640 1 -- 172.21.15.18:0/3445933125 shutdown_connections 2024-09-13T16:53:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:32.203+0000 7fd649600640 1 -- 172.21.15.18:0/3445933125 wait complete. 2024-09-13T16:53:32.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:31 smithi018 ceph-mon[30981]: pgmap v423: 129 pgs: 129 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 186 KiB/s wr, 23 op/s 2024-09-13T16:53:32.263 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sync... yes 2024-09-13T16:53:32.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:31 smithi144 ceph-mon[35328]: pgmap v423: 129 pgs: 129 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 186 KiB/s wr, 23 op/s 2024-09-13T16:53:32.365 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether snprintf is C99 conformant... done 2024-09-13T16:53:32.386 INFO:tasks.workunit.client.0.smithi018.stdout:configure: creating ./config.status 2024-09-13T16:53:32.657 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating Makefile 2024-09-13T16:53:32.695 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating src/Makefile 2024-09-13T16:53:32.736 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating man/Makefile 2024-09-13T16:53:32.755 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating config.h 2024-09-13T16:53:32.835 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: executing depfiles commands 2024-09-13T16:53:33.116 INFO:tasks.workunit.client.0.smithi018.stdout:make all-recursive 2024-09-13T16:53:33.118 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-13T16:53:33.124 INFO:tasks.workunit.client.0.smithi018.stdout:Making all in src 2024-09-13T16:53:33.154 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-13T16:53:33.154 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-13T16:53:33.154 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-13T16:53:33.326 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-13T16:53:33.327 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-13T16:53:33.450 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-13T16:53:33.450 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-13T16:53:33.558 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-13T16:53:33.558 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-13T16:53:33.660 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-13T16:53:33.660 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-13T16:53:33.763 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-13T16:53:33.763 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-13T16:53:33.866 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-13T16:53:33.866 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-13T16:53:33.996 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-13T16:53:33.996 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-13T16:53:34.080 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-13T16:53:34.080 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-13T16:53:34.166 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-13T16:53:34.166 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-13T16:53:34.243 INFO:tasks.workunit.client.0.smithi018.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-13T16:53:34.273 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-13T16:53:34.273 INFO:tasks.workunit.client.0.smithi018.stdout:Making all in man 2024-09-13T16:53:34.283 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-13T16:53:34.283 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Nothing to be done for 'all'. 2024-09-13T16:53:34.283 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-13T16:53:34.286 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-13T16:53:34.289 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-13T16:53:34.289 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-13T16:53:34.300 INFO:tasks.workunit.client.0.smithi018.stdout:running blogbench 2024-09-13T16:53:34.302 INFO:tasks.workunit.client.0.smithi018.stdout: 2024-09-13T16:53:34.302 INFO:tasks.workunit.client.0.smithi018.stdout:Frequency = 10 secs 2024-09-13T16:53:34.302 INFO:tasks.workunit.client.0.smithi018.stdout:Scratch dir = [blogtest_in] 2024-09-13T16:53:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:34 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:53:34.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:34 smithi094 ceph-mon[35259]: pgmap v424: 129 pgs: 129 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 227 KiB/s wr, 37 op/s 2024-09-13T16:53:34.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:34 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:53:34.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:34 smithi018 ceph-mon[30981]: pgmap v424: 129 pgs: 129 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 227 KiB/s wr, 37 op/s 2024-09-13T16:53:34.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:34 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:53:34.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:34 smithi144 ceph-mon[35328]: pgmap v424: 129 pgs: 129 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 227 KiB/s wr, 37 op/s 2024-09-13T16:53:36.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:35 smithi094 ceph-mon[35259]: pgmap v425: 129 pgs: 129 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 367 KiB/s wr, 74 op/s 2024-09-13T16:53:36.173 INFO:tasks.workunit.client.0.smithi018.stdout:Spawning 3 writers... 2024-09-13T16:53:36.173 INFO:tasks.workunit.client.0.smithi018.stdout:Spawning 1 rewriters... 2024-09-13T16:53:36.173 INFO:tasks.workunit.client.0.smithi018.stdout:Spawning 5 commenters... 2024-09-13T16:53:36.174 INFO:tasks.workunit.client.0.smithi018.stdout:Spawning 100 readers... 2024-09-13T16:53:36.184 INFO:tasks.workunit.client.0.smithi018.stdout:Benchmarking for 30 iterations. 2024-09-13T16:53:36.184 INFO:tasks.workunit.client.0.smithi018.stdout:The test will run during 5 minutes. 2024-09-13T16:53:36.184 INFO:tasks.workunit.client.0.smithi018.stdout: 2024-09-13T16:53:36.185 INFO:tasks.workunit.client.0.smithi018.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-13T16:53:36.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:35 smithi018 ceph-mon[30981]: pgmap v425: 129 pgs: 129 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 367 KiB/s wr, 74 op/s 2024-09-13T16:53:36.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:35 smithi144 ceph-mon[35328]: pgmap v425: 129 pgs: 129 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 367 KiB/s wr, 74 op/s 2024-09-13T16:53:38.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:37 smithi094 ceph-mon[35259]: pgmap v426: 129 pgs: 129 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 386 KiB/s wr, 98 op/s 2024-09-13T16:53:38.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:37 smithi018 ceph-mon[30981]: pgmap v426: 129 pgs: 129 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 386 KiB/s wr, 98 op/s 2024-09-13T16:53:38.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:37 smithi144 ceph-mon[35328]: pgmap v426: 129 pgs: 129 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 386 KiB/s wr, 98 op/s 2024-09-13T16:53:40.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:39 smithi094 ceph-mon[35259]: pgmap v427: 129 pgs: 129 active+clean; 8.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 759 KiB/s wr, 113 op/s 2024-09-13T16:53:40.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:39 smithi018 ceph-mon[30981]: pgmap v427: 129 pgs: 129 active+clean; 8.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 759 KiB/s wr, 113 op/s 2024-09-13T16:53:40.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:39 smithi144 ceph-mon[35328]: pgmap v427: 129 pgs: 129 active+clean; 8.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 759 KiB/s wr, 113 op/s 2024-09-13T16:53:41.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:41 smithi018 ceph-mon[30981]: pgmap v428: 129 pgs: 129 active+clean; 8.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 767 KiB/s wr, 119 op/s 2024-09-13T16:53:42.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:41 smithi094 ceph-mon[35259]: pgmap v428: 129 pgs: 129 active+clean; 8.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 767 KiB/s wr, 119 op/s 2024-09-13T16:53:42.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:41 smithi144 ceph-mon[35328]: pgmap v428: 129 pgs: 129 active+clean; 8.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 767 KiB/s wr, 119 op/s 2024-09-13T16:53:44.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:43 smithi094 ceph-mon[35259]: pgmap v429: 129 pgs: 129 active+clean; 19 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-13T16:53:44.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:43 smithi018 ceph-mon[30981]: pgmap v429: 129 pgs: 129 active+clean; 19 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-13T16:53:44.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:43 smithi144 ceph-mon[35328]: pgmap v429: 129 pgs: 129 active+clean; 19 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2024-09-13T16:53:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.538+0000 7f02f7200640 1 -- 172.21.15.18:0/3406071587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f010c240 msgr2=0x7f02f01173f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.538+0000 7f02f7200640 1 --2- 172.21.15.18:0/3406071587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f010c240 0x7f02f01173f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009ca0 tx=0x7f02e802a8d0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.538+0000 7f02f7200640 1 -- 172.21.15.18:0/3406071587 shutdown_connections 2024-09-13T16:53:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.538+0000 7f02f7200640 1 --2- 172.21.15.18:0/3406071587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f010c240 0x7f02f01173f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.538+0000 7f02f7200640 1 --2- 172.21.15.18:0/3406071587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f0109870 0x7f02f010bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.538+0000 7f02f7200640 1 --2- 172.21.15.18:0/3406071587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02f0071120 0x7f02f0071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.538+0000 7f02f7200640 1 -- 172.21.15.18:0/3406071587 >> 172.21.15.18:0/3406071587 conn(0x7f02f006cf30 msgr2=0x7f02f006f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.538+0000 7f02f7200640 1 -- 172.21.15.18:0/3406071587 shutdown_connections 2024-09-13T16:53:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.538+0000 7f02f7200640 1 -- 172.21.15.18:0/3406071587 wait complete. 2024-09-13T16:53:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.540+0000 7f02f7200640 1 Processor -- start 2024-09-13T16:53:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.540+0000 7f02f7200640 1 -- start start 2024-09-13T16:53:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.540+0000 7f02f7200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02f0071120 0x7f02f01a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.540+0000 7f02f7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f0109870 0x7f02f01a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.540+0000 7f02f7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f010c240 0x7f02f01ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.540+0000 7f02f7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01ac540 con 0x7f02f0109870 2024-09-13T16:53:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.540+0000 7f02f7200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01ac6b0 con 0x7f02f0071120 2024-09-13T16:53:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.540+0000 7f02f7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01ac870 con 0x7f02f010c240 2024-09-13T16:53:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.541+0000 7f02efe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02f0071120 0x7f02f01a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.541+0000 7f02efe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02f0071120 0x7f02f01a4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:38526/0 (socket says 172.21.15.18:38526) 2024-09-13T16:53:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.541+0000 7f02efe00640 1 -- 172.21.15.18:0/3393890281 learned_addr learned my addr 172.21.15.18:0/3393890281 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.541+0000 7f02ef400640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f0109870 0x7f02f01a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.541+0000 7f02f5200640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f010c240 0x7f02f01ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.542+0000 7f02ef400640 1 -- 172.21.15.18:0/3393890281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f010c240 msgr2=0x7f02f01ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.542+0000 7f02ef400640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f010c240 0x7f02f01ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.542+0000 7f02ef400640 1 -- 172.21.15.18:0/3393890281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02f0071120 msgr2=0x7f02f01a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.542+0000 7f02ef400640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02f0071120 0x7f02f01a4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.542+0000 7f02ef400640 1 -- 172.21.15.18:0/3393890281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8009900 con 0x7f02f0109870 2024-09-13T16:53:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.542+0000 7f02efe00640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02f0071120 0x7f02f01a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:53:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.542+0000 7f02ef400640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f0109870 0x7f02f01a4f90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00d6a0 tx=0x7f02dc00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.543+0000 7f02ecc00640 1 -- 172.21.15.18:0/3393890281 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc004220 con 0x7f02f0109870 2024-09-13T16:53:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.543+0000 7f02ecc00640 1 -- 172.21.15.18:0/3393890281 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02dc004380 con 0x7f02f0109870 2024-09-13T16:53:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.543+0000 7f02ecc00640 1 -- 172.21.15.18:0/3393890281 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc003d30 con 0x7f02f0109870 2024-09-13T16:53:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.543+0000 7f02f7200640 1 -- 172.21.15.18:0/3393890281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f01acb50 con 0x7f02f0109870 2024-09-13T16:53:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.545+0000 7f02f7200640 1 -- 172.21.15.18:0/3393890281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f01ad010 con 0x7f02f0109870 2024-09-13T16:53:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.550+0000 7f02f9ffb740 1 Processor -- start 2024-09-13T16:53:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.551+0000 7f02f9ffb740 1 -- start start 2024-09-13T16:53:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.551+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f74e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.551+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 0x561e62f79e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.551+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 0x561e62f7c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.551+0000 7f02f9ffb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62e80bb0 con 0x561e62f753d0 2024-09-13T16:53:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.551+0000 7f02f9ffb740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62edea70 con 0x561e62f7a460 2024-09-13T16:53:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.551+0000 7f02f9ffb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62edc200 con 0x561e62f74a90 2024-09-13T16:53:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.552+0000 7f02ecc00640 1 -- 172.21.15.18:0/3393890281 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f02dc009820 con 0x7f02f0109870 2024-09-13T16:53:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.552+0000 7f02efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 0x561e62f79e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.552+0000 7f02efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 0x561e62f79e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56032/0 (socket says 172.21.15.18:56032) 2024-09-13T16:53:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.552+0000 7f02efe00640 1 -- 172.21.15.18:0/4116809322 learned_addr learned my addr 172.21.15.18:0/4116809322 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.553+0000 7f02f5200640 1 --2- 172.21.15.18:0/4116809322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f74e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.553+0000 7f02efe00640 1 -- 172.21.15.18:0/4116809322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 msgr2=0x561e62f74e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.553+0000 7f02efe00640 1 --2- 172.21.15.18:0/4116809322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f74e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.553+0000 7f02ef400640 1 --2- 172.21.15.18:0/4116809322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 0x561e62f7c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.553+0000 7f02efe00640 1 -- 172.21.15.18:0/4116809322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 msgr2=0x561e62f7c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.553+0000 7f02efe00640 1 --2- 172.21.15.18:0/4116809322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 0x561e62f7c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.553+0000 7f02efe00640 1 -- 172.21.15.18:0/4116809322 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e62e79940 con 0x561e62f753d0 2024-09-13T16:53:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.554+0000 7f02efe00640 1 --2- 172.21.15.18:0/4116809322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 0x561e62f79e90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f02e00105d0 tx=0x7f02e0010a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a3341350d36e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.556+0000 7f02ecc00640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f02d40a1190 0x7f02d40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.557+0000 7f02e5600640 1 -- 172.21.15.18:0/4116809322 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000e910 con 0x561e62f753d0 2024-09-13T16:53:45.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.557+0000 7f02e5600640 1 -- 172.21.15.18:0/4116809322 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02e0015070 con 0x561e62f753d0 2024-09-13T16:53:45.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.557+0000 7f02e5600640 1 -- 172.21.15.18:0/4116809322 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e001cdb0 con 0x561e62f753d0 2024-09-13T16:53:45.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.557+0000 7f02ecc00640 1 -- 172.21.15.18:0/3393890281 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f02dc0cc1a0 con 0x7f02f0109870 2024-09-13T16:53:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.558+0000 7f02f9ffb740 1 -- 172.21.15.18:0/4116809322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 msgr2=0x561e62f79e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.558+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/4116809322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 0x561e62f79e90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f02e00105d0 tx=0x7f02e0010a90 comp rx=0 tx=0).stop 2024-09-13T16:53:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.559+0000 7f02f5200640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f02d40a1190 0x7f02d40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.560+0000 7f02f5200640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f02d40a1190 0x7f02d40a3650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f02e80098d0 tx=0x7f02e8009840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.561+0000 7f02f9ffb740 1 -- 172.21.15.18:0/4116809322 shutdown_connections 2024-09-13T16:53:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.561+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/4116809322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 0x561e62f79e90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.561+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/4116809322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 0x561e62f7c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.561+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/4116809322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f74e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.561+0000 7f02f9ffb740 1 -- 172.21.15.18:0/4116809322 >> 172.21.15.18:0/4116809322 conn(0x561e62f70100 msgr2=0x561e62f70500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.562+0000 7f02f9ffb740 1 -- 172.21.15.18:0/4116809322 shutdown_connections 2024-09-13T16:53:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.562+0000 7f02f9ffb740 1 -- 172.21.15.18:0/4116809322 wait complete. 2024-09-13T16:53:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.562+0000 7f02f9ffb740 1 -- start start 2024-09-13T16:53:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.564+0000 7f02f9ffb740 1 Processor -- start 2024-09-13T16:53:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.564+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f7e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.564+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 0x561e62f7ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.564+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f7a460 0x561e62f85ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.565+0000 7f02ef400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 0x561e62f7ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.565+0000 7f02ef400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 0x561e62f7ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:38538/0 (socket says 172.21.15.18:38538) 2024-09-13T16:53:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.565+0000 7f02efe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f7e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.565+0000 7f02efe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f7e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:41056/0 (socket says 172.21.15.18:41056) 2024-09-13T16:53:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.565+0000 7f02f5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f7a460 0x561e62f85ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.565+0000 7f02f5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f7a460 0x561e62f85ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56046/0 (socket says 172.21.15.18:56046) 2024-09-13T16:53:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.565+0000 7f02ef400640 1 -- 172.21.15.18:0/1833237534 learned_addr learned my addr 172.21.15.18:0/1833237534 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.566+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62ed7af0 con 0x561e62f7a460 2024-09-13T16:53:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.566+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62e95f20 con 0x561e62f753d0 2024-09-13T16:53:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.566+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62e95bc0 con 0x561e62f74a90 2024-09-13T16:53:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.567+0000 7f02f9ffb740 10 client.0 _ll_register_callbacks cb 0x561e62ec7a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:53:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.567+0000 7f02ef400640 1 -- 172.21.15.18:0/1833237534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 msgr2=0x561e62f7e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.567+0000 7f02ef400640 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f7e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.567+0000 7f02ef400640 1 -- 172.21.15.18:0/1833237534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f7a460 msgr2=0x561e62f85ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.567+0000 7f02ef400640 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f7a460 0x561e62f85ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.567+0000 7f02ef400640 1 -- 172.21.15.18:0/1833237534 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e000bdc0 con 0x561e62f753d0 2024-09-13T16:53:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.567+0000 7f02f5200640 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f7a460 0x561e62f85ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:53:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.568+0000 7f02ef400640 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 0x561e62f7ecb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009610 tx=0x7f02dc0991a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3edbe6e132b6e576 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.568+0000 7f02da000640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:53:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.568+0000 7f02da000640 1 -- 172.21.15.18:0/1833237534 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc09d060 con 0x561e62f753d0 2024-09-13T16:53:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.568+0000 7f02da000640 1 -- 172.21.15.18:0/1833237534 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f02dc0a16b0 con 0x561e62f753d0 2024-09-13T16:53:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.568+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e62f01c90 con 0x561e62f753d0 2024-09-13T16:53:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.569+0000 7f02da000640 1 -- 172.21.15.18:0/1833237534 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02dc009d70 con 0x561e62f753d0 2024-09-13T16:53:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.569+0000 7f02f9ffb740 10 client.25514 fetch_fsmap learned FSMap version 26 2024-09-13T16:53:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.569+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561e62ed6170 con 0x561e62f753d0 2024-09-13T16:53:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.569+0000 7f02da000640 1 -- 172.21.15.18:0/1833237534 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561e62f01c90 con 0x561e62f753d0 2024-09-13T16:53:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.570+0000 7f02da000640 1 -- 172.21.15.18:0/1833237534 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f02dc098240 con 0x561e62f753d0 2024-09-13T16:53:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.570+0000 7f02f9ffb740 10 client.25514 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T16:53:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.570+0000 7f02f9ffb740 10 client.25514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:53:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.570+0000 7f02f9ffb740 20 client.25514 populate_metadata read hostname 'smithi018' 2024-09-13T16:53:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.570+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561e62f8a440 0x561e62f8c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.570+0000 7f02f9ffb740 4 client.25514 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:53:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.570+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e62eca7d0 con 0x561e62f8a440 2024-09-13T16:53:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.570+0000 7f02efe00640 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561e62f8a440 0x561e62f8c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.571+0000 7f02efe00640 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561e62f8a440 0x561e62f8c860 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=821f539024d328a4 server_cookie=744e178e94a27a3c in_seq=0 out_seq=0 2024-09-13T16:53:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.571+0000 7f02da000640 10 client.25514 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02da000640 1 -- 172.21.15.18:0/1833237534 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561e62eca7d0 con 0x561e62f8a440 2024-09-13T16:53:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02da000640 10 client.25514 handle_command_reply: tid=0 2024-09-13T16:53:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02f9ffb740 1 client.25514 shutdown 2024-09-13T16:53:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 msgr2=0x561e62f7ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 0x561e62f7ecb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009610 tx=0x7f02dc0991a0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 shutdown_connections 2024-09-13T16:53:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561e62f8a440 0x561e62f8c860 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f7a460 0x561e62f85ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 0x561e62f7ecb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02da000640 0 client.25514 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/1833237534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f7e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.572+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 >> 172.21.15.18:0/1833237534 conn(0x561e62f70100 msgr2=0x561e62f6f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.573+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 shutdown_connections 2024-09-13T16:53:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.573+0000 7f02f9ffb740 1 -- 172.21.15.18:0/1833237534 wait complete. 2024-09-13T16:53:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.577+0000 7f02f9ffb740 20 client.25514 trim_cache size 0 max 16384 2024-09-13T16:53:45.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.607+0000 7f02f9ffb740 1 Processor -- start 2024-09-13T16:53:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.607+0000 7f02f9ffb740 1 -- start start 2024-09-13T16:53:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.607+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f74a90 0x561e62f7e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.608+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 0x561e62f7ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.608+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f7a460 0x561e62f85c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.608+0000 7f02f9ffb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62c3ee60 con 0x561e62f74a90 2024-09-13T16:53:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.608+0000 7f02f9ffb740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62eca800 con 0x561e62f753d0 2024-09-13T16:53:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.608+0000 7f02f9ffb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62f75c20 con 0x561e62f7a460 2024-09-13T16:53:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.608+0000 7f02f5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f7a460 0x561e62f85c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.608+0000 7f02f5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f7a460 0x561e62f85c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:41062/0 (socket says 172.21.15.18:41062) 2024-09-13T16:53:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.608+0000 7f02f5200640 1 -- 172.21.15.18:0/2157074847 learned_addr learned my addr 172.21.15.18:0/2157074847 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.609+0000 7f02efe00640 1 --2- 172.21.15.18:0/2157074847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f74a90 0x561e62f7e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.609+0000 7f02f5200640 1 -- 172.21.15.18:0/2157074847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 msgr2=0x561e62f7ecb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:53:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.609+0000 7f02f5200640 1 --2- 172.21.15.18:0/2157074847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 0x561e62f7ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.609+0000 7f02f5200640 1 -- 172.21.15.18:0/2157074847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f74a90 msgr2=0x561e62f7e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.609+0000 7f02f5200640 1 --2- 172.21.15.18:0/2157074847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f74a90 0x561e62f7e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.609+0000 7f02f5200640 1 -- 172.21.15.18:0/2157074847 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e62e78180 con 0x561e62f7a460 2024-09-13T16:53:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.609+0000 7f02efe00640 1 --2- 172.21.15.18:0/2157074847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f74a90 0x561e62f7e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:53:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.610+0000 7f02f5200640 1 --2- 172.21.15.18:0/2157074847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f7a460 0x561e62f85c60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f02e802aec0 tx=0x7f02e8040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94eafd1b4b74a0bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.610+0000 7f02e6000640 1 -- 172.21.15.18:0/2157074847 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e804d070 con 0x561e62f7a460 2024-09-13T16:53:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.610+0000 7f02e6000640 1 -- 172.21.15.18:0/2157074847 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02e8004040 con 0x561e62f7a460 2024-09-13T16:53:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.610+0000 7f02e6000640 1 -- 172.21.15.18:0/2157074847 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e80307d0 con 0x561e62f7a460 2024-09-13T16:53:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.611+0000 7f02f9ffb740 1 -- 172.21.15.18:0/2157074847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f7a460 msgr2=0x561e62f85c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.611+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/2157074847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f7a460 0x561e62f85c60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f02e802aec0 tx=0x7f02e8040000 comp rx=0 tx=0).stop 2024-09-13T16:53:45.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.611+0000 7f02f9ffb740 1 -- 172.21.15.18:0/2157074847 shutdown_connections 2024-09-13T16:53:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.612+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/2157074847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f7a460 0x561e62f85c60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.612+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/2157074847 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f753d0 0x561e62f7ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.612+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/2157074847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f74a90 0x561e62f7e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.612+0000 7f02f9ffb740 1 -- 172.21.15.18:0/2157074847 >> 172.21.15.18:0/2157074847 conn(0x561e62f70100 msgr2=0x561e62f704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.612+0000 7f02f9ffb740 1 -- 172.21.15.18:0/2157074847 shutdown_connections 2024-09-13T16:53:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.612+0000 7f02f9ffb740 1 -- 172.21.15.18:0/2157074847 wait complete. 2024-09-13T16:53:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.613+0000 7f02f9ffb740 1 -- start start 2024-09-13T16:53:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.614+0000 7f02f9ffb740 1 Processor -- start 2024-09-13T16:53:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.615+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f85ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.615+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 0x561e62f825a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.615+0000 7f02f9ffb740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 0x561e62f82ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.616+0000 7f02f9ffb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62f83120 con 0x561e62f753d0 2024-09-13T16:53:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.616+0000 7f02f9ffb740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62fe0930 con 0x561e62f7a460 2024-09-13T16:53:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.616+0000 7f02f9ffb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e62fe0a70 con 0x561e62f74a90 2024-09-13T16:53:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.616+0000 7f02f9ffb740 10 client.0 _ll_register_callbacks cb 0x7f02e000bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:53:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.616+0000 7f02f5200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 0x561e62f82ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.616+0000 7f02f5200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 0x561e62f82ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:38554/0 (socket says 172.21.15.18:38554) 2024-09-13T16:53:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.616+0000 7f02efe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f85ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.616+0000 7f02f5200640 1 -- 172.21.15.18:0/3002390308 learned_addr learned my addr 172.21.15.18:0/3002390308 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.616+0000 7f02ef400640 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 0x561e62f825a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.617+0000 7f02efe00640 1 -- 172.21.15.18:0/3002390308 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 msgr2=0x561e62f82ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.617+0000 7f02efe00640 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 0x561e62f82ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.617+0000 7f02efe00640 1 -- 172.21.15.18:0/3002390308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 msgr2=0x561e62f825a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.617+0000 7f02efe00640 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 0x561e62f825a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.617+0000 7f02efe00640 1 -- 172.21.15.18:0/3002390308 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f0117930 con 0x561e62f74a90 2024-09-13T16:53:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.617+0000 7f02efe00640 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f85ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x561e62f7dca0 tx=0x7f02e0005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d4c7e339cb176bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.617+0000 7f02da000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:53:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.618+0000 7f02da000640 1 -- 172.21.15.18:0/3002390308 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00285a0 con 0x561e62f74a90 2024-09-13T16:53:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.618+0000 7f02f9ffb740 1 -- 172.21.15.18:0/3002390308 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02e0015070 con 0x561e62f74a90 2024-09-13T16:53:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.618+0000 7f02da000640 1 -- 172.21.15.18:0/3002390308 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f02e0017070 con 0x561e62f74a90 2024-09-13T16:53:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.618+0000 7f02da000640 1 -- 172.21.15.18:0/3002390308 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02e0005600 con 0x561e62f74a90 2024-09-13T16:53:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.619+0000 7f02f9ffb740 10 client.25489 fetch_fsmap learned FSMap version 26 2024-09-13T16:53:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.619+0000 7f02f9ffb740 1 -- 172.21.15.18:0/3002390308 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561e62e9d560 con 0x561e62f74a90 2024-09-13T16:53:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.619+0000 7f02da000640 1 -- 172.21.15.18:0/3002390308 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02e0015070 con 0x561e62f74a90 2024-09-13T16:53:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.620+0000 7f02da000640 1 -- 172.21.15.18:0/3002390308 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f02e002f060 con 0x561e62f74a90 2024-09-13T16:53:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.620+0000 7f02f9ffb740 10 client.25489 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T16:53:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.620+0000 7f02f9ffb740 10 client.25489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:53:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.620+0000 7f02f9ffb740 20 client.25489 populate_metadata read hostname 'smithi018' 2024-09-13T16:53:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.620+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561e62fe2390 0x561e62fe4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.620+0000 7f02f9ffb740 4 client.25489 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:53:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.620+0000 7f02f9ffb740 1 -- 172.21.15.18:0/3002390308 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561e62bcb300 con 0x561e62fe2390 2024-09-13T16:53:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.621+0000 7f02ef400640 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561e62fe2390 0x561e62fe4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.622+0000 7f02ef400640 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561e62fe2390 0x561e62fe4780 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b7bba30420d0e8d server_cookie=1e8fdc49734faabf in_seq=0 out_seq=0 2024-09-13T16:53:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.622+0000 7f02da000640 10 client.25489 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.646+0000 7f02da000640 1 -- 172.21.15.18:0/3002390308 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561e62bcb300 con 0x561e62fe2390 2024-09-13T16:53:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.646+0000 7f02da000640 10 client.25489 handle_command_reply: tid=0 2024-09-13T16:53:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.646+0000 7f02f9ffb740 1 client.25489 shutdown 2024-09-13T16:53:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.646+0000 7f02f9ffb740 1 -- 172.21.15.18:0/3002390308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 msgr2=0x561e62f85ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.646+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f85ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x561e62f7dca0 tx=0x7f02e0005280 comp rx=0 tx=0).stop 2024-09-13T16:53:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.647+0000 7f02f9ffb740 1 -- 172.21.15.18:0/3002390308 shutdown_connections 2024-09-13T16:53:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.647+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561e62fe2390 0x561e62fe4780 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.647+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561e62f753d0 0x561e62f825a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.647+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561e62f7a460 0x561e62f82ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.647+0000 7f02f9ffb740 1 --2- 172.21.15.18:0/3002390308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e62f74a90 0x561e62f85ab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.647+0000 7f02f9ffb740 1 -- 172.21.15.18:0/3002390308 >> 172.21.15.18:0/3002390308 conn(0x561e62f70100 msgr2=0x561e62f7e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.647+0000 7f02da000640 0 client.25489 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.647+0000 7f02f9ffb740 1 -- 172.21.15.18:0/3002390308 shutdown_connections 2024-09-13T16:53:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.648+0000 7f02f9ffb740 1 -- 172.21.15.18:0/3002390308 wait complete. 2024-09-13T16:53:45.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.648+0000 7f02f9ffb740 20 client.25489 trim_cache size 0 max 16384 2024-09-13T16:53:45.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:53:45.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:53:45.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:53:45.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:53:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.650+0000 7f02f7200640 1 -- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f02d40a1190 msgr2=0x7f02d40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.650+0000 7f02f7200640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f02d40a1190 0x7f02d40a3650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f02e80098d0 tx=0x7f02e8009840 comp rx=0 tx=0).stop 2024-09-13T16:53:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.650+0000 7f02f7200640 1 -- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f0109870 msgr2=0x7f02f01a4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.650+0000 7f02f7200640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f0109870 0x7f02f01a4f90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00d6a0 tx=0x7f02dc00db60 comp rx=0 tx=0).stop 2024-09-13T16:53:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.651+0000 7f02f7200640 1 -- 172.21.15.18:0/3393890281 shutdown_connections 2024-09-13T16:53:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.651+0000 7f02f7200640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f02d40a1190 0x7f02d40a3650 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.651+0000 7f02f7200640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f0109870 0x7f02f01a4f90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.651+0000 7f02f7200640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f010c240 0x7f02f01ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.651+0000 7f02f7200640 1 --2- 172.21.15.18:0/3393890281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02f0071120 0x7f02f01a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.651+0000 7f02f7200640 1 -- 172.21.15.18:0/3393890281 >> 172.21.15.18:0/3393890281 conn(0x7f02f006cf30 msgr2=0x7f02f010d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.651+0000 7f02f7200640 1 -- 172.21.15.18:0/3393890281 shutdown_connections 2024-09-13T16:53:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:45.651+0000 7f02f7200640 1 -- 172.21.15.18:0/3393890281 wait complete. 2024-09-13T16:53:46.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:45 smithi094 ceph-mon[35259]: pgmap v430: 129 pgs: 129 active+clean; 24 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.9 MiB/s wr, 138 op/s 2024-09-13T16:53:46.222 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:45 smithi018 ceph-mon[30981]: pgmap v430: 129 pgs: 129 active+clean; 24 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.9 MiB/s wr, 138 op/s 2024-09-13T16:53:46.222 INFO:tasks.workunit.client.0.smithi018.stdout: 17 336783 987 212290 856 67195 1024 2024-09-13T16:53:46.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:45 smithi144 ceph-mon[35328]: pgmap v430: 129 pgs: 129 active+clean; 24 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.9 MiB/s wr, 138 op/s 2024-09-13T16:53:48.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:47 smithi094 ceph-mon[35259]: pgmap v431: 129 pgs: 129 active+clean; 29 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 2.3 MiB/s wr, 127 op/s 2024-09-13T16:53:48.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:47 smithi018 ceph-mon[30981]: pgmap v431: 129 pgs: 129 active+clean; 29 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 2.3 MiB/s wr, 127 op/s 2024-09-13T16:53:48.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:47 smithi144 ceph-mon[35328]: pgmap v431: 129 pgs: 129 active+clean; 29 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 2.3 MiB/s wr, 127 op/s 2024-09-13T16:53:50.155 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:49 smithi018 ceph-mon[30981]: pgmap v432: 129 pgs: 129 active+clean; 49 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-09-13T16:53:50.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:49 smithi094 ceph-mon[35259]: pgmap v432: 129 pgs: 129 active+clean; 49 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-09-13T16:53:50.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:49 smithi144 ceph-mon[35328]: pgmap v432: 129 pgs: 129 active+clean; 49 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-09-13T16:53:51.904 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:51 smithi018 ceph-mon[30981]: pgmap v433: 129 pgs: 129 active+clean; 59 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.6 MiB/s wr, 224 op/s 2024-09-13T16:53:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:51 smithi094 ceph-mon[35259]: pgmap v433: 129 pgs: 129 active+clean; 59 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.6 MiB/s wr, 224 op/s 2024-09-13T16:53:52.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:51 smithi144 ceph-mon[35328]: pgmap v433: 129 pgs: 129 active+clean; 59 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.6 MiB/s wr, 224 op/s 2024-09-13T16:53:54.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:53 smithi094 ceph-mon[35259]: pgmap v434: 129 pgs: 129 active+clean; 63 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.9 MiB/s wr, 224 op/s 2024-09-13T16:53:54.248 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:53 smithi018 ceph-mon[30981]: pgmap v434: 129 pgs: 129 active+clean; 63 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.9 MiB/s wr, 224 op/s 2024-09-13T16:53:54.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:53 smithi144 ceph-mon[35328]: pgmap v434: 129 pgs: 129 active+clean; 63 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.9 MiB/s wr, 224 op/s 2024-09-13T16:53:56.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:55 smithi094 ceph-mon[35259]: pgmap v435: 129 pgs: 129 active+clean; 63 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 4.0 MiB/s wr, 207 op/s 2024-09-13T16:53:56.200 INFO:tasks.workunit.client.0.smithi018.stdout: 22 523171 267 333642 316 150569 734 2024-09-13T16:53:56.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:55 smithi018 ceph-mon[30981]: pgmap v435: 129 pgs: 129 active+clean; 63 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 4.0 MiB/s wr, 207 op/s 2024-09-13T16:53:56.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:55 smithi144 ceph-mon[35328]: pgmap v435: 129 pgs: 129 active+clean; 63 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 4.0 MiB/s wr, 207 op/s 2024-09-13T16:53:58.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:57 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:53:58.065 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:57 smithi018 ceph-mon[30981]: pgmap v436: 129 pgs: 129 active+clean; 68 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 182 op/s 2024-09-13T16:53:58.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:57 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:53:58.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:57 smithi144 ceph-mon[35328]: pgmap v436: 129 pgs: 129 active+clean; 68 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 182 op/s 2024-09-13T16:53:58.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:57 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:53:58.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:57 smithi094 ceph-mon[35259]: pgmap v436: 129 pgs: 129 active+clean; 68 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 182 op/s 2024-09-13T16:53:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.815+0000 7f8b56000640 1 -- 172.21.15.18:0/2304136465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b500fe3d0 msgr2=0x7f8b501007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.815+0000 7f8b56000640 1 --2- 172.21.15.18:0/2304136465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b500fe3d0 0x7f8b501007e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009900 tx=0x7f8b4402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.815+0000 7f8b56000640 1 -- 172.21.15.18:0/2304136465 shutdown_connections 2024-09-13T16:53:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.815+0000 7f8b56000640 1 --2- 172.21.15.18:0/2304136465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b501036d0 0x7f8b50103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.815+0000 7f8b56000640 1 --2- 172.21.15.18:0/2304136465 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b50100d20 0x7f8b50103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.815+0000 7f8b56000640 1 --2- 172.21.15.18:0/2304136465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b500fe3d0 0x7f8b501007e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.815+0000 7f8b56000640 1 -- 172.21.15.18:0/2304136465 >> 172.21.15.18:0/2304136465 conn(0x7f8b500fa1c0 msgr2=0x7f8b500fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.815+0000 7f8b56000640 1 -- 172.21.15.18:0/2304136465 shutdown_connections 2024-09-13T16:53:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.815+0000 7f8b56000640 1 -- 172.21.15.18:0/2304136465 wait complete. 2024-09-13T16:53:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.816+0000 7f8b56000640 1 Processor -- start 2024-09-13T16:53:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.816+0000 7f8b56000640 1 -- start start 2024-09-13T16:53:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b56000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b500fe3d0 0x7f8b5019c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b56000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50100d20 0x7f8b5019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b56000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b501036d0 0x7f8b501a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b56000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501a3d30 con 0x7f8b501036d0 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b56000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501a3ea0 con 0x7f8b500fe3d0 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b56000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501a4060 con 0x7f8b50100d20 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b54c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b500fe3d0 0x7f8b5019c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b54c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b500fe3d0 0x7f8b5019c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:53666/0 (socket says 172.21.15.18:53666) 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b54c00640 1 -- 172.21.15.18:0/1087570032 learned_addr learned my addr 172.21.15.18:0/1087570032 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b55600640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b501036d0 0x7f8b501a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.817+0000 7f8b4fe00640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50100d20 0x7f8b5019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.818+0000 7f8b54c00640 1 -- 172.21.15.18:0/1087570032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50100d20 msgr2=0x7f8b5019c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.818+0000 7f8b54c00640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50100d20 0x7f8b5019c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.818+0000 7f8b54c00640 1 -- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b501036d0 msgr2=0x7f8b501a37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.818+0000 7f8b54c00640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b501036d0 0x7f8b501a37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.818+0000 7f8b54c00640 1 -- 172.21.15.18:0/1087570032 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44009560 con 0x7f8b500fe3d0 2024-09-13T16:53:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.818+0000 7f8b55600640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b501036d0 0x7f8b501a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:53:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.818+0000 7f8b54c00640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b500fe3d0 0x7f8b5019c290 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8b44031500 tx=0x7f8b44003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.819+0000 7f8b4d600640 1 -- 172.21.15.18:0/1087570032 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44003e00 con 0x7f8b500fe3d0 2024-09-13T16:53:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.819+0000 7f8b4d600640 1 -- 172.21.15.18:0/1087570032 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b44031c70 con 0x7f8b500fe3d0 2024-09-13T16:53:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.819+0000 7f8b4d600640 1 -- 172.21.15.18:0/1087570032 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4403bd80 con 0x7f8b500fe3d0 2024-09-13T16:53:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.819+0000 7f8b56000640 1 -- 172.21.15.18:0/1087570032 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b501a42e0 con 0x7f8b500fe3d0 2024-09-13T16:53:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.819+0000 7f8b56000640 1 -- 172.21.15.18:0/1087570032 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b501a47c0 con 0x7f8b500fe3d0 2024-09-13T16:53:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.822+0000 7f8b4d600640 1 -- 172.21.15.18:0/1087570032 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8b4403b460 con 0x7f8b500fe3d0 2024-09-13T16:53:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.823+0000 7f8b5a49f740 1 Processor -- start 2024-09-13T16:53:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.823+0000 7f8b5a49f740 1 -- start start 2024-09-13T16:53:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b4d600640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b380a1130 0x7f8b380a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474dfa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b4d600640 1 -- 172.21.15.18:0/1087570032 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f8b440ed5d0 con 0x7f8b500fe3d0 2024-09-13T16:53:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474dff080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b54c00640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b380a1130 0x7f8b380a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dff650 0x557474e01b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474d05bb0 con 0x557474dfa5c0 2024-09-13T16:53:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474d63a70 con 0x557474dff650 2024-09-13T16:53:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474d61200 con 0x557474df9c80 2024-09-13T16:53:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b55600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474dfa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.824+0000 7f8b55600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474dfa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:32852/0 (socket says 172.21.15.18:32852) 2024-09-13T16:53:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b55600640 1 -- 172.21.15.18:0/3693739786 learned_addr learned my addr 172.21.15.18:0/3693739786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b4fe00640 1 --2- 172.21.15.18:0/3693739786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474dff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b55600640 1 --2- 172.21.15.18:0/3693739786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dff650 0x557474e01b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b55600640 1 -- 172.21.15.18:0/3693739786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dff650 msgr2=0x557474e01b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b55600640 1 --2- 172.21.15.18:0/3693739786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dff650 0x557474e01b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b55600640 1 -- 172.21.15.18:0/3693739786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 msgr2=0x557474dff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b55600640 1 --2- 172.21.15.18:0/3693739786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474dff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b55600640 1 -- 172.21.15.18:0/3693739786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557474cfe940 con 0x557474df9c80 2024-09-13T16:53:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b4fe00640 1 --2- 172.21.15.18:0/3693739786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474dff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:53:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b55600640 1 --2- 172.21.15.18:0/3693739786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474dfa080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800ab80 tx=0x7f8b48009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e792383d430f384d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.825+0000 7f8b54c00640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b380a1130 0x7f8b380a35f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8b44005ec0 tx=0x7f8b440da040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.826+0000 7f8b42000640 1 -- 172.21.15.18:0/3693739786 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48010050 con 0x557474df9c80 2024-09-13T16:53:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.826+0000 7f8b42000640 1 -- 172.21.15.18:0/3693739786 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b480193b0 con 0x557474df9c80 2024-09-13T16:53:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.826+0000 7f8b42000640 1 -- 172.21.15.18:0/3693739786 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48010050 con 0x557474df9c80 2024-09-13T16:53:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.827+0000 7f8b5a49f740 1 -- 172.21.15.18:0/3693739786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 msgr2=0x557474dfa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.827+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/3693739786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474dfa080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800ab80 tx=0x7f8b48009650 comp rx=0 tx=0).stop 2024-09-13T16:53:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.827+0000 7f8b5a49f740 1 -- 172.21.15.18:0/3693739786 shutdown_connections 2024-09-13T16:53:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.827+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/3693739786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474dff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.827+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/3693739786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dff650 0x557474e01b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.827+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/3693739786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474dfa080 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.827+0000 7f8b5a49f740 1 -- 172.21.15.18:0/3693739786 >> 172.21.15.18:0/3693739786 conn(0x557474df52f0 msgr2=0x557474df56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.828+0000 7f8b5a49f740 1 -- 172.21.15.18:0/3693739786 shutdown_connections 2024-09-13T16:53:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.828+0000 7f8b5a49f740 1 -- 172.21.15.18:0/3693739786 wait complete. 2024-09-13T16:53:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.828+0000 7f8b5a49f740 1 -- start start 2024-09-13T16:53:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.829+0000 7f8b5a49f740 1 Processor -- start 2024-09-13T16:53:58.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.829+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474e03930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.829+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474e03e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.829+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dff650 0x557474e0aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.829+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474d5caf0 con 0x557474dfa5c0 2024-09-13T16:53:58.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.829+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474d1af20 con 0x557474dff650 2024-09-13T16:53:58.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.829+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474d1abc0 con 0x557474df9c80 2024-09-13T16:53:58.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.830+0000 7f8b5a49f740 10 client.0 _ll_register_callbacks cb 0x557474d4ca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.830+0000 7f8b4fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474e03e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.830+0000 7f8b4fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474e03e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49012/0 (socket says 172.21.15.18:49012) 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.830+0000 7f8b4fe00640 1 -- 172.21.15.18:0/1950635471 learned_addr learned my addr 172.21.15.18:0/1950635471 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.830+0000 7f8b4fe00640 1 -- 172.21.15.18:0/1950635471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 msgr2=0x557474e03930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.830+0000 7f8b4fe00640 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474e03930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.830+0000 7f8b4fe00640 1 -- 172.21.15.18:0/1950635471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dff650 msgr2=0x557474e0aeb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.830+0000 7f8b4fe00640 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dff650 0x557474e0aeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.830+0000 7f8b4fe00640 1 -- 172.21.15.18:0/1950635471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b48013040 con 0x557474dfa5c0 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.831+0000 7f8b4fe00640 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474e03e70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c012700 tx=0x7f8b3c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1f63f4673b6cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.831+0000 7f8b36a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.831+0000 7f8b36a00640 1 -- 172.21.15.18:0/1950635471 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c017070 con 0x557474dfa5c0 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.831+0000 7f8b36a00640 1 -- 172.21.15.18:0/1950635471 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f8b3c004020 con 0x557474dfa5c0 2024-09-13T16:53:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.831+0000 7f8b5a49f740 1 -- 172.21.15.18:0/1950635471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557474d86c90 con 0x557474dfa5c0 2024-09-13T16:53:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.831+0000 7f8b36a00640 1 -- 172.21.15.18:0/1950635471 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b3c004220 con 0x557474dfa5c0 2024-09-13T16:53:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.831+0000 7f8b5a49f740 10 client.15480 fetch_fsmap learned FSMap version 27 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.831+0000 7f8b5a49f740 1 -- 172.21.15.18:0/1950635471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557474d5b170 con 0x557474dfa5c0 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.832+0000 7f8b36a00640 1 -- 172.21.15.18:0/1950635471 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557474d86c90 con 0x557474dfa5c0 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.832+0000 7f8b36a00640 1 -- 172.21.15.18:0/1950635471 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f8b3c003850 con 0x557474dfa5c0 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.832+0000 7f8b5a49f740 10 client.15480 fetch_fsmap finished waiting for FSMap version 27 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.832+0000 7f8b5a49f740 10 client.15480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.832+0000 7f8b5a49f740 20 client.15480 populate_metadata read hostname 'smithi018' 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.832+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557474e20690 0x557474e22ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.832+0000 7f8b5a49f740 4 client.15480 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.832+0000 7f8b5a49f740 1 -- 172.21.15.18:0/1950635471 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557474d4f7d0 con 0x557474e20690 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.833+0000 7f8b55600640 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557474e20690 0x557474e22ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.833+0000 7f8b55600640 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557474e20690 0x557474e22ab0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df41d44c38adf91c server_cookie=dff132dca8c34115 in_seq=0 out_seq=0 2024-09-13T16:53:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.833+0000 7f8b36a00640 10 client.15480 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.835+0000 7f8b36a00640 1 -- 172.21.15.18:0/1950635471 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557474d4f7d0 con 0x557474e20690 2024-09-13T16:53:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.835+0000 7f8b36a00640 10 client.15480 handle_command_reply: tid=0 2024-09-13T16:53:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.835+0000 7f8b5a49f740 1 client.15480 shutdown 2024-09-13T16:53:58.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.836+0000 7f8b5a49f740 1 -- 172.21.15.18:0/1950635471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 msgr2=0x557474e03e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:58.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.836+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474e03e70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c012700 tx=0x7f8b3c012bc0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.836+0000 7f8b5a49f740 1 -- 172.21.15.18:0/1950635471 shutdown_connections 2024-09-13T16:53:58.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.836+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557474e20690 0x557474e22ab0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.836+0000 7f8b36a00640 0 client.15480 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:58.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.836+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474e03e70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.836+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dff650 0x557474e0aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.836+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/1950635471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474e03930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.836+0000 7f8b5a49f740 1 -- 172.21.15.18:0/1950635471 >> 172.21.15.18:0/1950635471 conn(0x557474df52f0 msgr2=0x557474df6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:58.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.836+0000 7f8b5a49f740 1 -- 172.21.15.18:0/1950635471 shutdown_connections 2024-09-13T16:53:58.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.837+0000 7f8b5a49f740 1 -- 172.21.15.18:0/1950635471 wait complete. 2024-09-13T16:53:58.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.837+0000 7f8b5a49f740 20 client.15480 trim_cache size 0 max 16384 2024-09-13T16:53:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.858+0000 7f8b5a49f740 1 Processor -- start 2024-09-13T16:53:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.867+0000 7f8b5a49f740 1 -- start start 2024-09-13T16:53:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.867+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474df9c80 0x557474df4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.867+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474e0ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.867+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474dff650 0x557474df56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.867+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474ac3e60 con 0x557474dfa5c0 2024-09-13T16:53:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.867+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474e1ebc0 con 0x557474df9c80 2024-09-13T16:53:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.867+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474dfaaa0 con 0x557474dff650 2024-09-13T16:53:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.869+0000 7f8b55600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474df9c80 0x557474df4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.869+0000 7f8b55600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474df9c80 0x557474df4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:53680/0 (socket says 172.21.15.18:53680) 2024-09-13T16:53:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.869+0000 7f8b55600640 1 -- 172.21.15.18:0/3487758712 learned_addr learned my addr 172.21.15.18:0/3487758712 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.870+0000 7f8b55600640 1 --2- 172.21.15.18:0/3487758712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474dff650 0x557474df56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.870+0000 7f8b55600640 1 -- 172.21.15.18:0/3487758712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474dff650 msgr2=0x557474df56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.870+0000 7f8b55600640 1 --2- 172.21.15.18:0/3487758712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474dff650 0x557474df56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.870+0000 7f8b55600640 1 -- 172.21.15.18:0/3487758712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 msgr2=0x557474e0ae70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:53:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.870+0000 7f8b4fe00640 1 --2- 172.21.15.18:0/3487758712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474e0ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.871+0000 7f8b55600640 1 --2- 172.21.15.18:0/3487758712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474e0ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.871+0000 7f8b55600640 1 -- 172.21.15.18:0/3487758712 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557474cfd180 con 0x557474df9c80 2024-09-13T16:53:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.876+0000 7f8b55600640 1 --2- 172.21.15.18:0/3487758712 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474df9c80 0x557474df4c70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800e920 tx=0x7f8b48004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf06a1c6bcb6bbb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.880+0000 7f8b42a00640 1 -- 172.21.15.18:0/3487758712 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48010040 con 0x557474df9c80 2024-09-13T16:53:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.880+0000 7f8b42a00640 1 -- 172.21.15.18:0/3487758712 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b48019520 con 0x557474df9c80 2024-09-13T16:53:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.880+0000 7f8b42a00640 1 -- 172.21.15.18:0/3487758712 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48025420 con 0x557474df9c80 2024-09-13T16:53:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.881+0000 7f8b5a49f740 1 -- 172.21.15.18:0/3487758712 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474df9c80 msgr2=0x557474df4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.881+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/3487758712 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474df9c80 0x557474df4c70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800e920 tx=0x7f8b48004b50 comp rx=0 tx=0).stop 2024-09-13T16:53:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.890+0000 7f8b5a49f740 1 -- 172.21.15.18:0/3487758712 shutdown_connections 2024-09-13T16:53:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.890+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/3487758712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dfa5c0 0x557474e0ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.890+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/3487758712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474dff650 0x557474df56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.890+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/3487758712 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474df9c80 0x557474df4c70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.890+0000 7f8b5a49f740 1 -- 172.21.15.18:0/3487758712 >> 172.21.15.18:0/3487758712 conn(0x557474df52f0 msgr2=0x557474dfb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:58.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.894+0000 7f8b5a49f740 1 -- 172.21.15.18:0/3487758712 shutdown_connections 2024-09-13T16:53:58.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.895+0000 7f8b5a49f740 1 -- 172.21.15.18:0/3487758712 wait complete. 2024-09-13T16:53:58.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.895+0000 7f8b5a49f740 1 -- start start 2024-09-13T16:53:58.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.896+0000 7f8b5a49f740 1 Processor -- start 2024-09-13T16:53:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.901+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474e07bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.901+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dfa5c0 0x557474e08130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.902+0000 7f8b5a49f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dff650 0x557474e76b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.902+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474e086f0 con 0x557474dff650 2024-09-13T16:53:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.902+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474e08860 con 0x557474dfa5c0 2024-09-13T16:53:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.902+0000 7f8b5a49f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557474e880d0 con 0x557474df9c80 2024-09-13T16:53:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.902+0000 7f8b5a49f740 10 client.0 _ll_register_callbacks cb 0x7f8b48009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:53:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.902+0000 7f8b4fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dfa5c0 0x557474e08130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.902+0000 7f8b4fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dfa5c0 0x557474e08130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:53690/0 (socket says 172.21.15.18:53690) 2024-09-13T16:53:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.902+0000 7f8b4fe00640 1 -- 172.21.15.18:0/2640565119 learned_addr learned my addr 172.21.15.18:0/2640565119 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:53:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.903+0000 7f8b55600640 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dff650 0x557474e76b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.903+0000 7f8b4fe00640 1 -- 172.21.15.18:0/2640565119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 msgr2=0x557474e07bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:53:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.903+0000 7f8b4fe00640 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474e07bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.903+0000 7f8b4fe00640 1 -- 172.21.15.18:0/2640565119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dff650 msgr2=0x557474e76b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:53:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.903+0000 7f8b4fe00640 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dff650 0x557474e76b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.903+0000 7f8b4fe00640 1 -- 172.21.15.18:0/2640565119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4801e040 con 0x557474dfa5c0 2024-09-13T16:53:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.903+0000 7f8b55600640 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dff650 0x557474e76b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:53:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.904+0000 7f8b4fe00640 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dfa5c0 0x557474e08130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0126d0 tx=0x7f8b3c005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56e763a986e63a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:53:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.905+0000 7f8b36a00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.905+0000 7f8b36a00640 1 -- 172.21.15.18:0/2640565119 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c017040 con 0x557474dfa5c0 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.905+0000 7f8b36a00640 1 -- 172.21.15.18:0/2640565119 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f8b3c003800 con 0x557474dfa5c0 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.905+0000 7f8b5a49f740 1 -- 172.21.15.18:0/2640565119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b480193b0 con 0x557474dfa5c0 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.905+0000 7f8b36a00640 1 -- 172.21.15.18:0/2640565119 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b3c0039c0 con 0x557474dfa5c0 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.905+0000 7f8b5a49f740 10 client.25532 fetch_fsmap learned FSMap version 27 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.905+0000 7f8b5a49f740 1 -- 172.21.15.18:0/2640565119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557474d22560 con 0x557474dfa5c0 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.906+0000 7f8b36a00640 1 -- 172.21.15.18:0/2640565119 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b480193b0 con 0x557474dfa5c0 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.906+0000 7f8b36a00640 1 -- 172.21.15.18:0/2640565119 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f8b3c00e5f0 con 0x557474dfa5c0 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.907+0000 7f8b5a49f740 10 client.25532 fetch_fsmap finished waiting for FSMap version 27 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.907+0000 7f8b5a49f740 10 client.25532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:53:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.907+0000 7f8b5a49f740 20 client.25532 populate_metadata read hostname 'smithi018' 2024-09-13T16:53:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.907+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557474e777a0 0x557474e79bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:53:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.907+0000 7f8b5a49f740 4 client.25532 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:53:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.907+0000 7f8b5a49f740 1 -- 172.21.15.18:0/2640565119 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557474a50300 con 0x557474e777a0 2024-09-13T16:53:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.907+0000 7f8b55600640 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557474e777a0 0x557474e79bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:53:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.908+0000 7f8b55600640 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557474e777a0 0x557474e79bc0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9346111eed063292 server_cookie=a06c832be67fded1 in_seq=0 out_seq=0 2024-09-13T16:53:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:58.908+0000 7f8b36a00640 10 client.25532 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.445+0000 7f8b36a00640 1 -- 172.21.15.18:0/2640565119 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557474a50300 con 0x557474e777a0 2024-09-13T16:53:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.445+0000 7f8b36a00640 10 client.25532 handle_command_reply: tid=0 2024-09-13T16:53:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.446+0000 7f8b5a49f740 1 client.25532 shutdown 2024-09-13T16:53:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.447+0000 7f8b5a49f740 1 -- 172.21.15.18:0/2640565119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dfa5c0 msgr2=0x557474e08130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.447+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dfa5c0 0x557474e08130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0126d0 tx=0x7f8b3c005c50 comp rx=0 tx=0).stop 2024-09-13T16:53:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.447+0000 7f8b5a49f740 1 -- 172.21.15.18:0/2640565119 shutdown_connections 2024-09-13T16:53:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.447+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557474e777a0 0x557474e79bc0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.447+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557474dff650 0x557474e76b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.447+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557474dfa5c0 0x557474e08130 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.447+0000 7f8b5a49f740 1 --2- 172.21.15.18:0/2640565119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557474df9c80 0x557474e07bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.447+0000 7f8b5a49f740 1 -- 172.21.15.18:0/2640565119 >> 172.21.15.18:0/2640565119 conn(0x557474df52f0 msgr2=0x557474df3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.447+0000 7f8b36a00640 0 client.25532 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:53:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.469+0000 7f8b5a49f740 1 -- 172.21.15.18:0/2640565119 shutdown_connections 2024-09-13T16:53:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.472+0000 7f8b5a49f740 1 -- 172.21.15.18:0/2640565119 wait complete. 2024-09-13T16:53:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.477+0000 7f8b5a49f740 20 client.25532 trim_cache size 0 max 16384 2024-09-13T16:53:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:53:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:53:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:53:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:53:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.512+0000 7f8b56000640 1 -- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b380a1130 msgr2=0x7f8b380a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.512+0000 7f8b56000640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b380a1130 0x7f8b380a35f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8b44005ec0 tx=0x7f8b440da040 comp rx=0 tx=0).stop 2024-09-13T16:53:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.512+0000 7f8b56000640 1 -- 172.21.15.18:0/1087570032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b500fe3d0 msgr2=0x7f8b5019c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:53:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.512+0000 7f8b56000640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b500fe3d0 0x7f8b5019c290 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8b44031500 tx=0x7f8b44003c10 comp rx=0 tx=0).stop 2024-09-13T16:53:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.516+0000 7f8b56000640 1 -- 172.21.15.18:0/1087570032 shutdown_connections 2024-09-13T16:53:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.516+0000 7f8b56000640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f8b380a1130 0x7f8b380a35f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.516+0000 7f8b56000640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b501036d0 0x7f8b501a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.516+0000 7f8b56000640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b50100d20 0x7f8b5019c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.516+0000 7f8b56000640 1 --2- 172.21.15.18:0/1087570032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b500fe3d0 0x7f8b5019c290 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:53:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.516+0000 7f8b56000640 1 -- 172.21.15.18:0/1087570032 >> 172.21.15.18:0/1087570032 conn(0x7f8b500fa1c0 msgr2=0x7f8b50101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:53:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.523+0000 7f8b56000640 1 -- 172.21.15.18:0/1087570032 shutdown_connections 2024-09-13T16:53:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:53:59.523+0000 7f8b56000640 1 -- 172.21.15.18:0/1087570032 wait complete. 2024-09-13T16:54:00.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:53:59 smithi018 ceph-mon[30981]: pgmap v437: 129 pgs: 129 active+clean; 68 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 224 op/s 2024-09-13T16:54:00.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:53:59 smithi094 ceph-mon[35259]: pgmap v437: 129 pgs: 129 active+clean; 68 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 224 op/s 2024-09-13T16:54:00.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:53:59 smithi144 ceph-mon[35328]: pgmap v437: 129 pgs: 129 active+clean; 68 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 224 op/s 2024-09-13T16:54:02.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:01 smithi094 ceph-mon[35259]: pgmap v438: 129 pgs: 129 active+clean; 72 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 220 op/s 2024-09-13T16:54:02.216 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:01 smithi018 ceph-mon[30981]: pgmap v438: 129 pgs: 129 active+clean; 72 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 220 op/s 2024-09-13T16:54:02.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:01 smithi144 ceph-mon[35328]: pgmap v438: 129 pgs: 129 active+clean; 72 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 220 op/s 2024-09-13T16:54:04.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:03 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:54:04.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:03 smithi018 ceph-mon[30981]: pgmap v439: 129 pgs: 129 active+clean; 72 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-09-13T16:54:04.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:03 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:54:04.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:03 smithi144 ceph-mon[35328]: pgmap v439: 129 pgs: 129 active+clean; 72 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-09-13T16:54:04.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:03 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:54:04.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:03 smithi094 ceph-mon[35259]: pgmap v439: 129 pgs: 129 active+clean; 72 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-09-13T16:54:06.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:05 smithi094 ceph-mon[35259]: pgmap v440: 129 pgs: 129 active+clean; 73 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 231 op/s 2024-09-13T16:54:06.200 INFO:tasks.workunit.client.0.smithi018.stdout: 32 388593 592 264592 476 152178 1001 2024-09-13T16:54:06.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:05 smithi018 ceph-mon[30981]: pgmap v440: 129 pgs: 129 active+clean; 73 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 231 op/s 2024-09-13T16:54:06.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:05 smithi144 ceph-mon[35328]: pgmap v440: 129 pgs: 129 active+clean; 73 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 231 op/s 2024-09-13T16:54:08.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:07 smithi094 ceph-mon[35259]: pgmap v441: 129 pgs: 129 active+clean; 81 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 247 op/s 2024-09-13T16:54:08.176 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:07 smithi018 ceph-mon[30981]: pgmap v441: 129 pgs: 129 active+clean; 81 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 247 op/s 2024-09-13T16:54:08.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:07 smithi144 ceph-mon[35328]: pgmap v441: 129 pgs: 129 active+clean; 81 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 247 op/s 2024-09-13T16:54:10.091 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:09 smithi018 ceph-mon[30981]: pgmap v442: 129 pgs: 129 active+clean; 99 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 378 op/s 2024-09-13T16:54:10.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:09 smithi144 ceph-mon[35328]: pgmap v442: 129 pgs: 129 active+clean; 99 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 378 op/s 2024-09-13T16:54:10.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:09 smithi094 ceph-mon[35259]: pgmap v442: 129 pgs: 129 active+clean; 99 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 378 op/s 2024-09-13T16:54:11.926 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:11 smithi018 ceph-mon[30981]: pgmap v443: 129 pgs: 129 active+clean; 114 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 426 op/s 2024-09-13T16:54:12.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:11 smithi144 ceph-mon[35328]: pgmap v443: 129 pgs: 129 active+clean; 114 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 426 op/s 2024-09-13T16:54:12.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:11 smithi094 ceph-mon[35259]: pgmap v443: 129 pgs: 129 active+clean; 114 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 426 op/s 2024-09-13T16:54:14.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:13 smithi018 ceph-mon[30981]: pgmap v444: 129 pgs: 129 active+clean; 120 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 388 op/s 2024-09-13T16:54:14.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:13 smithi144 ceph-mon[35328]: pgmap v444: 129 pgs: 129 active+clean; 120 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 388 op/s 2024-09-13T16:54:14.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:13 smithi094 ceph-mon[35259]: pgmap v444: 129 pgs: 129 active+clean; 120 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 388 op/s 2024-09-13T16:54:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.580+0000 7f4793e00640 1 -- 172.21.15.18:0/3357659652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4794070f40 msgr2=0x7f4794071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.580+0000 7f4793e00640 1 --2- 172.21.15.18:0/3357659652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4794070f40 0x7f4794071320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4784009900 tx=0x7f478402a440 comp rx=0 tx=0).stop 2024-09-13T16:54:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.580+0000 7f4793e00640 1 -- 172.21.15.18:0/3357659652 shutdown_connections 2024-09-13T16:54:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.580+0000 7f4793e00640 1 --2- 172.21.15.18:0/3357659652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f479410bdc0 0x7f479410e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.580+0000 7f4793e00640 1 --2- 172.21.15.18:0/3357659652 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4794071860 0x7f479410b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.580+0000 7f4793e00640 1 --2- 172.21.15.18:0/3357659652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4794070f40 0x7f4794071320 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.580+0000 7f4793e00640 1 -- 172.21.15.18:0/3357659652 >> 172.21.15.18:0/3357659652 conn(0x7f479406cd10 msgr2=0x7f479406f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.591+0000 7f4793e00640 1 -- 172.21.15.18:0/3357659652 shutdown_connections 2024-09-13T16:54:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.596+0000 7f4793e00640 1 -- 172.21.15.18:0/3357659652 wait complete. 2024-09-13T16:54:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.597+0000 7f4793e00640 1 Processor -- start 2024-09-13T16:54:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.597+0000 7f4793e00640 1 -- start start 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.597+0000 7f4793e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4794070f40 0x7f47941139d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.598+0000 7f4793e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4794071860 0x7f4794113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.598+0000 7f4792a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4794070f40 0x7f47941139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.598+0000 7f4792a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4794070f40 0x7f47941139d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:59218/0 (socket says 172.21.15.18:59218) 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.598+0000 7f4792a00640 1 -- 172.21.15.18:0/318475814 learned_addr learned my addr 172.21.15.18:0/318475814 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.598+0000 7f4792000640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4794071860 0x7f4794113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.598+0000 7f4793e00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f479410bdc0 0x7f47941a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.599+0000 7f4793400640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f479410bdc0 0x7f47941a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.599+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4794116fd0 con 0x7f479410bdc0 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.599+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4794117140 con 0x7f4794071860 2024-09-13T16:54:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.599+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47941a40a0 con 0x7f4794070f40 2024-09-13T16:54:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.601+0000 7f4792000640 1 -- 172.21.15.18:0/318475814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4794070f40 msgr2=0x7f47941139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.601+0000 7f4792000640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4794070f40 0x7f47941139d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.601+0000 7f4792000640 1 -- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f479410bdc0 msgr2=0x7f47941a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.601+0000 7f4792000640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f479410bdc0 0x7f47941a3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.601+0000 7f4792000640 1 -- 172.21.15.18:0/318475814 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784009560 con 0x7f4794071860 2024-09-13T16:54:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.601+0000 7f4793400640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f479410bdc0 0x7f47941a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:54:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.601+0000 7f4792000640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4794071860 0x7f4794113f10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f478000b3c0 tx=0x7f478000b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.602+0000 7f4792a00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4794070f40 0x7f47941139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:54:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.602+0000 7f4798a00640 1 -- 172.21.15.18:0/318475814 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780011830 con 0x7f4794071860 2024-09-13T16:54:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.602+0000 7f4798a00640 1 -- 172.21.15.18:0/318475814 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4780011e50 con 0x7f4794071860 2024-09-13T16:54:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.602+0000 7f4798a00640 1 -- 172.21.15.18:0/318475814 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478000f2e0 con 0x7f4794071860 2024-09-13T16:54:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.602+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47941a4380 con 0x7f4794071860 2024-09-13T16:54:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.602+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47941a4840 con 0x7f4794071860 2024-09-13T16:54:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.616+0000 7f4798a00640 1 -- 172.21.15.18:0/318475814 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f478001b460 con 0x7f4794071860 2024-09-13T16:54:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.618+0000 7f4798a00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47780a1280 0x7f47780a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.618+0000 7f4792a00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47780a1280 0x7f47780a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.620+0000 7f4792a00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47780a1280 0x7f47780a3740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4784006010 tx=0x7f4784004040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.620+0000 7f4798a00640 1 -- 172.21.15.18:0/318475814 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f47800cd360 con 0x7f4794071860 2024-09-13T16:54:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.633+0000 7f479cc77740 1 Processor -- start 2024-09-13T16:54:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.637+0000 7f479cc77740 1 -- start start 2024-09-13T16:54:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.637+0000 7f479cc77740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f354080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.637+0000 7f479cc77740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 0x56442f359080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.637+0000 7f479cc77740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f35bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.637+0000 7f479cc77740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f25fbb0 con 0x56442f353c80 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.637+0000 7f479cc77740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f2bda70 con 0x56442f359650 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.637+0000 7f479cc77740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f2bb200 con 0x56442f3545c0 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.649+0000 7f4792a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f354080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.649+0000 7f4792a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f354080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59008/0 (socket says 172.21.15.18:59008) 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.649+0000 7f4792a00640 1 -- 172.21.15.18:0/3483192400 learned_addr learned my addr 172.21.15.18:0/3483192400 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.649+0000 7f4792a00640 1 -- 172.21.15.18:0/3483192400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 msgr2=0x56442f359080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.649+0000 7f4792a00640 1 --2- 172.21.15.18:0/3483192400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 0x56442f359080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.650+0000 7f4792a00640 1 -- 172.21.15.18:0/3483192400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 msgr2=0x56442f35bb10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.650+0000 7f4792a00640 1 --2- 172.21.15.18:0/3483192400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f35bb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.650+0000 7f4792a00640 1 -- 172.21.15.18:0/3483192400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56442f258940 con 0x56442f353c80 2024-09-13T16:54:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.650+0000 7f4792a00640 1 --2- 172.21.15.18:0/3483192400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f354080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f47840044b0 tx=0x7f478403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1016c507cd685e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.659+0000 7f4788c00640 1 -- 172.21.15.18:0/3483192400 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784044040 con 0x56442f353c80 2024-09-13T16:54:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.659+0000 7f4788c00640 1 -- 172.21.15.18:0/3483192400 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47840319c0 con 0x56442f353c80 2024-09-13T16:54:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.659+0000 7f4788c00640 1 -- 172.21.15.18:0/3483192400 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478403db50 con 0x56442f353c80 2024-09-13T16:54:15.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.669+0000 7f479cc77740 1 -- 172.21.15.18:0/3483192400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 msgr2=0x56442f354080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:15.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.669+0000 7f479cc77740 1 --2- 172.21.15.18:0/3483192400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f354080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f47840044b0 tx=0x7f478403d000 comp rx=0 tx=0).stop 2024-09-13T16:54:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.677+0000 7f479cc77740 1 -- 172.21.15.18:0/3483192400 shutdown_connections 2024-09-13T16:54:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.677+0000 7f479cc77740 1 --2- 172.21.15.18:0/3483192400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f35bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.677+0000 7f479cc77740 1 --2- 172.21.15.18:0/3483192400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 0x56442f359080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.677+0000 7f479cc77740 1 --2- 172.21.15.18:0/3483192400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f354080 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.677+0000 7f479cc77740 1 -- 172.21.15.18:0/3483192400 >> 172.21.15.18:0/3483192400 conn(0x56442f34f2f0 msgr2=0x56442f34f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.692+0000 7f479cc77740 1 -- 172.21.15.18:0/3483192400 shutdown_connections 2024-09-13T16:54:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.692+0000 7f479cc77740 1 -- 172.21.15.18:0/3483192400 wait complete. 2024-09-13T16:54:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.693+0000 7f479cc77740 1 -- start start 2024-09-13T16:54:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.693+0000 7f479cc77740 1 Processor -- start 2024-09-13T16:54:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.694+0000 7f479cc77740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f35d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.694+0000 7f479cc77740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 0x56442f35dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.694+0000 7f479cc77740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f364f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.694+0000 7f479cc77740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f2b6af0 con 0x56442f353c80 2024-09-13T16:54:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.694+0000 7f479cc77740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f274f20 con 0x56442f359650 2024-09-13T16:54:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.694+0000 7f479cc77740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f274bc0 con 0x56442f3545c0 2024-09-13T16:54:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.694+0000 7f479cc77740 10 client.0 _ll_register_callbacks cb 0x56442f2a6a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:54:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.695+0000 7f4792a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f35d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.695+0000 7f4792a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f35d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59018/0 (socket says 172.21.15.18:59018) 2024-09-13T16:54:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.695+0000 7f4792a00640 1 -- 172.21.15.18:0/3011792328 learned_addr learned my addr 172.21.15.18:0/3011792328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.695+0000 7f4793400640 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f364f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.696+0000 7f4792a00640 1 -- 172.21.15.18:0/3011792328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 msgr2=0x56442f35dec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:54:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.696+0000 7f4792a00640 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 0x56442f35dec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.696+0000 7f4792a00640 1 -- 172.21.15.18:0/3011792328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 msgr2=0x56442f364f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.696+0000 7f4792a00640 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f364f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.696+0000 7f4792a00640 1 -- 172.21.15.18:0/3011792328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4794117670 con 0x56442f353c80 2024-09-13T16:54:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.696+0000 7f4792a00640 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f35d980 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4784032fd0 tx=0x7f4784031730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0b614d7a157754 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:15.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.703+0000 7f477d600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:54:15.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.703+0000 7f477d600640 1 -- 172.21.15.18:0/3011792328 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478403dce0 con 0x56442f353c80 2024-09-13T16:54:15.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.703+0000 7f477d600640 1 -- 172.21.15.18:0/3011792328 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f478403de40 con 0x56442f353c80 2024-09-13T16:54:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.711+0000 7f479cc77740 1 -- 172.21.15.18:0/3011792328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56442f2e0c90 con 0x56442f353c80 2024-09-13T16:54:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.717+0000 7f477d600640 1 -- 172.21.15.18:0/3011792328 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4784003e70 con 0x56442f353c80 2024-09-13T16:54:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.717+0000 7f479cc77740 10 client.15492 fetch_fsmap learned FSMap version 28 2024-09-13T16:54:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.717+0000 7f479cc77740 1 -- 172.21.15.18:0/3011792328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56442f2b5170 con 0x56442f353c80 2024-09-13T16:54:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.722+0000 7f477d600640 1 -- 172.21.15.18:0/3011792328 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56442f2e0c90 con 0x56442f353c80 2024-09-13T16:54:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.722+0000 7f477d600640 1 -- 172.21.15.18:0/3011792328 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4784068610 con 0x56442f353c80 2024-09-13T16:54:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.722+0000 7f479cc77740 10 client.15492 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:54:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.722+0000 7f479cc77740 10 client.15492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:54:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.722+0000 7f479cc77740 20 client.15492 populate_metadata read hostname 'smithi018' 2024-09-13T16:54:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.722+0000 7f479cc77740 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56442f369120 0x56442f36b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.722+0000 7f479cc77740 4 client.15492 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:54:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.722+0000 7f479cc77740 1 -- 172.21.15.18:0/3011792328 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56442f2a97d0 con 0x56442f369120 2024-09-13T16:54:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.748+0000 7f4792000640 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56442f369120 0x56442f36b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.795+0000 7f4792000640 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56442f369120 0x56442f36b540 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a43b421bcbf7e419 server_cookie=744b336a190dda2c in_seq=0 out_seq=0 2024-09-13T16:54:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.800+0000 7f477d600640 10 client.15492 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.814+0000 7f477d600640 1 -- 172.21.15.18:0/3011792328 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56442f2a97d0 con 0x56442f369120 2024-09-13T16:54:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.814+0000 7f477d600640 10 client.15492 handle_command_reply: tid=0 2024-09-13T16:54:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.818+0000 7f479cc77740 1 client.15492 shutdown 2024-09-13T16:54:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.822+0000 7f479cc77740 1 -- 172.21.15.18:0/3011792328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 msgr2=0x56442f35d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.822+0000 7f479cc77740 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f35d980 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4784032fd0 tx=0x7f4784031730 comp rx=0 tx=0).stop 2024-09-13T16:54:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.826+0000 7f479cc77740 1 -- 172.21.15.18:0/3011792328 shutdown_connections 2024-09-13T16:54:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.826+0000 7f479cc77740 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56442f369120 0x56442f36b540 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.826+0000 7f479cc77740 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f364f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.826+0000 7f479cc77740 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 0x56442f35dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.826+0000 7f479cc77740 1 --2- 172.21.15.18:0/3011792328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f35d980 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.826+0000 7f477d600640 0 client.15492 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.826+0000 7f479cc77740 1 -- 172.21.15.18:0/3011792328 >> 172.21.15.18:0/3011792328 conn(0x56442f34f2f0 msgr2=0x56442f350b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.835+0000 7f479cc77740 1 -- 172.21.15.18:0/3011792328 shutdown_connections 2024-09-13T16:54:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.836+0000 7f479cc77740 1 -- 172.21.15.18:0/3011792328 wait complete. 2024-09-13T16:54:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.840+0000 7f479cc77740 20 client.15492 trim_cache size 0 max 16384 2024-09-13T16:54:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.924+0000 7f479cc77740 1 Processor -- start 2024-09-13T16:54:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.924+0000 7f479cc77740 1 -- start start 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.924+0000 7f479cc77740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f36fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.924+0000 7f479cc77740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 0x56442f364ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.924+0000 7f479cc77740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f35d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.924+0000 7f479cc77740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f01de60 con 0x56442f353c80 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.924+0000 7f479cc77740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f2e0c90 con 0x56442f359650 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.924+0000 7f479cc77740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f366080 con 0x56442f3545c0 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.925+0000 7f4793400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f35d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.925+0000 7f4793400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f35d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:37018/0 (socket says 172.21.15.18:37018) 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.925+0000 7f4793400640 1 -- 172.21.15.18:0/2300622104 learned_addr learned my addr 172.21.15.18:0/2300622104 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.925+0000 7f4793400640 1 -- 172.21.15.18:0/2300622104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 msgr2=0x56442f364ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:54:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.925+0000 7f4793400640 1 --2- 172.21.15.18:0/2300622104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 0x56442f364ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.925+0000 7f4793400640 1 -- 172.21.15.18:0/2300622104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 msgr2=0x56442f36fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:15.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.925+0000 7f4792a00640 1 --2- 172.21.15.18:0/2300622104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f36fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.925+0000 7f4793400640 1 --2- 172.21.15.18:0/2300622104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f36fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.925+0000 7f4793400640 1 -- 172.21.15.18:0/2300622104 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56442f257180 con 0x56442f359650 2024-09-13T16:54:15.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.926+0000 7f4792a00640 1 --2- 172.21.15.18:0/2300622104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f36fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:54:15.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.926+0000 7f4793400640 1 --2- 172.21.15.18:0/2300622104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f35d730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f478c003da0 tx=0x7f478c004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97fb7f25a0efea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:15.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.927+0000 7f4789600640 1 -- 172.21.15.18:0/2300622104 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c004d20 con 0x56442f359650 2024-09-13T16:54:15.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.927+0000 7f4789600640 1 -- 172.21.15.18:0/2300622104 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f478c004e80 con 0x56442f359650 2024-09-13T16:54:15.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.927+0000 7f4789600640 1 -- 172.21.15.18:0/2300622104 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c0054e0 con 0x56442f359650 2024-09-13T16:54:15.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.928+0000 7f479cc77740 1 -- 172.21.15.18:0/2300622104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 msgr2=0x56442f35d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:15.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.928+0000 7f479cc77740 1 --2- 172.21.15.18:0/2300622104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f35d730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f478c003da0 tx=0x7f478c004410 comp rx=0 tx=0).stop 2024-09-13T16:54:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.930+0000 7f479cc77740 1 -- 172.21.15.18:0/2300622104 shutdown_connections 2024-09-13T16:54:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.930+0000 7f479cc77740 1 --2- 172.21.15.18:0/2300622104 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f35d730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.930+0000 7f479cc77740 1 --2- 172.21.15.18:0/2300622104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f3545c0 0x56442f364ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.930+0000 7f479cc77740 1 --2- 172.21.15.18:0/2300622104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f353c80 0x56442f36fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.930+0000 7f479cc77740 1 -- 172.21.15.18:0/2300622104 >> 172.21.15.18:0/2300622104 conn(0x56442f34f2f0 msgr2=0x56442f355580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.941+0000 7f479cc77740 1 -- 172.21.15.18:0/2300622104 shutdown_connections 2024-09-13T16:54:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.941+0000 7f479cc77740 1 -- 172.21.15.18:0/2300622104 wait complete. 2024-09-13T16:54:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.941+0000 7f479cc77740 1 -- start start 2024-09-13T16:54:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.942+0000 7f479cc77740 1 Processor -- start 2024-09-13T16:54:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.942+0000 7f479cc77740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f353c80 0x56442f363e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.947 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.943+0000 7f479cc77740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f3545c0 0x56442f364380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.947 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.943+0000 7f4792000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f3545c0 0x56442f364380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.943+0000 7f4792000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f3545c0 0x56442f364380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59034/0 (socket says 172.21.15.18:59034) 2024-09-13T16:54:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.944+0000 7f4792000640 1 -- 172.21.15.18:0/256654268 learned_addr learned my addr 172.21.15.18:0/256654268 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.944+0000 7f479cc77740 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f3bf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.944+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f3bfb50 con 0x56442f3545c0 2024-09-13T16:54:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.944+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f3bfc90 con 0x56442f359650 2024-09-13T16:54:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.944+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56442f3bfdd0 con 0x56442f353c80 2024-09-13T16:54:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.944+0000 7f479cc77740 10 client.0 _ll_register_callbacks cb 0x7f478c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:54:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.947+0000 7f4793400640 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f3bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.947+0000 7f4792a00640 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f353c80 0x56442f363e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.947+0000 7f4793400640 1 -- 172.21.15.18:0/256654268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f353c80 msgr2=0x56442f363e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.947+0000 7f4793400640 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f353c80 0x56442f363e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.947+0000 7f4793400640 1 -- 172.21.15.18:0/256654268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f3545c0 msgr2=0x56442f364380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.947+0000 7f4793400640 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f3545c0 0x56442f364380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.947+0000 7f4793400640 1 -- 172.21.15.18:0/256654268 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c003a50 con 0x56442f359650 2024-09-13T16:54:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.958+0000 7f4793400640 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f3bf610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f478c004910 tx=0x7f478c003fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d953a57e1fe1017b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.971+0000 7f477d600640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:54:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.971+0000 7f477d600640 1 -- 172.21.15.18:0/256654268 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c004e10 con 0x56442f359650 2024-09-13T16:54:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.971+0000 7f477d600640 1 -- 172.21.15.18:0/256654268 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f478c0057a0 con 0x56442f359650 2024-09-13T16:54:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.978+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56442efaa300 con 0x56442f359650 2024-09-13T16:54:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.987+0000 7f477d600640 1 -- 172.21.15.18:0/256654268 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f478c005960 con 0x56442f359650 2024-09-13T16:54:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.998+0000 7f479cc77740 10 client.25541 fetch_fsmap learned FSMap version 28 2024-09-13T16:54:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.998+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56442f27c560 con 0x56442f359650 2024-09-13T16:54:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:15.999+0000 7f477d600640 1 -- 172.21.15.18:0/256654268 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56442efaa300 con 0x56442f359650 2024-09-13T16:54:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:16.002+0000 7f477d600640 1 -- 172.21.15.18:0/256654268 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f478c026800 con 0x56442f359650 2024-09-13T16:54:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:16.006+0000 7f479cc77740 10 client.25541 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:54:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:16.006+0000 7f479cc77740 10 client.25541 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:54:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:16.007+0000 7f479cc77740 20 client.25541 populate_metadata read hostname 'smithi018' 2024-09-13T16:54:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:16.007+0000 7f479cc77740 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56442f3c1630 0x56442f3c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:16.007+0000 7f479cc77740 4 client.25541 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:54:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:16.007+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56442efbb600 con 0x56442f3c1630 2024-09-13T16:54:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:16.007+0000 7f4792a00640 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56442f3c1630 0x56442f3c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:16.011+0000 7f4792a00640 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56442f3c1630 0x56442f3c3a50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7e8978a0ecb2be8 server_cookie=64ba4414eeb01ca3 in_seq=0 out_seq=0 2024-09-13T16:54:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:16.011+0000 7f477d600640 10 client.25541 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:16.082 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:15 smithi018 ceph-mon[30981]: pgmap v445: 129 pgs: 129 active+clean; 135 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 443 op/s 2024-09-13T16:54:16.218 INFO:tasks.workunit.client.0.smithi018.stdout: 33 270254 59 195495 203 96568 188 2024-09-13T16:54:16.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:15 smithi144 ceph-mon[35328]: pgmap v445: 129 pgs: 129 active+clean; 135 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 443 op/s 2024-09-13T16:54:16.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:15 smithi094 ceph-mon[35259]: pgmap v445: 129 pgs: 129 active+clean; 135 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 443 op/s 2024-09-13T16:54:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.736+0000 7f477d600640 1 -- 172.21.15.18:0/256654268 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56442efbb600 con 0x56442f3c1630 2024-09-13T16:54:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.736+0000 7f477d600640 10 client.25541 handle_command_reply: tid=0 2024-09-13T16:54:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.736+0000 7f479cc77740 1 client.25541 shutdown 2024-09-13T16:54:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 msgr2=0x56442f3bf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f3bf610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f478c004910 tx=0x7f478c003fd0 comp rx=0 tx=0).stop 2024-09-13T16:54:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 shutdown_connections 2024-09-13T16:54:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56442f3c1630 0x56442f3c3a50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56442f3545c0 0x56442f364380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f477d600640 0 client.25541 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56442f359650 0x56442f3bf610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 1 --2- 172.21.15.18:0/256654268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56442f353c80 0x56442f363e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 >> 172.21.15.18:0/256654268 conn(0x56442f34f2f0 msgr2=0x56442f35d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 shutdown_connections 2024-09-13T16:54:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 1 -- 172.21.15.18:0/256654268 wait complete. 2024-09-13T16:54:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.737+0000 7f479cc77740 20 client.25541 trim_cache size 0 max 16384 2024-09-13T16:54:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:54:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:54:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:54:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:54:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47780a1280 msgr2=0x7f47780a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47780a1280 0x7f47780a3740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4784006010 tx=0x7f4784004040 comp rx=0 tx=0).stop 2024-09-13T16:54:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4794071860 msgr2=0x7f4794113f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4794071860 0x7f4794113f10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f478000b3c0 tx=0x7f478000b880 comp rx=0 tx=0).stop 2024-09-13T16:54:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 shutdown_connections 2024-09-13T16:54:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47780a1280 0x7f47780a3740 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f479410bdc0 0x7f47941a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4794071860 0x7f4794113f10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 --2- 172.21.15.18:0/318475814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4794070f40 0x7f47941139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 >> 172.21.15.18:0/318475814 conn(0x7f479406cd10 msgr2=0x7f479406ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.738+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 shutdown_connections 2024-09-13T16:54:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:17.739+0000 7f4793e00640 1 -- 172.21.15.18:0/318475814 wait complete. 2024-09-13T16:54:18.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:17 smithi018 ceph-mon[30981]: pgmap v446: 129 pgs: 129 active+clean; 152 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.3 MiB/s wr, 503 op/s 2024-09-13T16:54:18.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:17 smithi144 ceph-mon[35328]: pgmap v446: 129 pgs: 129 active+clean; 152 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.3 MiB/s wr, 503 op/s 2024-09-13T16:54:18.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:17 smithi094 ceph-mon[35259]: pgmap v446: 129 pgs: 129 active+clean; 152 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.3 MiB/s wr, 503 op/s 2024-09-13T16:54:20.000 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:19 smithi018 ceph-mon[30981]: pgmap v447: 129 pgs: 129 active+clean; 156 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.2 MiB/s wr, 565 op/s 2024-09-13T16:54:20.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:19 smithi144 ceph-mon[35328]: pgmap v447: 129 pgs: 129 active+clean; 156 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.2 MiB/s wr, 565 op/s 2024-09-13T16:54:20.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:19 smithi094 ceph-mon[35259]: pgmap v447: 129 pgs: 129 active+clean; 156 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.2 MiB/s wr, 565 op/s 2024-09-13T16:54:21.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:21 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:54:21.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:21 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:54:22.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:21 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:54:22.747 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:22 smithi018 ceph-mon[30981]: pgmap v448: 129 pgs: 129 active+clean; 156 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.0 MiB/s wr, 474 op/s 2024-09-13T16:54:23.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:22 smithi144 ceph-mon[35328]: pgmap v448: 129 pgs: 129 active+clean; 156 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.0 MiB/s wr, 474 op/s 2024-09-13T16:54:23.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:22 smithi094 ceph-mon[35259]: pgmap v448: 129 pgs: 129 active+clean; 156 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.0 MiB/s wr, 474 op/s 2024-09-13T16:54:24.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:23 smithi018 ceph-mon[30981]: pgmap v449: 129 pgs: 129 active+clean; 156 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 366 op/s 2024-09-13T16:54:24.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:23 smithi144 ceph-mon[35328]: pgmap v449: 129 pgs: 129 active+clean; 156 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 366 op/s 2024-09-13T16:54:24.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:23 smithi094 ceph-mon[35259]: pgmap v449: 129 pgs: 129 active+clean; 156 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 366 op/s 2024-09-13T16:54:26.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:25 smithi018 ceph-mon[30981]: pgmap v450: 129 pgs: 129 active+clean; 160 MiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 365 op/s 2024-09-13T16:54:26.218 INFO:tasks.workunit.client.0.smithi018.stdout: 47 437984 758 317841 687 164112 750 2024-09-13T16:54:26.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:25 smithi144 ceph-mon[35328]: pgmap v450: 129 pgs: 129 active+clean; 160 MiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 365 op/s 2024-09-13T16:54:26.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:25 smithi094 ceph-mon[35259]: pgmap v450: 129 pgs: 129 active+clean; 160 MiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 365 op/s 2024-09-13T16:54:29.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:28 smithi018 ceph-mon[30981]: pgmap v451: 129 pgs: 129 active+clean; 160 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 260 op/s 2024-09-13T16:54:29.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:28 smithi144 ceph-mon[35328]: pgmap v451: 129 pgs: 129 active+clean; 160 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 260 op/s 2024-09-13T16:54:29.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:28 smithi094 ceph-mon[35259]: pgmap v451: 129 pgs: 129 active+clean; 160 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 260 op/s 2024-09-13T16:54:30.201 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:29 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:54:30.201 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:29 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:54:30.201 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:29 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:54:30.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:29 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:54:30.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:29 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:54:30.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:29 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:54:30.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:29 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:54:30.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:29 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:54:30.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:29 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:54:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.141+0000 7fc7dea00640 1 -- 172.21.15.18:0/3148940636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d8072f10 msgr2=0x7fc7d8073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.141+0000 7fc7dea00640 1 --2- 172.21.15.18:0/3148940636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d8072f10 0x7fc7d8073370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009900 tx=0x7fc7c402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.141+0000 7fc7dea00640 1 -- 172.21.15.18:0/3148940636 shutdown_connections 2024-09-13T16:54:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.141+0000 7fc7dea00640 1 --2- 172.21.15.18:0/3148940636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7d810c2e0 0x7fc7d810e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.142+0000 7fc7dea00640 1 --2- 172.21.15.18:0/3148940636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d8072f10 0x7fc7d8073370 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.142+0000 7fc7dea00640 1 --2- 172.21.15.18:0/3148940636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7d80744f0 0x7fc7d8072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.142+0000 7fc7dea00640 1 -- 172.21.15.18:0/3148940636 >> 172.21.15.18:0/3148940636 conn(0x7fc7d80fb4b0 msgr2=0x7fc7d80fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.142+0000 7fc7dea00640 1 -- 172.21.15.18:0/3148940636 shutdown_connections 2024-09-13T16:54:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.142+0000 7fc7dea00640 1 -- 172.21.15.18:0/3148940636 wait complete. 2024-09-13T16:54:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.143+0000 7fc7dea00640 1 Processor -- start 2024-09-13T16:54:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.143+0000 7fc7dea00640 1 -- start start 2024-09-13T16:54:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.144+0000 7fc7dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7d80744f0 0x7fc7d819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.144+0000 7fc7dea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d810c2e0 0x7fc7d819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.144+0000 7fc7dea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7d81a1ab0 0x7fc7d81a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.144+0000 7fc7dea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81a43e0 con 0x7fc7d81a1ab0 2024-09-13T16:54:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.144+0000 7fc7dea00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81a4550 con 0x7fc7d810c2e0 2024-09-13T16:54:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.144+0000 7fc7dea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81a4710 con 0x7fc7d80744f0 2024-09-13T16:54:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.144+0000 7fc7d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7d80744f0 0x7fc7d819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.144+0000 7fc7d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7d80744f0 0x7fc7d819c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:40422/0 (socket says 172.21.15.18:40422) 2024-09-13T16:54:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.144+0000 7fc7d7e00640 1 -- 172.21.15.18:0/3898523695 learned_addr learned my addr 172.21.15.18:0/3898523695 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.144+0000 7fc7d7400640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d810c2e0 0x7fc7d819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.145+0000 7fc7d7e00640 1 -- 172.21.15.18:0/3898523695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d810c2e0 msgr2=0x7fc7d819caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.145+0000 7fc7d7e00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d810c2e0 0x7fc7d819caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.145+0000 7fc7dca00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7d81a1ab0 0x7fc7d81a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.145+0000 7fc7d7e00640 1 -- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7d81a1ab0 msgr2=0x7fc7d81a3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.145+0000 7fc7d7e00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7d81a1ab0 0x7fc7d81a3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.145+0000 7fc7d7e00640 1 -- 172.21.15.18:0/3898523695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c4009560 con 0x7fc7d80744f0 2024-09-13T16:54:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.145+0000 7fc7dca00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7d81a1ab0 0x7fc7d81a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:54:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.146+0000 7fc7d7e00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7d80744f0 0x7fc7d819c5b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800e9f0 tx=0x7fc7c800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.146+0000 7fc7d4c00640 1 -- 172.21.15.18:0/3898523695 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8009700 con 0x7fc7d80744f0 2024-09-13T16:54:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.146+0000 7fc7d4c00640 1 -- 172.21.15.18:0/3898523695 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7c800cd80 con 0x7fc7d80744f0 2024-09-13T16:54:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.146+0000 7fc7d4c00640 1 -- 172.21.15.18:0/3898523695 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8018860 con 0x7fc7d80744f0 2024-09-13T16:54:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.146+0000 7fc7dea00640 1 -- 172.21.15.18:0/3898523695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d81a49f0 con 0x7fc7d80744f0 2024-09-13T16:54:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.147+0000 7fc7dea00640 1 -- 172.21.15.18:0/3898523695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d81a4e80 con 0x7fc7d80744f0 2024-09-13T16:54:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.151+0000 7fc7e180b740 1 Processor -- start 2024-09-13T16:54:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.151+0000 7fc7e180b740 1 -- start start 2024-09-13T16:54:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a103127a70 0x55a103127e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 0x55a10312ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a10312d440 0x55a10312f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7e180b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103033bb0 con 0x55a103127a70 2024-09-13T16:54:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7e180b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103091a70 con 0x55a1031283b0 2024-09-13T16:54:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7e180b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10308f200 con 0x55a10312d440 2024-09-13T16:54:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7dca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a103127a70 0x55a103127e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a10312d440 0x55a10312f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a10312d440 0x55a10312f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:40424/0 (socket says 172.21.15.18:40424) 2024-09-13T16:54:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7d7400640 1 -- 172.21.15.18:0/3180493781 learned_addr learned my addr 172.21.15.18:0/3180493781 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.152+0000 7fc7dca00640 1 --2- 172.21.15.18:0/3180493781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a103127a70 0x55a103127e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59002/0 (socket says 172.21.15.18:59002) 2024-09-13T16:54:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.153+0000 7fc7d4c00640 1 -- 172.21.15.18:0/3898523695 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc7c80189c0 con 0x7fc7d80744f0 2024-09-13T16:54:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.153+0000 7fc7d7e00640 1 --2- 172.21.15.18:0/3180493781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 0x55a10312ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.153+0000 7fc7dca00640 1 -- 172.21.15.18:0/3180493781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a10312d440 msgr2=0x55a10312f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.153+0000 7fc7dca00640 1 --2- 172.21.15.18:0/3180493781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a10312d440 0x55a10312f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.153+0000 7fc7dca00640 1 -- 172.21.15.18:0/3180493781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 msgr2=0x55a10312ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.153+0000 7fc7dca00640 1 --2- 172.21.15.18:0/3180493781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 0x55a10312ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.153+0000 7fc7dca00640 1 -- 172.21.15.18:0/3180493781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a10302c940 con 0x55a103127a70 2024-09-13T16:54:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.154+0000 7fc7d4c00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc7bc0a1110 0x7fc7bc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.154+0000 7fc7d4c00640 1 -- 172.21.15.18:0/3898523695 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fc7c8014070 con 0x7fc7d80744f0 2024-09-13T16:54:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.154+0000 7fc7dca00640 1 --2- 172.21.15.18:0/3180493781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a103127a70 0x55a103127e70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009de0 tx=0x7fc7d000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3384eb3de8cd7211 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.155+0000 7fc7d7e00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc7bc0a1110 0x7fc7bc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.156+0000 7fc7cd600640 1 -- 172.21.15.18:0/3180493781 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0004b20 con 0x55a103127a70 2024-09-13T16:54:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.156+0000 7fc7cd600640 1 -- 172.21.15.18:0/3180493781 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d0004c80 con 0x55a103127a70 2024-09-13T16:54:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.156+0000 7fc7cd600640 1 -- 172.21.15.18:0/3180493781 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0011860 con 0x55a103127a70 2024-09-13T16:54:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.157+0000 7fc7e180b740 1 -- 172.21.15.18:0/3180493781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a103127a70 msgr2=0x55a103127e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.157+0000 7fc7e180b740 1 --2- 172.21.15.18:0/3180493781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a103127a70 0x55a103127e70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009de0 tx=0x7fc7d000f730 comp rx=0 tx=0).stop 2024-09-13T16:54:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.157+0000 7fc7e180b740 1 -- 172.21.15.18:0/3180493781 shutdown_connections 2024-09-13T16:54:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.157+0000 7fc7e180b740 1 --2- 172.21.15.18:0/3180493781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a10312d440 0x55a10312f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.157+0000 7fc7e180b740 1 --2- 172.21.15.18:0/3180493781 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 0x55a10312ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.157+0000 7fc7e180b740 1 --2- 172.21.15.18:0/3180493781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a103127a70 0x55a103127e70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.157+0000 7fc7e180b740 1 -- 172.21.15.18:0/3180493781 >> 172.21.15.18:0/3180493781 conn(0x55a1031230e0 msgr2=0x55a1031234e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.157+0000 7fc7d7e00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc7bc0a1110 0x7fc7bc0a35d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc7c809a040 tx=0x7fc7c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.157+0000 7fc7e180b740 1 -- 172.21.15.18:0/3180493781 shutdown_connections 2024-09-13T16:54:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.158+0000 7fc7e180b740 1 -- 172.21.15.18:0/3180493781 wait complete. 2024-09-13T16:54:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.158+0000 7fc7e180b740 1 -- start start 2024-09-13T16:54:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.158+0000 7fc7e180b740 1 Processor -- start 2024-09-13T16:54:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.159+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a1031317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.159+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 0x55a103131d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.159+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a103138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.159+0000 7fc7e180b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10308aaf0 con 0x55a10312d440 2024-09-13T16:54:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.159+0000 7fc7e180b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103048f20 con 0x55a103127a70 2024-09-13T16:54:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.159+0000 7fc7e180b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103048bc0 con 0x55a1031283b0 2024-09-13T16:54:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.159+0000 7fc7e180b740 10 client.0 _ll_register_callbacks cb 0x55a10307aa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:54:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.159+0000 7fc7dca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a1031317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.159+0000 7fc7dca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a1031317c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:58964/0 (socket says 172.21.15.18:58964) 2024-09-13T16:54:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.159+0000 7fc7dca00640 1 -- 172.21.15.18:0/1284565704 learned_addr learned my addr 172.21.15.18:0/1284565704 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.160+0000 7fc7d7400640 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 0x55a103131d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.160+0000 7fc7dca00640 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a103138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.160+0000 7fc7d7400640 1 -- 172.21.15.18:0/1284565704 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 msgr2=0x55a1031317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.160+0000 7fc7d7400640 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a1031317c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.160+0000 7fc7d7400640 1 -- 172.21.15.18:0/1284565704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 msgr2=0x55a103138ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.160+0000 7fc7d7400640 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a103138ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.160+0000 7fc7d7400640 1 -- 172.21.15.18:0/1284565704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d0009a40 con 0x55a1031283b0 2024-09-13T16:54:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.160+0000 7fc7dca00640 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a103138ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:54:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.161+0000 7fc7d7400640 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 0x55a103131d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4006010 tx=0x7fc7c4004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=714817a2a2f0b8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.161+0000 7fc7c2000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:54:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.161+0000 7fc7c2000640 1 -- 172.21.15.18:0/1284565704 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4003b80 con 0x55a1031283b0 2024-09-13T16:54:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.161+0000 7fc7c2000640 1 -- 172.21.15.18:0/1284565704 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fc7c4003ce0 con 0x55a1031283b0 2024-09-13T16:54:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.161+0000 7fc7e180b740 1 -- 172.21.15.18:0/1284565704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1030b4c90 con 0x55a1031283b0 2024-09-13T16:54:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.163+0000 7fc7c2000640 1 -- 172.21.15.18:0/1284565704 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7c4003ea0 con 0x55a1031283b0 2024-09-13T16:54:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.163+0000 7fc7e180b740 10 client.25513 fetch_fsmap learned FSMap version 28 2024-09-13T16:54:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.163+0000 7fc7e180b740 1 -- 172.21.15.18:0/1284565704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a103089170 con 0x55a1031283b0 2024-09-13T16:54:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.164+0000 7fc7c2000640 1 -- 172.21.15.18:0/1284565704 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a1030b4c90 con 0x55a1031283b0 2024-09-13T16:54:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.164+0000 7fc7c2000640 1 -- 172.21.15.18:0/1284565704 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fc7c40467f0 con 0x55a1031283b0 2024-09-13T16:54:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.165+0000 7fc7e180b740 10 client.25513 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:54:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.165+0000 7fc7e180b740 10 client.25513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:54:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.165+0000 7fc7e180b740 20 client.25513 populate_metadata read hostname 'smithi018' 2024-09-13T16:54:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.165+0000 7fc7e180b740 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a10313d360 0x55a10313f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.165+0000 7fc7e180b740 4 client.25513 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:54:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.165+0000 7fc7e180b740 1 -- 172.21.15.18:0/1284565704 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a10307d7d0 con 0x55a10313d360 2024-09-13T16:54:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.165+0000 7fc7dca00640 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a10313d360 0x55a10313f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.166+0000 7fc7dca00640 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a10313d360 0x55a10313f780 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67b1d62dfa02e45 server_cookie=c96cf44bfa84e112 in_seq=0 out_seq=0 2024-09-13T16:54:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.166+0000 7fc7c2000640 10 client.25513 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7c2000640 1 -- 172.21.15.18:0/1284565704 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a10307d7d0 con 0x55a10313d360 2024-09-13T16:54:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7c2000640 10 client.25513 handle_command_reply: tid=0 2024-09-13T16:54:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7e180b740 1 client.25513 shutdown 2024-09-13T16:54:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7e180b740 1 -- 172.21.15.18:0/1284565704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 msgr2=0x55a103131d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7e180b740 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 0x55a103131d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4006010 tx=0x7fc7c4004600 comp rx=0 tx=0).stop 2024-09-13T16:54:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7e180b740 1 -- 172.21.15.18:0/1284565704 shutdown_connections 2024-09-13T16:54:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7e180b740 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a10313d360 0x55a10313f780 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7e180b740 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a103138ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7e180b740 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 0x55a103131d00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7e180b740 1 --2- 172.21.15.18:0/1284565704 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a1031317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7e180b740 1 -- 172.21.15.18:0/1284565704 >> 172.21.15.18:0/1284565704 conn(0x55a1031230e0 msgr2=0x55a1031248f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.168+0000 7fc7c2000640 0 client.25513 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.169+0000 7fc7e180b740 1 -- 172.21.15.18:0/1284565704 shutdown_connections 2024-09-13T16:54:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.169+0000 7fc7e180b740 1 -- 172.21.15.18:0/1284565704 wait complete. 2024-09-13T16:54:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.169+0000 7fc7e180b740 20 client.25513 trim_cache size 0 max 16384 2024-09-13T16:54:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7e180b740 1 Processor -- start 2024-09-13T16:54:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7e180b740 1 -- start start 2024-09-13T16:54:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a10311e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 0x55a103138c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a1031317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7e180b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a102df1e60 con 0x55a10312d440 2024-09-13T16:54:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7e180b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103131300 con 0x55a103127a70 2024-09-13T16:54:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7e180b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10311d730 con 0x55a1031283b0 2024-09-13T16:54:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7dca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a10311e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7dca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a10311e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:58974/0 (socket says 172.21.15.18:58974) 2024-09-13T16:54:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.188+0000 7fc7dca00640 1 -- 172.21.15.18:0/2352689596 learned_addr learned my addr 172.21.15.18:0/2352689596 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.189+0000 7fc7dca00640 1 --2- 172.21.15.18:0/2352689596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a1031317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.189+0000 7fc7d7400640 1 --2- 172.21.15.18:0/2352689596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 0x55a103138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.189+0000 7fc7dca00640 1 -- 172.21.15.18:0/2352689596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 msgr2=0x55a103138c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.189+0000 7fc7dca00640 1 --2- 172.21.15.18:0/2352689596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 0x55a103138c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.189+0000 7fc7dca00640 1 -- 172.21.15.18:0/2352689596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 msgr2=0x55a1031317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.189+0000 7fc7dca00640 1 --2- 172.21.15.18:0/2352689596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a1031317c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.189+0000 7fc7dca00640 1 -- 172.21.15.18:0/2352689596 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a10302b180 con 0x55a103127a70 2024-09-13T16:54:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.189+0000 7fc7d7400640 1 --2- 172.21.15.18:0/2352689596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 0x55a103138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:54:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.189+0000 7fc7dca00640 1 --2- 172.21.15.18:0/2352689596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a10311e590 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009d30 tx=0x7fc7d000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23beb2dceaa73133 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.190+0000 7fc7ce000640 1 -- 172.21.15.18:0/2352689596 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d001d040 con 0x55a103127a70 2024-09-13T16:54:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.190+0000 7fc7ce000640 1 -- 172.21.15.18:0/2352689596 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d0031070 con 0x55a103127a70 2024-09-13T16:54:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.190+0000 7fc7ce000640 1 -- 172.21.15.18:0/2352689596 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00052b0 con 0x55a103127a70 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 -- 172.21.15.18:0/2352689596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 msgr2=0x55a10311e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 --2- 172.21.15.18:0/2352689596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a10311e590 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009d30 tx=0x7fc7d000f730 comp rx=0 tx=0).stop 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 -- 172.21.15.18:0/2352689596 shutdown_connections 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 --2- 172.21.15.18:0/2352689596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a1031317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 --2- 172.21.15.18:0/2352689596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1031283b0 0x55a103138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 --2- 172.21.15.18:0/2352689596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a103127a70 0x55a10311e590 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 -- 172.21.15.18:0/2352689596 >> 172.21.15.18:0/2352689596 conn(0x55a1031230e0 msgr2=0x55a103129410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 -- 172.21.15.18:0/2352689596 shutdown_connections 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 -- 172.21.15.18:0/2352689596 wait complete. 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 -- start start 2024-09-13T16:54:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.191+0000 7fc7e180b740 1 Processor -- start 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103127a70 0x55a103138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 0x55a1031373d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7e180b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a103137a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7e180b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103138100 con 0x55a10312d440 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7e180b740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103138270 con 0x55a1031283b0 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7e180b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1031938a0 con 0x55a103127a70 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7e180b740 10 client.0 _ll_register_callbacks cb 0x7fc7d00095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7d7400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 0x55a1031373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7dca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103127a70 0x55a103138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7d7400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 0x55a1031373d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:58980/0 (socket says 172.21.15.18:58980) 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7d7400640 1 -- 172.21.15.18:0/307559801 learned_addr learned my addr 172.21.15.18:0/307559801 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.192+0000 7fc7dca00640 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a103137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7d7400640 1 -- 172.21.15.18:0/307559801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103127a70 msgr2=0x55a103138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7d7400640 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103127a70 0x55a103138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7d7400640 1 -- 172.21.15.18:0/307559801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 msgr2=0x55a103137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7d7400640 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a103137a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7d7400640 1 -- 172.21.15.18:0/307559801 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a10302c940 con 0x55a1031283b0 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7dca00640 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a103137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7d7400640 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 0x55a1031373d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc7c402a9e0 tx=0x7fc7c4004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d720d10e7a7a46d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7c2000640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7c2000640 1 -- 172.21.15.18:0/307559801 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4046680 con 0x55a1031283b0 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7c2000640 1 -- 172.21.15.18:0/307559801 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fc7c40467e0 con 0x55a1031283b0 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.193+0000 7fc7e180b740 1 -- 172.21.15.18:0/307559801 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7d0004c80 con 0x55a1031283b0 2024-09-13T16:54:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.194+0000 7fc7c2000640 1 -- 172.21.15.18:0/307559801 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7c4005d50 con 0x55a1031283b0 2024-09-13T16:54:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.194+0000 7fc7e180b740 10 client.25559 fetch_fsmap learned FSMap version 28 2024-09-13T16:54:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.194+0000 7fc7e180b740 1 -- 172.21.15.18:0/307559801 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a103050560 con 0x55a1031283b0 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.194+0000 7fc7c2000640 1 -- 172.21.15.18:0/307559801 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d0004c80 con 0x55a1031283b0 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.195+0000 7fc7c2000640 1 -- 172.21.15.18:0/307559801 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fc7c403ca20 con 0x55a1031283b0 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.195+0000 7fc7e180b740 10 client.25559 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.195+0000 7fc7e180b740 10 client.25559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.195+0000 7fc7e180b740 20 client.25559 populate_metadata read hostname 'smithi018' 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.195+0000 7fc7e180b740 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a1031950d0 0x55a1031974f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.195+0000 7fc7e180b740 4 client.25559 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.195+0000 7fc7e180b740 1 -- 172.21.15.18:0/307559801 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a102d7e300 con 0x55a1031950d0 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.195+0000 7fc7dca00640 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a1031950d0 0x55a1031974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.196+0000 7fc7c2000640 10 client.25559 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.196+0000 7fc7dca00640 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a1031950d0 0x55a1031974f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ace6d7631af4aa29 server_cookie=9ecb1664d32c969f in_seq=0 out_seq=0 2024-09-13T16:54:31.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:31 smithi094 ceph-mon[35259]: pgmap v452: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 257 op/s 2024-09-13T16:54:31.464 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:31 smithi018 ceph-mon[30981]: pgmap v452: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 257 op/s 2024-09-13T16:54:31.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:31 smithi144 ceph-mon[35328]: pgmap v452: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 257 op/s 2024-09-13T16:54:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.870+0000 7fc7c2000640 1 -- 172.21.15.18:0/307559801 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a102d7e300 con 0x55a1031950d0 2024-09-13T16:54:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.870+0000 7fc7c2000640 10 client.25559 handle_command_reply: tid=0 2024-09-13T16:54:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.871+0000 7fc7e180b740 1 client.25559 shutdown 2024-09-13T16:54:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.872+0000 7fc7e180b740 1 -- 172.21.15.18:0/307559801 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 msgr2=0x55a1031373d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.872+0000 7fc7e180b740 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 0x55a1031373d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc7c402a9e0 tx=0x7fc7c4004320 comp rx=0 tx=0).stop 2024-09-13T16:54:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.873+0000 7fc7e180b740 1 -- 172.21.15.18:0/307559801 shutdown_connections 2024-09-13T16:54:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.873+0000 7fc7e180b740 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a1031950d0 0x55a1031974f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.873+0000 7fc7e180b740 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a10312d440 0x55a103137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.873+0000 7fc7e180b740 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a1031283b0 0x55a1031373d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.873+0000 7fc7e180b740 1 --2- 172.21.15.18:0/307559801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103127a70 0x55a103138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.873+0000 7fc7e180b740 1 -- 172.21.15.18:0/307559801 >> 172.21.15.18:0/307559801 conn(0x55a1031230e0 msgr2=0x55a103131760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.874+0000 7fc7c2000640 0 client.25559 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.874+0000 7fc7e180b740 1 -- 172.21.15.18:0/307559801 shutdown_connections 2024-09-13T16:54:31.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.874+0000 7fc7e180b740 1 -- 172.21.15.18:0/307559801 wait complete. 2024-09-13T16:54:31.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.875+0000 7fc7e180b740 20 client.25559 trim_cache size 0 max 16384 2024-09-13T16:54:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:54:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:54:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:54:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:54:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.878+0000 7fc7dea00640 1 -- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc7bc0a1110 msgr2=0x7fc7bc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc7bc0a1110 0x7fc7bc0a35d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc7c809a040 tx=0x7fc7c8000bc0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 -- 172.21.15.18:0/3898523695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7d80744f0 msgr2=0x7fc7d819c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7d80744f0 0x7fc7d819c5b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800e9f0 tx=0x7fc7c800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 -- 172.21.15.18:0/3898523695 shutdown_connections 2024-09-13T16:54:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc7bc0a1110 0x7fc7bc0a35d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7d81a1ab0 0x7fc7d81a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7d810c2e0 0x7fc7d819caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 --2- 172.21.15.18:0/3898523695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7d80744f0 0x7fc7d819c5b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 -- 172.21.15.18:0/3898523695 >> 172.21.15.18:0/3898523695 conn(0x7fc7d80fb4b0 msgr2=0x7fc7d80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 -- 172.21.15.18:0/3898523695 shutdown_connections 2024-09-13T16:54:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:31.879+0000 7fc7dea00640 1 -- 172.21.15.18:0/3898523695 wait complete. 2024-09-13T16:54:33.468 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:33 smithi018 ceph-mon[30981]: pgmap v453: 129 pgs: 129 active+clean; 192 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 287 op/s 2024-09-13T16:54:33.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:33 smithi144 ceph-mon[35328]: pgmap v453: 129 pgs: 129 active+clean; 192 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 287 op/s 2024-09-13T16:54:33.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:33 smithi094 ceph-mon[35259]: pgmap v453: 129 pgs: 129 active+clean; 192 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 287 op/s 2024-09-13T16:54:35.474 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:35 smithi018 ceph-mon[30981]: pgmap v454: 129 pgs: 129 active+clean; 197 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 294 op/s 2024-09-13T16:54:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:35 smithi144 ceph-mon[35328]: pgmap v454: 129 pgs: 129 active+clean; 197 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 294 op/s 2024-09-13T16:54:35.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:35 smithi094 ceph-mon[35259]: pgmap v454: 129 pgs: 129 active+clean; 197 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 294 op/s 2024-09-13T16:54:36.218 INFO:tasks.workunit.client.0.smithi018.stdout: 55 409711 565 283628 372 134645 458 2024-09-13T16:54:37.471 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:37 smithi018 ceph-mon[30981]: pgmap v455: 129 pgs: 129 active+clean; 204 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 492 op/s 2024-09-13T16:54:37.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:37 smithi144 ceph-mon[35328]: pgmap v455: 129 pgs: 129 active+clean; 204 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 492 op/s 2024-09-13T16:54:37.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:37 smithi094 ceph-mon[35259]: pgmap v455: 129 pgs: 129 active+clean; 204 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 492 op/s 2024-09-13T16:54:39.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:39 smithi018 ceph-mon[30981]: pgmap v456: 129 pgs: 129 active+clean; 216 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 574 op/s 2024-09-13T16:54:39.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:39 smithi144 ceph-mon[35328]: pgmap v456: 129 pgs: 129 active+clean; 216 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 574 op/s 2024-09-13T16:54:39.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:39 smithi094 ceph-mon[35259]: pgmap v456: 129 pgs: 129 active+clean; 216 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 574 op/s 2024-09-13T16:54:41.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:41 smithi018 ceph-mon[30981]: pgmap v457: 129 pgs: 129 active+clean; 225 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.9 MiB/s wr, 615 op/s 2024-09-13T16:54:41.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:41 smithi144 ceph-mon[35328]: pgmap v457: 129 pgs: 129 active+clean; 225 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.9 MiB/s wr, 615 op/s 2024-09-13T16:54:41.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:41 smithi094 ceph-mon[35259]: pgmap v457: 129 pgs: 129 active+clean; 225 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.9 MiB/s wr, 615 op/s 2024-09-13T16:54:43.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:43 smithi018 ceph-mon[30981]: pgmap v458: 129 pgs: 129 active+clean; 235 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.7 MiB/s wr, 593 op/s 2024-09-13T16:54:43.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:43 smithi144 ceph-mon[35328]: pgmap v458: 129 pgs: 129 active+clean; 235 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.7 MiB/s wr, 593 op/s 2024-09-13T16:54:43.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:43 smithi094 ceph-mon[35259]: pgmap v458: 129 pgs: 129 active+clean; 235 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.7 MiB/s wr, 593 op/s 2024-09-13T16:54:45.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:45 smithi018 ceph-mon[30981]: pgmap v459: 129 pgs: 129 active+clean; 235 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 481 op/s 2024-09-13T16:54:45.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:45 smithi144 ceph-mon[35328]: pgmap v459: 129 pgs: 129 active+clean; 235 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 481 op/s 2024-09-13T16:54:45.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:45 smithi094 ceph-mon[35259]: pgmap v459: 129 pgs: 129 active+clean; 235 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 481 op/s 2024-09-13T16:54:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.667+0000 7f5f74c00640 1 -- 172.21.15.18:0/1050431157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f680a6030 msgr2=0x7f5f680aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.667+0000 7f5f74c00640 1 --2- 172.21.15.18:0/1050431157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f680a6030 0x7f5f680aa8d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5f7004e4e0 tx=0x7f5f7008c820 comp rx=0 tx=0).stop 2024-09-13T16:54:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.670+0000 7f5f74c00640 1 -- 172.21.15.18:0/1050431157 shutdown_connections 2024-09-13T16:54:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.670+0000 7f5f74c00640 1 --2- 172.21.15.18:0/1050431157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f680a6030 0x7f5f680aa8d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.670+0000 7f5f74c00640 1 --2- 172.21.15.18:0/1050431157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f680a5670 0x7f5f680a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.670+0000 7f5f74c00640 1 --2- 172.21.15.18:0/1050431157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f680a4540 0x7f5f680a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.670+0000 7f5f74c00640 1 -- 172.21.15.18:0/1050431157 >> 172.21.15.18:0/1050431157 conn(0x7f5f6809fba0 msgr2=0x7f5f680a2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.670+0000 7f5f74c00640 1 -- 172.21.15.18:0/1050431157 shutdown_connections 2024-09-13T16:54:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.670+0000 7f5f74c00640 1 -- 172.21.15.18:0/1050431157 wait complete. 2024-09-13T16:54:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.671+0000 7f5f74c00640 1 Processor -- start 2024-09-13T16:54:45.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.673+0000 7f5f74c00640 1 -- start start 2024-09-13T16:54:45.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.673+0000 7f5f74c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f680a4540 0x7f5f6813a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.673+0000 7f5f74c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f680a5670 0x7f5f6813a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.674+0000 7f5f74c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f680a6030 0x7f5f68141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.674+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f680a5670 0x7f5f6813a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.674+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f680a5670 0x7f5f6813a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:40758/0 (socket says 172.21.15.18:40758) 2024-09-13T16:54:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.674+0000 7f5f6d400640 1 -- 172.21.15.18:0/3209643460 learned_addr learned my addr 172.21.15.18:0/3209643460 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.674+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68141eb0 con 0x7f5f680a4540 2024-09-13T16:54:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.674+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68142020 con 0x7f5f680a5670 2024-09-13T16:54:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.675+0000 7f5f6e800640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f680a6030 0x7f5f68141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.674+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681421e0 con 0x7f5f680a6030 2024-09-13T16:54:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.676+0000 7f5f6de00640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f680a4540 0x7f5f6813a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:45.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.679+0000 7f5f6d400640 1 -- 172.21.15.18:0/3209643460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f680a6030 msgr2=0x7f5f68141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.680+0000 7f5f6d400640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f680a6030 0x7f5f68141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.680+0000 7f5f6d400640 1 -- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f680a4540 msgr2=0x7f5f6813a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.681+0000 7f5f6d400640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f680a4540 0x7f5f6813a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.681+0000 7f5f6d400640 1 -- 172.21.15.18:0/3209643460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7004f100 con 0x7f5f680a5670 2024-09-13T16:54:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.681+0000 7f5f6de00640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f680a4540 0x7f5f6813a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:54:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.682+0000 7f5f6d400640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f680a5670 0x7f5f6813a900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c01ea00 tx=0x7f5f5c01eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:45.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.682+0000 7f5f66a00640 1 -- 172.21.15.18:0/3209643460 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c01ab00 con 0x7f5f680a5670 2024-09-13T16:54:45.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.682+0000 7f5f66a00640 1 -- 172.21.15.18:0/3209643460 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f5c01ac60 con 0x7f5f680a5670 2024-09-13T16:54:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.684+0000 7f5f66a00640 1 -- 172.21.15.18:0/3209643460 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c020700 con 0x7f5f680a5670 2024-09-13T16:54:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.684+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f681424c0 con 0x7f5f680a5670 2024-09-13T16:54:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.684+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f68142950 con 0x7f5f680a5670 2024-09-13T16:54:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.694+0000 7f5f77a68740 1 Processor -- start 2024-09-13T16:54:45.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.697+0000 7f5f66a00640 1 -- 172.21.15.18:0/3209643460 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5f5c020860 con 0x7f5f680a5670 2024-09-13T16:54:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.700+0000 7f5f77a68740 1 -- start start 2024-09-13T16:54:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.703+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8ae8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.703+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8aed080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.703+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8aefb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.703+0000 7f5f77a68740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace89f3bb0 con 0x55ace8ae85c0 2024-09-13T16:54:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.703+0000 7f5f77a68740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace8a51a70 con 0x55ace8aed650 2024-09-13T16:54:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.703+0000 7f5f77a68740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace8a4f200 con 0x55ace8ae7c80 2024-09-13T16:54:45.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.704+0000 7f5f6e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8ae8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:45.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.704+0000 7f5f66a00640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5f540a10b0 0x7f5f540a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.704+0000 7f5f66a00640 1 -- 172.21.15.18:0/3209643460 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f5f5c0dd730 con 0x7f5f680a5670 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.704+0000 7f5f6e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8ae8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:52992/0 (socket says 172.21.15.18:52992) 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.704+0000 7f5f6e800640 1 -- 172.21.15.18:0/2774875880 learned_addr learned my addr 172.21.15.18:0/2774875880 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.705+0000 7f5f6e800640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5f540a10b0 0x7f5f540a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.707+0000 7f5f6de00640 1 --2- 172.21.15.18:0/2774875880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8aed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.707+0000 7f5f6de00640 1 -- 172.21.15.18:0/2774875880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 msgr2=0x55ace8ae8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.708+0000 7f5f6de00640 1 --2- 172.21.15.18:0/2774875880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8ae8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.708+0000 7f5f6de00640 1 -- 172.21.15.18:0/2774875880 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 msgr2=0x55ace8aefb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.708+0000 7f5f6de00640 1 --2- 172.21.15.18:0/2774875880 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8aefb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.708+0000 7f5f6de00640 1 -- 172.21.15.18:0/2774875880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ace89ec940 con 0x55ace8ae85c0 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.708+0000 7f5f6e800640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5f540a10b0 0x7f5f540a3570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5f70063cd0 tx=0x7f5f70065df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.709+0000 7f5f6de00640 1 --2- 172.21.15.18:0/2774875880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8aed080 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000bcd0 tx=0x7f5f6000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911e3bb36b4c7cc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.710+0000 7f5f5b400640 1 -- 172.21.15.18:0/2774875880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6001a460 con 0x55ace8ae85c0 2024-09-13T16:54:45.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.710+0000 7f5f5b400640 1 -- 172.21.15.18:0/2774875880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f6001aa80 con 0x55ace8ae85c0 2024-09-13T16:54:45.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.710+0000 7f5f5b400640 1 -- 172.21.15.18:0/2774875880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60011a30 con 0x55ace8ae85c0 2024-09-13T16:54:45.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.711+0000 7f5f77a68740 1 -- 172.21.15.18:0/2774875880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 msgr2=0x55ace8aed080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:45.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.711+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2774875880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8aed080 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000bcd0 tx=0x7f5f6000f730 comp rx=0 tx=0).stop 2024-09-13T16:54:45.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.714+0000 7f5f77a68740 1 -- 172.21.15.18:0/2774875880 shutdown_connections 2024-09-13T16:54:45.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.714+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2774875880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8aed080 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.714+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2774875880 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8aefb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.714+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2774875880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8ae8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.714+0000 7f5f77a68740 1 -- 172.21.15.18:0/2774875880 >> 172.21.15.18:0/2774875880 conn(0x55ace8ae32f0 msgr2=0x55ace8ae36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:45.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.715+0000 7f5f77a68740 1 -- 172.21.15.18:0/2774875880 shutdown_connections 2024-09-13T16:54:45.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.715+0000 7f5f77a68740 1 -- 172.21.15.18:0/2774875880 wait complete. 2024-09-13T16:54:45.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.715+0000 7f5f77a68740 1 -- start start 2024-09-13T16:54:45.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.718+0000 7f5f77a68740 1 Processor -- start 2024-09-13T16:54:45.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.718+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8af1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.719+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8af1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.719+0000 7f5f6de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8af1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.719+0000 7f5f6de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8af1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:52998/0 (socket says 172.21.15.18:52998) 2024-09-13T16:54:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.720+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8af1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.720+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8af1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55752/0 (socket says 172.21.15.18:55752) 2024-09-13T16:54:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.720+0000 7f5f6de00640 1 -- 172.21.15.18:0/2200196919 learned_addr learned my addr 172.21.15.18:0/2200196919 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.720+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.720+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace8a4aaf0 con 0x55ace8ae85c0 2024-09-13T16:54:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.724+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace8a08f20 con 0x55ace8aed650 2024-09-13T16:54:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.724+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace8a08bc0 con 0x55ace8ae7c80 2024-09-13T16:54:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.725+0000 7f5f77a68740 10 client.0 _ll_register_callbacks cb 0x55ace8a3aa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:54:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.722+0000 7f5f6e800640 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.725+0000 7f5f6e800640 1 -- 172.21.15.18:0/2200196919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 msgr2=0x55ace8af1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.725+0000 7f5f6e800640 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8af1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.725+0000 7f5f6e800640 1 -- 172.21.15.18:0/2200196919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 msgr2=0x55ace8af1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.725+0000 7f5f6e800640 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8af1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.725+0000 7f5f6e800640 1 -- 172.21.15.18:0/2200196919 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6000b8e0 con 0x55ace8aed650 2024-09-13T16:54:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.726+0000 7f5f6e800640 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af8f30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5f700660d0 tx=0x7f5f70066570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7fa5a56aa9c2097 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.726+0000 7f5f4fe00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:54:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.728+0000 7f5f4fe00640 1 -- 172.21.15.18:0/2200196919 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70060af0 con 0x55ace8aed650 2024-09-13T16:54:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.728+0000 7f5f4fe00640 1 -- 172.21.15.18:0/2200196919 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f5f70060c50 con 0x55ace8aed650 2024-09-13T16:54:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.728+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ace8a74c90 con 0x55ace8aed650 2024-09-13T16:54:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.729+0000 7f5f4fe00640 1 -- 172.21.15.18:0/2200196919 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f70060e10 con 0x55ace8aed650 2024-09-13T16:54:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.729+0000 7f5f77a68740 10 client.25568 fetch_fsmap learned FSMap version 28 2024-09-13T16:54:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.729+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ace8a49170 con 0x55ace8aed650 2024-09-13T16:54:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.729+0000 7f5f4fe00640 1 -- 172.21.15.18:0/2200196919 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ace8a74c90 con 0x55ace8aed650 2024-09-13T16:54:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.730+0000 7f5f4fe00640 1 -- 172.21.15.18:0/2200196919 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f5f70061500 con 0x55ace8aed650 2024-09-13T16:54:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.730+0000 7f5f77a68740 10 client.25568 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:54:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.730+0000 7f5f77a68740 10 client.25568 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:54:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.730+0000 7f5f77a68740 20 client.25568 populate_metadata read hostname 'smithi018' 2024-09-13T16:54:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.731+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ace8afd5f0 0x55ace8affa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.731+0000 7f5f77a68740 4 client.25568 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:54:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.731+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ace8a3d7d0 con 0x55ace8afd5f0 2024-09-13T16:54:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.731+0000 7f5f6de00640 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ace8afd5f0 0x55ace8affa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.732+0000 7f5f6de00640 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ace8afd5f0 0x55ace8affa10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a888df7841edbac0 server_cookie=79e3e228589bde7b in_seq=0 out_seq=0 2024-09-13T16:54:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.732+0000 7f5f4fe00640 10 client.25568 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.733+0000 7f5f4fe00640 1 -- 172.21.15.18:0/2200196919 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ace8a3d7d0 con 0x55ace8afd5f0 2024-09-13T16:54:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.733+0000 7f5f4fe00640 10 client.25568 handle_command_reply: tid=0 2024-09-13T16:54:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.734+0000 7f5f77a68740 1 client.25568 shutdown 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.734+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 msgr2=0x55ace8af8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.734+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af8f30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5f700660d0 tx=0x7f5f70066570 comp rx=0 tx=0).stop 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.734+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 shutdown_connections 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.734+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ace8afd5f0 0x55ace8affa10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.734+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8af1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.734+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af8f30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.734+0000 7f5f77a68740 1 --2- 172.21.15.18:0/2200196919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8af1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.734+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 >> 172.21.15.18:0/2200196919 conn(0x55ace8ae32f0 msgr2=0x55ace8ae4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.734+0000 7f5f4fe00640 0 client.25568 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.735+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 shutdown_connections 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.735+0000 7f5f77a68740 1 -- 172.21.15.18:0/2200196919 wait complete. 2024-09-13T16:54:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.735+0000 7f5f77a68740 20 client.25568 trim_cache size 0 max 16384 2024-09-13T16:54:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:45.979+0000 7f5f77a68740 1 Processor -- start 2024-09-13T16:54:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.011+0000 7f5f77a68740 1 -- start start 2024-09-13T16:54:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.011+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8b04370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.011+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8af8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.011+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.011+0000 7f5f77a68740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace87b1e60 con 0x55ace8ae85c0 2024-09-13T16:54:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.011+0000 7f5f77a68740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace8a74cc0 con 0x55ace8aed650 2024-09-13T16:54:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.011+0000 7f5f77a68740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace8af2ba0 con 0x55ace8ae7c80 2024-09-13T16:54:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.012+0000 7f5f6e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.012+0000 7f5f6e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:40780/0 (socket says 172.21.15.18:40780) 2024-09-13T16:54:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.012+0000 7f5f6e800640 1 -- 172.21.15.18:0/3354059967 learned_addr learned my addr 172.21.15.18:0/3354059967 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.016+0000 7f5f6e800640 1 -- 172.21.15.18:0/3354059967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 msgr2=0x55ace8b04370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:54:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.016+0000 7f5f6e800640 1 --2- 172.21.15.18:0/3354059967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8b04370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.016+0000 7f5f6e800640 1 -- 172.21.15.18:0/3354059967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 msgr2=0x55ace8af8ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:54:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.016+0000 7f5f6e800640 1 --2- 172.21.15.18:0/3354059967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8af8ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.016+0000 7f5f6e800640 1 -- 172.21.15.18:0/3354059967 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ace89eb180 con 0x55ace8aed650 2024-09-13T16:54:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.022+0000 7f5f6e800640 1 --2- 172.21.15.18:0/3354059967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af1aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f70063970 tx=0x7f5f7008c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=515a2ffe2aa23377 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.027+0000 7f5f5be00640 1 -- 172.21.15.18:0/3354059967 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f700ae4e0 con 0x55ace8aed650 2024-09-13T16:54:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.028+0000 7f5f5be00640 1 -- 172.21.15.18:0/3354059967 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f700c5070 con 0x55ace8aed650 2024-09-13T16:54:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.028+0000 7f5f5be00640 1 -- 172.21.15.18:0/3354059967 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f700aecc0 con 0x55ace8aed650 2024-09-13T16:54:46.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.031+0000 7f5f77a68740 1 -- 172.21.15.18:0/3354059967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 msgr2=0x55ace8af1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:46.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.031+0000 7f5f77a68740 1 --2- 172.21.15.18:0/3354059967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af1aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f70063970 tx=0x7f5f7008c820 comp rx=0 tx=0).stop 2024-09-13T16:54:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.052+0000 7f5f77a68740 1 -- 172.21.15.18:0/3354059967 shutdown_connections 2024-09-13T16:54:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.052+0000 7f5f77a68740 1 --2- 172.21.15.18:0/3354059967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8ae85c0 0x55ace8af8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.052+0000 7f5f77a68740 1 --2- 172.21.15.18:0/3354059967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8aed650 0x55ace8af1aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.052+0000 7f5f77a68740 1 --2- 172.21.15.18:0/3354059967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8b04370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.052+0000 7f5f77a68740 1 -- 172.21.15.18:0/3354059967 >> 172.21.15.18:0/3354059967 conn(0x55ace8ae32f0 msgr2=0x55ace8aff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.054+0000 7f5f77a68740 1 -- 172.21.15.18:0/3354059967 shutdown_connections 2024-09-13T16:54:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.058+0000 7f5f77a68740 1 -- 172.21.15.18:0/3354059967 wait complete. 2024-09-13T16:54:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.059+0000 7f5f77a68740 1 -- start start 2024-09-13T16:54:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.059+0000 7f5f77a68740 1 Processor -- start 2024-09-13T16:54:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.064+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8af6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.072+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8ae85c0 0x55ace8af6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.072+0000 7f5f77a68740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8aed650 0x55ace8af7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.072+0000 7f5f6de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8af6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.072+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8ae85c0 0x55ace8af6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.072+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8ae85c0 0x55ace8af6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:40784/0 (socket says 172.21.15.18:40784) 2024-09-13T16:54:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.072+0000 7f5f6de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8af6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:53010/0 (socket says 172.21.15.18:53010) 2024-09-13T16:54:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.073+0000 7f5f6e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8aed650 0x55ace8af7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.073+0000 7f5f6e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8aed650 0x55ace8af7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55768/0 (socket says 172.21.15.18:55768) 2024-09-13T16:54:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.074+0000 7f5f6d400640 1 -- 172.21.15.18:0/8527228 learned_addr learned my addr 172.21.15.18:0/8527228 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:54:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.074+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace8af8490 con 0x55ace8aed650 2024-09-13T16:54:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.077+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace8af8600 con 0x55ace8ae85c0 2024-09-13T16:54:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.077+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace8af87c0 con 0x55ace8ae7c80 2024-09-13T16:54:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.077+0000 7f5f77a68740 10 client.0 _ll_register_callbacks cb 0x7f5f6000b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:54:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.090+0000 7f5f6d400640 1 -- 172.21.15.18:0/8527228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 msgr2=0x55ace8af6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.090+0000 7f5f6d400640 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8af6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.090+0000 7f5f6d400640 1 -- 172.21.15.18:0/8527228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8aed650 msgr2=0x55ace8af7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:54:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.090+0000 7f5f6d400640 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8aed650 0x55ace8af7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.090+0000 7f5f6d400640 1 -- 172.21.15.18:0/8527228 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ace8a49170 con 0x55ace8ae85c0 2024-09-13T16:54:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.096+0000 7f5f6e800640 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8aed650 0x55ace8af7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:54:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.096+0000 7f5f6d400640 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8ae85c0 0x55ace8af6fe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0aa750 tx=0x7f5f5c0aaec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c02c278a27b227 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:54:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.101+0000 7f5f4fe00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:54:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.101+0000 7f5f4fe00640 1 -- 172.21.15.18:0/8527228 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0ae5f0 con 0x55ace8ae85c0 2024-09-13T16:54:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.101+0000 7f5f4fe00640 1 -- 172.21.15.18:0/8527228 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f5f5c0b2c40 con 0x55ace8ae85c0 2024-09-13T16:54:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.120+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f6001aa80 con 0x55ace8ae85c0 2024-09-13T16:54:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.125+0000 7f5f4fe00640 1 -- 172.21.15.18:0/8527228 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f5c0dd440 con 0x55ace8ae85c0 2024-09-13T16:54:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.125+0000 7f5f77a68740 10 client.25574 fetch_fsmap learned FSMap version 28 2024-09-13T16:54:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.125+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ace8a10560 con 0x55ace8ae85c0 2024-09-13T16:54:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.127+0000 7f5f4fe00640 1 -- 172.21.15.18:0/8527228 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f5c0b2e90 con 0x55ace8ae85c0 2024-09-13T16:54:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.127+0000 7f5f4fe00640 1 -- 172.21.15.18:0/8527228 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f5f5c0a65b0 con 0x55ace8ae85c0 2024-09-13T16:54:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.128+0000 7f5f77a68740 10 client.25574 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:54:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.128+0000 7f5f77a68740 10 client.25574 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:54:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.128+0000 7f5f77a68740 20 client.25574 populate_metadata read hostname 'smithi018' 2024-09-13T16:54:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.128+0000 7f5f77a68740 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ace8b54860 0x55ace8b56c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:54:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.128+0000 7f5f77a68740 4 client.25574 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:54:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.128+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ace873e300 con 0x55ace8b54860 2024-09-13T16:54:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.131+0000 7f5f6de00640 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ace8b54860 0x55ace8b56c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:54:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.137+0000 7f5f6de00640 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ace8b54860 0x55ace8b56c80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53293efca528c663 server_cookie=d6f66c733cbde0e0 in_seq=0 out_seq=0 2024-09-13T16:54:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.138+0000 7f5f4fe00640 10 client.25574 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:46.257 INFO:tasks.workunit.client.0.smithi018.stdout: 67 477436 626 327480 710 155025 464 2024-09-13T16:54:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.716+0000 7f5f4fe00640 1 -- 172.21.15.18:0/8527228 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ace873e300 con 0x55ace8b54860 2024-09-13T16:54:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.716+0000 7f5f4fe00640 10 client.25574 handle_command_reply: tid=0 2024-09-13T16:54:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.720+0000 7f5f77a68740 1 client.25574 shutdown 2024-09-13T16:54:46.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.773+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8ae85c0 msgr2=0x55ace8af6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:46.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.773+0000 7f5f77a68740 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8ae85c0 0x55ace8af6fe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0aa750 tx=0x7f5f5c0aaec0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.789+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 shutdown_connections 2024-09-13T16:54:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.789+0000 7f5f77a68740 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ace8b54860 0x55ace8b56c80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.789+0000 7f5f77a68740 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ace8aed650 0x55ace8af7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.789+0000 7f5f77a68740 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ace8ae85c0 0x55ace8af6fe0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.789+0000 7f5f77a68740 1 --2- 172.21.15.18:0/8527228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ace8ae7c80 0x55ace8af6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.789+0000 7f5f4fe00640 0 client.25574 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:54:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.789+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 >> 172.21.15.18:0/8527228 conn(0x55ace8ae32f0 msgr2=0x55ace8ae96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.790+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 shutdown_connections 2024-09-13T16:54:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.794+0000 7f5f77a68740 1 -- 172.21.15.18:0/8527228 wait complete. 2024-09-13T16:54:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.821+0000 7f5f77a68740 20 client.25574 trim_cache size 0 max 16384 2024-09-13T16:54:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:54:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:54:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:54:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:54:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.854+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5f540a10b0 msgr2=0x7f5f540a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.854+0000 7f5f74c00640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5f540a10b0 0x7f5f540a3570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5f70063cd0 tx=0x7f5f70065df0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.854+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f680a5670 msgr2=0x7f5f6813a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:54:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.854+0000 7f5f74c00640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f680a5670 0x7f5f6813a900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c01ea00 tx=0x7f5f5c01eec0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.855+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 shutdown_connections 2024-09-13T16:54:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.855+0000 7f5f74c00640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f680a6030 0x7f5f68141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.855+0000 7f5f74c00640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f680a5670 0x7f5f6813a900 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.855+0000 7f5f74c00640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f5f540a10b0 0x7f5f540a3570 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.855+0000 7f5f74c00640 1 --2- 172.21.15.18:0/3209643460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f680a4540 0x7f5f6813a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:54:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.855+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 >> 172.21.15.18:0/3209643460 conn(0x7f5f6809fba0 msgr2=0x7f5f680a8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:54:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.859+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 shutdown_connections 2024-09-13T16:54:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:54:46.859+0000 7f5f74c00640 1 -- 172.21.15.18:0/3209643460 wait complete. 2024-09-13T16:54:47.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:47 smithi144 ceph-mon[35328]: pgmap v460: 129 pgs: 129 active+clean; 237 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 459 op/s 2024-09-13T16:54:47.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:47 smithi094 ceph-mon[35259]: pgmap v460: 129 pgs: 129 active+clean; 237 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 459 op/s 2024-09-13T16:54:47.713 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:47 smithi018 ceph-mon[30981]: pgmap v460: 129 pgs: 129 active+clean; 237 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 459 op/s 2024-09-13T16:54:49.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:49 smithi144 ceph-mon[35328]: pgmap v461: 129 pgs: 129 active+clean; 237 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2024-09-13T16:54:49.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:49 smithi094 ceph-mon[35259]: pgmap v461: 129 pgs: 129 active+clean; 237 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2024-09-13T16:54:49.715 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:49 smithi018 ceph-mon[30981]: pgmap v461: 129 pgs: 129 active+clean; 237 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2024-09-13T16:54:51.468 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:51 smithi018 ceph-mon[30981]: pgmap v462: 129 pgs: 129 active+clean; 237 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 196 op/s 2024-09-13T16:54:51.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:51 smithi144 ceph-mon[35328]: pgmap v462: 129 pgs: 129 active+clean; 237 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 196 op/s 2024-09-13T16:54:51.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:51 smithi094 ceph-mon[35259]: pgmap v462: 129 pgs: 129 active+clean; 237 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 196 op/s 2024-09-13T16:54:53.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:53 smithi144 ceph-mon[35328]: pgmap v463: 129 pgs: 129 active+clean; 251 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 253 op/s 2024-09-13T16:54:53.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:53 smithi094 ceph-mon[35259]: pgmap v463: 129 pgs: 129 active+clean; 251 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 253 op/s 2024-09-13T16:54:53.715 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:53 smithi018 ceph-mon[30981]: pgmap v463: 129 pgs: 129 active+clean; 251 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 253 op/s 2024-09-13T16:54:55.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:55 smithi144 ceph-mon[35328]: pgmap v464: 129 pgs: 129 active+clean; 256 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 230 op/s 2024-09-13T16:54:55.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:55 smithi094 ceph-mon[35259]: pgmap v464: 129 pgs: 129 active+clean; 256 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 230 op/s 2024-09-13T16:54:55.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:55 smithi018 ceph-mon[30981]: pgmap v464: 129 pgs: 129 active+clean; 256 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 230 op/s 2024-09-13T16:54:56.255 INFO:tasks.workunit.client.0.smithi018.stdout: 82 501977 733 346876 710 148400 214 2024-09-13T16:54:57.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:57 smithi144 ceph-mon[35328]: pgmap v465: 129 pgs: 129 active+clean; 275 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 312 op/s 2024-09-13T16:54:57.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:57 smithi094 ceph-mon[35259]: pgmap v465: 129 pgs: 129 active+clean; 275 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 312 op/s 2024-09-13T16:54:57.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:57 smithi018 ceph-mon[30981]: pgmap v465: 129 pgs: 129 active+clean; 275 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 312 op/s 2024-09-13T16:54:59.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:54:59 smithi018 ceph-mon[30981]: pgmap v466: 129 pgs: 129 active+clean; 288 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 341 op/s 2024-09-13T16:54:59.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:54:59 smithi144 ceph-mon[35328]: pgmap v466: 129 pgs: 129 active+clean; 288 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 341 op/s 2024-09-13T16:54:59.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:54:59 smithi094 ceph-mon[35259]: pgmap v466: 129 pgs: 129 active+clean; 288 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 341 op/s 2024-09-13T16:55:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.681+0000 7f8924c00640 1 -- 172.21.15.18:0/4226780685 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8920103a30 msgr2=0x7f892010a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.681+0000 7f8924c00640 1 --2- 172.21.15.18:0/4226780685 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8920103a30 0x7f892010a350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8918009be0 tx=0x7f891802a6b0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.681+0000 7f8924c00640 1 -- 172.21.15.18:0/4226780685 shutdown_connections 2024-09-13T16:55:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.681+0000 7f8924c00640 1 --2- 172.21.15.18:0/4226780685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8920103070 0x7f89201034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.681+0000 7f8924c00640 1 --2- 172.21.15.18:0/4226780685 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8920103a30 0x7f892010a350 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.681+0000 7f8924c00640 1 --2- 172.21.15.18:0/4226780685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920101f20 0x7f8920102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.681+0000 7f8924c00640 1 -- 172.21.15.18:0/4226780685 >> 172.21.15.18:0/4226780685 conn(0x7f89200fd680 msgr2=0x7f89200ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.681+0000 7f8924c00640 1 -- 172.21.15.18:0/4226780685 shutdown_connections 2024-09-13T16:55:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.682+0000 7f8924c00640 1 -- 172.21.15.18:0/4226780685 wait complete. 2024-09-13T16:55:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.683+0000 7f8924c00640 1 Processor -- start 2024-09-13T16:55:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.684+0000 7f8924c00640 1 -- start start 2024-09-13T16:55:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.684+0000 7f8924c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8920101f20 0x7f8920197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.684+0000 7f8924c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8920103070 0x7f8920198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.684+0000 7f8924c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920103a30 0x7f892019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.684+0000 7f8924c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892019fa40 con 0x7f8920101f20 2024-09-13T16:55:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.684+0000 7f8924c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892019fbb0 con 0x7f8920103070 2024-09-13T16:55:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.684+0000 7f8924c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892019fd70 con 0x7f8920103a30 2024-09-13T16:55:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.685+0000 7f891de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8920101f20 0x7f8920197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.685+0000 7f891de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8920101f20 0x7f8920197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53984/0 (socket says 172.21.15.18:53984) 2024-09-13T16:55:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.685+0000 7f891de00640 1 -- 172.21.15.18:0/3076116459 learned_addr learned my addr 172.21.15.18:0/3076116459 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.685+0000 7f891d400640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8920103070 0x7f8920198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.685+0000 7f891e800640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920103a30 0x7f892019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.686+0000 7f891d400640 1 -- 172.21.15.18:0/3076116459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920103a30 msgr2=0x7f892019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.686+0000 7f891d400640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920103a30 0x7f892019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.686+0000 7f891d400640 1 -- 172.21.15.18:0/3076116459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8920101f20 msgr2=0x7f8920197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.686+0000 7f891d400640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8920101f20 0x7f8920197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.686+0000 7f891d400640 1 -- 172.21.15.18:0/3076116459 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c009560 con 0x7f8920103070 2024-09-13T16:55:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.687+0000 7f891d400640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8920103070 0x7f8920198490 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8920101c40 tx=0x7f890c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.687+0000 7f8916a00640 1 -- 172.21.15.18:0/3076116459 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c004440 con 0x7f8920103070 2024-09-13T16:55:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.687+0000 7f8916a00640 1 -- 172.21.15.18:0/3076116459 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f890c00cd80 con 0x7f8920103070 2024-09-13T16:55:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.687+0000 7f8924c00640 1 -- 172.21.15.18:0/3076116459 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8918009840 con 0x7f8920103070 2024-09-13T16:55:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.687+0000 7f8916a00640 1 -- 172.21.15.18:0/3076116459 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c019480 con 0x7f8920103070 2024-09-13T16:55:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.687+0000 7f8924c00640 1 -- 172.21.15.18:0/3076116459 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89201a02f0 con 0x7f8920103070 2024-09-13T16:55:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.692+0000 7f8927a53740 1 Processor -- start 2024-09-13T16:55:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.692+0000 7f8927a53740 1 -- start start 2024-09-13T16:55:00.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.693+0000 7f8927a53740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f09680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.693+0000 7f8916a00640 1 -- 172.21.15.18:0/3076116459 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f890c00c8c0 con 0x7f8920103070 2024-09-13T16:55:00.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.693+0000 7f8927a53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09bc0 0x5575d6f0e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.693+0000 7f8927a53740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f0ec50 0x5575d6f11110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.693+0000 7f8927a53740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6e0cbb0 con 0x5575d6f09bc0 2024-09-13T16:55:00.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.693+0000 7f8927a53740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6e6aa70 con 0x5575d6f09280 2024-09-13T16:55:00.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.693+0000 7f8927a53740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6e68200 con 0x5575d6f0ec50 2024-09-13T16:55:00.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.694+0000 7f891e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f09680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.694+0000 7f891e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f09680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:45630/0 (socket says 172.21.15.18:45630) 2024-09-13T16:55:00.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.694+0000 7f891e800640 1 -- 172.21.15.18:0/3702129331 learned_addr learned my addr 172.21.15.18:0/3702129331 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:00.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.694+0000 7f891de00640 1 --2- 172.21.15.18:0/3702129331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09bc0 0x5575d6f0e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.695+0000 7f8916a00640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f89040a1110 0x7f89040a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.695+0000 7f8916a00640 1 -- 172.21.15.18:0/3076116459 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f890c014070 con 0x7f8920103070 2024-09-13T16:55:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.696+0000 7f891de00640 1 -- 172.21.15.18:0/3702129331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f0ec50 msgr2=0x5575d6f11110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:55:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.696+0000 7f891de00640 1 --2- 172.21.15.18:0/3702129331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f0ec50 0x5575d6f11110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.696+0000 7f891de00640 1 -- 172.21.15.18:0/3702129331 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 msgr2=0x5575d6f09680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.696+0000 7f891de00640 1 --2- 172.21.15.18:0/3702129331 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f09680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.696+0000 7f891de00640 1 -- 172.21.15.18:0/3702129331 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575d6e05940 con 0x5575d6f09bc0 2024-09-13T16:55:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.696+0000 7f891e800640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f89040a1110 0x7f89040a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.697+0000 7f891de00640 1 --2- 172.21.15.18:0/3702129331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09bc0 0x5575d6f0e680 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8910009c80 tx=0x7f89100117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a3b9039f039fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:00.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.700+0000 7f891e800640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f89040a1110 0x7f89040a35d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8918004af0 tx=0x7f891802a6b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:00.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.703+0000 7f890b400640 1 -- 172.21.15.18:0/3702129331 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910012450 con 0x5575d6f09bc0 2024-09-13T16:55:00.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.703+0000 7f890b400640 1 -- 172.21.15.18:0/3702129331 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8910012a70 con 0x5575d6f09bc0 2024-09-13T16:55:00.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.703+0000 7f890b400640 1 -- 172.21.15.18:0/3702129331 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000faf0 con 0x5575d6f09bc0 2024-09-13T16:55:00.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.704+0000 7f8927a53740 1 -- 172.21.15.18:0/3702129331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09bc0 msgr2=0x5575d6f0e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:00.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.704+0000 7f8927a53740 1 --2- 172.21.15.18:0/3702129331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09bc0 0x5575d6f0e680 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8910009c80 tx=0x7f89100117b0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.708+0000 7f8927a53740 1 -- 172.21.15.18:0/3702129331 shutdown_connections 2024-09-13T16:55:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.708+0000 7f8927a53740 1 --2- 172.21.15.18:0/3702129331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09bc0 0x5575d6f0e680 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.708+0000 7f8927a53740 1 --2- 172.21.15.18:0/3702129331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f0ec50 0x5575d6f11110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.708+0000 7f8927a53740 1 --2- 172.21.15.18:0/3702129331 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f09680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.708+0000 7f8927a53740 1 -- 172.21.15.18:0/3702129331 >> 172.21.15.18:0/3702129331 conn(0x5575d6f048f0 msgr2=0x5575d6f04cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.712+0000 7f8927a53740 1 -- 172.21.15.18:0/3702129331 shutdown_connections 2024-09-13T16:55:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.712+0000 7f8927a53740 1 -- 172.21.15.18:0/3702129331 wait complete. 2024-09-13T16:55:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.712+0000 7f8927a53740 1 -- start start 2024-09-13T16:55:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.713+0000 7f8927a53740 1 Processor -- start 2024-09-13T16:55:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.714+0000 7f8927a53740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f12fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.714+0000 7f8927a53740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f13510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.714+0000 7f8927a53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.714+0000 7f891e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.715+0000 7f891d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f13510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.715+0000 7f891d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f13510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:44228/0 (socket says 172.21.15.18:44228) 2024-09-13T16:55:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.715+0000 7f891e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53998/0 (socket says 172.21.15.18:53998) 2024-09-13T16:55:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.715+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6e63af0 con 0x5575d6f0ec50 2024-09-13T16:55:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.715+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6e21f20 con 0x5575d6f09280 2024-09-13T16:55:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.715+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6e21bc0 con 0x5575d6f09bc0 2024-09-13T16:55:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.715+0000 7f8927a53740 10 client.0 _ll_register_callbacks cb 0x5575d6e53a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:55:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.715+0000 7f891d400640 1 -- 172.21.15.18:0/3487208469 learned_addr learned my addr 172.21.15.18:0/3487208469 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.718+0000 7f891d400640 1 -- 172.21.15.18:0/3487208469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 msgr2=0x5575d6f12fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:55:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.718+0000 7f891d400640 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f12fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.718+0000 7f891d400640 1 -- 172.21.15.18:0/3487208469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 msgr2=0x5575d6f1a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.719+0000 7f891d400640 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.719+0000 7f891d400640 1 -- 172.21.15.18:0/3487208469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8910009860 con 0x5575d6f09bc0 2024-09-13T16:55:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.719+0000 7f891e800640 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:55:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.719+0000 7f891d400640 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f13510 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f890c096880 tx=0x7f890c099ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb11e1061967996 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.720+0000 7f88ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:55:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.720+0000 7f88ffe00640 1 -- 172.21.15.18:0/3487208469 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0850d0 con 0x5575d6f09bc0 2024-09-13T16:55:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.720+0000 7f88ffe00640 1 -- 172.21.15.18:0/3487208469 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f890c018e80 con 0x5575d6f09bc0 2024-09-13T16:55:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.720+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575d6e8dc90 con 0x5575d6f09bc0 2024-09-13T16:55:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.720+0000 7f88ffe00640 1 -- 172.21.15.18:0/3487208469 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f890c0cd160 con 0x5575d6f09bc0 2024-09-13T16:55:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.720+0000 7f8927a53740 10 client.25543 fetch_fsmap learned FSMap version 28 2024-09-13T16:55:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.720+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5575d6e62170 con 0x5575d6f09bc0 2024-09-13T16:55:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.721+0000 7f88ffe00640 1 -- 172.21.15.18:0/3487208469 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f890c09a380 con 0x5575d6f09bc0 2024-09-13T16:55:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.721+0000 7f88ffe00640 1 -- 172.21.15.18:0/3487208469 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f890c0b0070 con 0x5575d6f09bc0 2024-09-13T16:55:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.722+0000 7f8927a53740 10 client.25543 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:55:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.722+0000 7f8927a53740 10 client.25543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:55:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.722+0000 7f8927a53740 20 client.25543 populate_metadata read hostname 'smithi018' 2024-09-13T16:55:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.722+0000 7f8927a53740 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5575d6effc90 0x5575d6f02150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.722+0000 7f8927a53740 4 client.25543 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:55:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.722+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575d6e8dc90 con 0x5575d6effc90 2024-09-13T16:55:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.735+0000 7f891de00640 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5575d6effc90 0x5575d6f02150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.735+0000 7f891de00640 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5575d6effc90 0x5575d6f02150 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38c20496306f1486 server_cookie=2453b015d34c8f46 in_seq=0 out_seq=0 2024-09-13T16:55:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.735+0000 7f88ffe00640 10 client.25543 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.736+0000 7f88ffe00640 1 -- 172.21.15.18:0/3487208469 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5575d6e8dc90 con 0x5575d6effc90 2024-09-13T16:55:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.736+0000 7f88ffe00640 10 client.25543 handle_command_reply: tid=0 2024-09-13T16:55:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.736+0000 7f8927a53740 1 client.25543 shutdown 2024-09-13T16:55:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 msgr2=0x5575d6f13510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f8927a53740 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f13510 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f890c096880 tx=0x7f890c099ec0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 shutdown_connections 2024-09-13T16:55:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f8927a53740 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5575d6effc90 0x5575d6f02150 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f8927a53740 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f8927a53740 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f13510 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f88ffe00640 0 client.25543 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f8927a53740 1 --2- 172.21.15.18:0/3487208469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f12fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 >> 172.21.15.18:0/3487208469 conn(0x5575d6f048f0 msgr2=0x5575d6f06100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 shutdown_connections 2024-09-13T16:55:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.737+0000 7f8927a53740 1 -- 172.21.15.18:0/3487208469 wait complete. 2024-09-13T16:55:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.739+0000 7f8927a53740 20 client.25543 trim_cache size 0 max 16384 2024-09-13T16:55:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.832+0000 7f8927a53740 1 Processor -- start 2024-09-13T16:55:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.837+0000 7f8927a53740 1 -- start start 2024-09-13T16:55:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.837+0000 7f8927a53740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f0ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.837+0000 7f8927a53740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f1a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.837+0000 7f8927a53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f0b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.837+0000 7f891de00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f0ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.838+0000 7f891de00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f0ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42484/0 (socket says 172.21.15.18:42484) 2024-09-13T16:55:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.838+0000 7f891d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f1a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.838+0000 7f891d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f1a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:55506/0 (socket says 172.21.15.18:55506) 2024-09-13T16:55:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.841+0000 7f8927a53740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6bcae60 con 0x5575d6f0ec50 2024-09-13T16:55:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.841+0000 7f8927a53740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6f0a100 con 0x5575d6f09280 2024-09-13T16:55:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.841+0000 7f8927a53740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6efe340 con 0x5575d6f09bc0 2024-09-13T16:55:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.841+0000 7f891de00640 1 -- 172.21.15.18:0/3678058973 learned_addr learned my addr 172.21.15.18:0/3678058973 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.845+0000 7f891d400640 1 -- 172.21.15.18:0/3678058973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 msgr2=0x5575d6f0ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.845+0000 7f891d400640 1 --2- 172.21.15.18:0/3678058973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f0ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.845+0000 7f891d400640 1 -- 172.21.15.18:0/3678058973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 msgr2=0x5575d6f0b080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:55:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.845+0000 7f891e800640 1 --2- 172.21.15.18:0/3678058973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f0b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.845+0000 7f891d400640 1 --2- 172.21.15.18:0/3678058973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f0b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.845+0000 7f891d400640 1 -- 172.21.15.18:0/3678058973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575d6e04180 con 0x5575d6f09bc0 2024-09-13T16:55:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.845+0000 7f891e800640 1 --2- 172.21.15.18:0/3678058973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f0b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:55:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.850+0000 7f891d400640 1 --2- 172.21.15.18:0/3678058973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f1a510 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f890c009530 tx=0x7f890c0039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9a534cf73cae238 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.855+0000 7f890be00640 1 -- 172.21.15.18:0/3678058973 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0850d0 con 0x5575d6f09bc0 2024-09-13T16:55:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.855+0000 7f890be00640 1 -- 172.21.15.18:0/3678058973 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f890c0cd160 con 0x5575d6f09bc0 2024-09-13T16:55:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.856+0000 7f8927a53740 1 -- 172.21.15.18:0/3678058973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 msgr2=0x5575d6f1a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.856+0000 7f8927a53740 1 --2- 172.21.15.18:0/3678058973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f1a510 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f890c009530 tx=0x7f890c0039c0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.856+0000 7f8927a53740 1 -- 172.21.15.18:0/3678058973 shutdown_connections 2024-09-13T16:55:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.856+0000 7f8927a53740 1 --2- 172.21.15.18:0/3678058973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f0ec50 0x5575d6f0b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.856+0000 7f8927a53740 1 --2- 172.21.15.18:0/3678058973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f09bc0 0x5575d6f1a510 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.856+0000 7f8927a53740 1 --2- 172.21.15.18:0/3678058973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f09280 0x5575d6f0ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.856+0000 7f8927a53740 1 -- 172.21.15.18:0/3678058973 >> 172.21.15.18:0/3678058973 conn(0x5575d6f048f0 msgr2=0x5575d6f2fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.861+0000 7f8927a53740 1 -- 172.21.15.18:0/3678058973 shutdown_connections 2024-09-13T16:55:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.874+0000 7f8927a53740 1 -- 172.21.15.18:0/3678058973 wait complete. 2024-09-13T16:55:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.881+0000 7f8927a53740 1 -- start start 2024-09-13T16:55:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.881+0000 7f8927a53740 1 Processor -- start 2024-09-13T16:55:00.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.882+0000 7f8927a53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09280 0x5575d6f14e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.884+0000 7f891de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09280 0x5575d6f14e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.884+0000 7f891de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09280 0x5575d6f14e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38712/0 (socket says 172.21.15.18:38712) 2024-09-13T16:55:00.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.884+0000 7f891de00640 1 -- 172.21.15.18:0/2794210044 learned_addr learned my addr 172.21.15.18:0/2794210044 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:00.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.884+0000 7f8927a53740 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.885+0000 7f8927a53740 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f15360 0x5575d6f7d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.885+0000 7f891d400640 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.885+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6f158c0 con 0x5575d6f09280 2024-09-13T16:55:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.885+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6f15a30 con 0x5575d6f0ec50 2024-09-13T16:55:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.885+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d6f7d790 con 0x5575d6f15360 2024-09-13T16:55:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.885+0000 7f891e800640 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f15360 0x5575d6f7d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.886+0000 7f891d400640 1 -- 172.21.15.18:0/2794210044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f15360 msgr2=0x5575d6f7d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.886+0000 7f891d400640 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f15360 0x5575d6f7d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.886+0000 7f891d400640 1 -- 172.21.15.18:0/2794210044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09280 msgr2=0x5575d6f14e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.886+0000 7f891d400640 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09280 0x5575d6f14e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.886+0000 7f891d400640 1 -- 172.21.15.18:0/2794210044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575d6e62170 con 0x5575d6f0ec50 2024-09-13T16:55:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.887+0000 7f891d400640 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f890c09a310 tx=0x7f890c009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b1064d9d682ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.888+0000 7f8927a53740 10 client.0 _ll_register_callbacks cb 0x7f8910009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:55:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.888+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575d6e567d0 con 0x5575d6f0ec50 2024-09-13T16:55:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.888+0000 7f891de00640 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09280 0x5575d6f14e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:55:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.888+0000 7f88ffe00640 10 client.25589 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:55:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.888+0000 7f88ffe00640 1 -- 172.21.15.18:0/2794210044 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0850d0 con 0x5575d6f0ec50 2024-09-13T16:55:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.888+0000 7f88ffe00640 1 -- 172.21.15.18:0/2794210044 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f890c0a2800 con 0x5575d6f0ec50 2024-09-13T16:55:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.889+0000 7f88ffe00640 1 -- 172.21.15.18:0/2794210044 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f890c0cd160 con 0x5575d6f0ec50 2024-09-13T16:55:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.894+0000 7f8927a53740 10 client.25589 fetch_fsmap learned FSMap version 28 2024-09-13T16:55:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.894+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({fsmap=28}) v3 -- 0x5575d6e29560 con 0x5575d6f0ec50 2024-09-13T16:55:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.894+0000 7f88ffe00640 1 -- 172.21.15.18:0/2794210044 <== mon.2 v2:172.21.15.94:3300/0 4 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f890c0b0070 con 0x5575d6f0ec50 2024-09-13T16:55:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.898+0000 7f8927a53740 10 client.25589 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:55:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.898+0000 7f8927a53740 10 client.25589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:55:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.898+0000 7f8927a53740 20 client.25589 populate_metadata read hostname 'smithi018' 2024-09-13T16:55:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.898+0000 7f8927a53740 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5575d6f1bae0 0x5575d6f1df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.898+0000 7f8927a53740 4 client.25589 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:55:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.898+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5575d6e567d0 con 0x5575d6f1bae0 2024-09-13T16:55:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.903+0000 7f891de00640 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5575d6f1bae0 0x5575d6f1df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.907+0000 7f891de00640 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5575d6f1bae0 0x5575d6f1df40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e035f8b1ede06fed server_cookie=30c7c5d5d3fc6732 in_seq=0 out_seq=0 2024-09-13T16:55:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:00.909+0000 7f88ffe00640 10 client.25589 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:01.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:01 smithi144 ceph-mon[35328]: pgmap v467: 129 pgs: 129 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 382 op/s 2024-09-13T16:55:01.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:01 smithi094 ceph-mon[35259]: pgmap v467: 129 pgs: 129 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 382 op/s 2024-09-13T16:55:01.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:01 smithi018 ceph-mon[30981]: pgmap v467: 129 pgs: 129 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 382 op/s 2024-09-13T16:55:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.372+0000 7f88ffe00640 1 -- 172.21.15.18:0/2794210044 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5575d6e567d0 con 0x5575d6f1bae0 2024-09-13T16:55:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.373+0000 7f88ffe00640 10 client.25589 handle_command_reply: tid=0 2024-09-13T16:55:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.374+0000 7f8927a53740 1 client.25589 shutdown 2024-09-13T16:55:02.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.378+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f0ec50 msgr2=0x5575d6f1a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:02.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.378+0000 7f8927a53740 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f890c09a310 tx=0x7f890c009f70 comp rx=0 tx=0).stop 2024-09-13T16:55:02.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.378+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 shutdown_connections 2024-09-13T16:55:02.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.378+0000 7f8927a53740 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5575d6f1bae0 0x5575d6f1df40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.378+0000 7f8927a53740 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d6f15360 0x5575d6f7d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.378+0000 7f8927a53740 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5575d6f0ec50 0x5575d6f1a390 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f890c09a310 tx=0x7f890c009f70 comp rx=0 tx=0).stop 2024-09-13T16:55:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.378+0000 7f8927a53740 1 --2- 172.21.15.18:0/2794210044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d6f09280 0x5575d6f14e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.378+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 >> 172.21.15.18:0/2794210044 conn(0x5575d6f048f0 msgr2=0x5575d6f0ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.378+0000 7f88ffe00640 0 client.25589 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.378+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 shutdown_connections 2024-09-13T16:55:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.379+0000 7f8927a53740 1 -- 172.21.15.18:0/2794210044 wait complete. 2024-09-13T16:55:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.379+0000 7f8927a53740 20 client.25589 trim_cache size 0 max 16384 2024-09-13T16:55:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:55:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:55:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:55:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:55:02.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.382+0000 7f8924c00640 1 -- 172.21.15.18:0/3076116459 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f89040a1110 msgr2=0x7f89040a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:02.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.382+0000 7f8924c00640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f89040a1110 0x7f89040a35d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8918004af0 tx=0x7f891802a6b0 comp rx=0 tx=0).stop 2024-09-13T16:55:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.383+0000 7f8924c00640 1 -- 172.21.15.18:0/3076116459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8920103070 msgr2=0x7f8920198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.383+0000 7f8924c00640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8920103070 0x7f8920198490 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8920101c40 tx=0x7f890c00ee50 comp rx=0 tx=0).stop 2024-09-13T16:55:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.384+0000 7f8924c00640 1 -- 172.21.15.18:0/3076116459 shutdown_connections 2024-09-13T16:55:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.384+0000 7f8924c00640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920103a30 0x7f892019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.384+0000 7f8924c00640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8920103070 0x7f8920198490 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.384+0000 7f8924c00640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f89040a1110 0x7f89040a35d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.384+0000 7f8924c00640 1 --2- 172.21.15.18:0/3076116459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8920101f20 0x7f8920197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.384+0000 7f8924c00640 1 -- 172.21.15.18:0/3076116459 >> 172.21.15.18:0/3076116459 conn(0x7f89200fd680 msgr2=0x7f8920106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.386+0000 7f8924c00640 1 -- 172.21.15.18:0/3076116459 shutdown_connections 2024-09-13T16:55:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:02.386+0000 7f8924c00640 1 -- 172.21.15.18:0/3076116459 wait complete. 2024-09-13T16:55:03.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:03 smithi094 ceph-mon[35259]: pgmap v468: 129 pgs: 129 active+clean; 321 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.4 MiB/s wr, 499 op/s 2024-09-13T16:55:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:03 smithi018 ceph-mon[30981]: pgmap v468: 129 pgs: 129 active+clean; 321 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.4 MiB/s wr, 499 op/s 2024-09-13T16:55:03.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:03 smithi144 ceph-mon[35328]: pgmap v468: 129 pgs: 129 active+clean; 321 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.4 MiB/s wr, 499 op/s 2024-09-13T16:55:05.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:05 smithi094 ceph-mon[35259]: pgmap v469: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.6 MiB/s wr, 471 op/s 2024-09-13T16:55:05.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:05 smithi018 ceph-mon[30981]: pgmap v469: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.6 MiB/s wr, 471 op/s 2024-09-13T16:55:05.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:05 smithi144 ceph-mon[35328]: pgmap v469: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.6 MiB/s wr, 471 op/s 2024-09-13T16:55:06.255 INFO:tasks.workunit.client.0.smithi018.stdout: 93 444331 526 306998 759 116373 558 2024-09-13T16:55:07.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:07 smithi018 ceph-mon[30981]: pgmap v470: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 610 op/s 2024-09-13T16:55:07.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:07 smithi094 ceph-mon[35259]: pgmap v470: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 610 op/s 2024-09-13T16:55:07.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:07 smithi144 ceph-mon[35328]: pgmap v470: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 610 op/s 2024-09-13T16:55:09.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:09 smithi094 ceph-mon[35259]: pgmap v471: 129 pgs: 129 active+clean; 327 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 573 op/s 2024-09-13T16:55:09.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:09 smithi018 ceph-mon[30981]: pgmap v471: 129 pgs: 129 active+clean; 327 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 573 op/s 2024-09-13T16:55:09.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:09 smithi144 ceph-mon[35328]: pgmap v471: 129 pgs: 129 active+clean; 327 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 573 op/s 2024-09-13T16:55:11.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:11 smithi094 ceph-mon[35259]: pgmap v472: 129 pgs: 129 active+clean; 333 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 536 op/s 2024-09-13T16:55:11.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:11 smithi018 ceph-mon[30981]: pgmap v472: 129 pgs: 129 active+clean; 333 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 536 op/s 2024-09-13T16:55:11.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:11 smithi144 ceph-mon[35328]: pgmap v472: 129 pgs: 129 active+clean; 333 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 536 op/s 2024-09-13T16:55:13.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:13 smithi094 ceph-mon[35259]: pgmap v473: 129 pgs: 129 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 498 op/s 2024-09-13T16:55:13.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:13 smithi018 ceph-mon[30981]: pgmap v473: 129 pgs: 129 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 498 op/s 2024-09-13T16:55:13.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:13 smithi144 ceph-mon[35328]: pgmap v473: 129 pgs: 129 active+clean; 334 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 498 op/s 2024-09-13T16:55:15.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:15 smithi094 ceph-mon[35259]: pgmap v474: 129 pgs: 129 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 362 op/s 2024-09-13T16:55:15.715 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:15 smithi018 ceph-mon[30981]: pgmap v474: 129 pgs: 129 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 362 op/s 2024-09-13T16:55:15.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:15 smithi144 ceph-mon[35328]: pgmap v474: 129 pgs: 129 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 362 op/s 2024-09-13T16:55:16.267 INFO:tasks.workunit.client.0.smithi018.stdout: 102 537584 555 379109 586 144745 652 2024-09-13T16:55:17.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:17 smithi094 ceph-mon[35259]: pgmap v475: 129 pgs: 129 active+clean; 349 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 355 op/s 2024-09-13T16:55:17.725 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:17 smithi018 ceph-mon[30981]: pgmap v475: 129 pgs: 129 active+clean; 349 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 355 op/s 2024-09-13T16:55:17.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:17 smithi144 ceph-mon[35328]: pgmap v475: 129 pgs: 129 active+clean; 349 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 355 op/s 2024-09-13T16:55:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.092+0000 7fa68b000640 1 -- 172.21.15.18:0/2436062900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa68410c240 msgr2=0x7fa6841173f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.092+0000 7fa68b000640 1 --2- 172.21.15.18:0/2436062900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa68410c240 0x7fa6841173f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009ca0 tx=0x7fa67c02a8f0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.110+0000 7fa68b000640 1 -- 172.21.15.18:0/2436062900 shutdown_connections 2024-09-13T16:55:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.110+0000 7fa68b000640 1 --2- 172.21.15.18:0/2436062900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa68410c240 0x7fa6841173f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.110+0000 7fa68b000640 1 --2- 172.21.15.18:0/2436062900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa684109870 0x7fa68410bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.110+0000 7fa68b000640 1 --2- 172.21.15.18:0/2436062900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa684071120 0x7fa684071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.110+0000 7fa68b000640 1 -- 172.21.15.18:0/2436062900 >> 172.21.15.18:0/2436062900 conn(0x7fa68406cf30 msgr2=0x7fa68406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.123+0000 7fa68b000640 1 -- 172.21.15.18:0/2436062900 shutdown_connections 2024-09-13T16:55:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.125+0000 7fa68b000640 1 -- 172.21.15.18:0/2436062900 wait complete. 2024-09-13T16:55:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.128+0000 7fa68b000640 1 Processor -- start 2024-09-13T16:55:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.144+0000 7fa68b000640 1 -- start start 2024-09-13T16:55:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.144+0000 7fa68b000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa684071120 0x7fa6841a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.144+0000 7fa68b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa684109870 0x7fa6841a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.144+0000 7fa68b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa68410c240 0x7fa6841ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.144+0000 7fa68b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6841ac7c0 con 0x7fa684109870 2024-09-13T16:55:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.144+0000 7fa68b000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68410ec10 con 0x7fa684071120 2024-09-13T16:55:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.144+0000 7fa68b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68410edd0 con 0x7fa68410c240 2024-09-13T16:55:18.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.147+0000 7fa689000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa68410c240 0x7fa6841ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.147+0000 7fa683400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa684109870 0x7fa6841a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.147+0000 7fa689000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa68410c240 0x7fa6841ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:50208/0 (socket says 172.21.15.18:50208) 2024-09-13T16:55:18.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.147+0000 7fa689000640 1 -- 172.21.15.18:0/4049754277 learned_addr learned my addr 172.21.15.18:0/4049754277 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.151+0000 7fa683e00640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa684071120 0x7fa6841a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.151+0000 7fa683400640 1 -- 172.21.15.18:0/4049754277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa68410c240 msgr2=0x7fa6841ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.151+0000 7fa683400640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa68410c240 0x7fa6841ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.151+0000 7fa683400640 1 -- 172.21.15.18:0/4049754277 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa684071120 msgr2=0x7fa6841a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.151+0000 7fa683400640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa684071120 0x7fa6841a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.151+0000 7fa683400640 1 -- 172.21.15.18:0/4049754277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c009900 con 0x7fa684109870 2024-09-13T16:55:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.170+0000 7fa683400640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa684109870 0x7fa6841a51f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa67000e9c0 tx=0x7fa67000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.195+0000 7fa680c00640 1 -- 172.21.15.18:0/4049754277 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000cc40 con 0x7fa684109870 2024-09-13T16:55:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.195+0000 7fa680c00640 1 -- 172.21.15.18:0/4049754277 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6700044e0 con 0x7fa684109870 2024-09-13T16:55:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.195+0000 7fa680c00640 1 -- 172.21.15.18:0/4049754277 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670003e00 con 0x7fa684109870 2024-09-13T16:55:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.195+0000 7fa68b000640 1 -- 172.21.15.18:0/4049754277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68410f0b0 con 0x7fa684109870 2024-09-13T16:55:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.196+0000 7fa68b000640 1 -- 172.21.15.18:0/4049754277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68410f5f0 con 0x7fa684109870 2024-09-13T16:55:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.226+0000 7fa680c00640 1 -- 172.21.15.18:0/4049754277 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa670003fa0 con 0x7fa684109870 2024-09-13T16:55:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.244+0000 7fa680c00640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6680a1290 0x7fa6680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.245+0000 7fa68de05740 1 Processor -- start 2024-09-13T16:55:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.245+0000 7fa680c00640 1 -- 172.21.15.18:0/4049754277 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa670014070 con 0x7fa684109870 2024-09-13T16:55:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.246+0000 7fa683e00640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6680a1290 0x7fa6680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.247+0000 7fa683e00640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6680a1290 0x7fa6680a3750 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa6841a5b80 tx=0x7fa674008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.249+0000 7fa68de05740 1 -- start start 2024-09-13T16:55:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.249+0000 7fa68de05740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 0x55a108a6ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.249+0000 7fa68de05740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a71e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.249+0000 7fa68de05740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a72440 0x55a108a74900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.249+0000 7fa68de05740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a108978bb0 con 0x55a108a6ca70 2024-09-13T16:55:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.249+0000 7fa68de05740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1089d6a70 con 0x55a108a6d3b0 2024-09-13T16:55:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.249+0000 7fa68de05740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1089d4200 con 0x55a108a72440 2024-09-13T16:55:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.258+0000 7fa689000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a72440 0x55a108a74900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.258+0000 7fa689000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a72440 0x55a108a74900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:50216/0 (socket says 172.21.15.18:50216) 2024-09-13T16:55:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.258+0000 7fa689000640 1 -- 172.21.15.18:0/754168055 learned_addr learned my addr 172.21.15.18:0/754168055 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.258+0000 7fa683400640 1 --2- 172.21.15.18:0/754168055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a71e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.259+0000 7fa689000640 1 -- 172.21.15.18:0/754168055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 msgr2=0x55a108a71e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.259+0000 7fa689000640 1 --2- 172.21.15.18:0/754168055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a71e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.259+0000 7fa689000640 1 -- 172.21.15.18:0/754168055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 msgr2=0x55a108a6ce70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.259+0000 7fa689000640 1 --2- 172.21.15.18:0/754168055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 0x55a108a6ce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.259+0000 7fa689000640 1 -- 172.21.15.18:0/754168055 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a108971940 con 0x55a108a72440 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.263+0000 7fa689000640 1 --2- 172.21.15.18:0/754168055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a72440 0x55a108a74900 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa67c02f420 tx=0x7fa67c02f450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3250f4f9f8c3752d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.266+0000 7fa679600640 1 -- 172.21.15.18:0/754168055 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c040070 con 0x55a108a72440 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.266+0000 7fa679600640 1 -- 172.21.15.18:0/754168055 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa67c003e30 con 0x55a108a72440 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.266+0000 7fa679600640 1 -- 172.21.15.18:0/754168055 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c004790 con 0x55a108a72440 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.268+0000 7fa68de05740 1 -- 172.21.15.18:0/754168055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a72440 msgr2=0x55a108a74900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:18.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.268+0000 7fa68de05740 1 --2- 172.21.15.18:0/754168055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a72440 0x55a108a74900 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa67c02f420 tx=0x7fa67c02f450 comp rx=0 tx=0).stop 2024-09-13T16:55:18.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.268+0000 7fa68de05740 1 -- 172.21.15.18:0/754168055 shutdown_connections 2024-09-13T16:55:18.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.268+0000 7fa68de05740 1 --2- 172.21.15.18:0/754168055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a72440 0x55a108a74900 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.268+0000 7fa68de05740 1 --2- 172.21.15.18:0/754168055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a71e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.268+0000 7fa68de05740 1 --2- 172.21.15.18:0/754168055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 0x55a108a6ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.268+0000 7fa68de05740 1 -- 172.21.15.18:0/754168055 >> 172.21.15.18:0/754168055 conn(0x55a108a680e0 msgr2=0x55a108a684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:18.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.275+0000 7fa68de05740 1 -- 172.21.15.18:0/754168055 shutdown_connections 2024-09-13T16:55:18.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.277+0000 7fa68de05740 1 -- 172.21.15.18:0/754168055 wait complete. 2024-09-13T16:55:18.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.277+0000 7fa68de05740 1 -- start start 2024-09-13T16:55:18.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.278+0000 7fa68de05740 1 Processor -- start 2024-09-13T16:55:18.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.281+0000 7fa68de05740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 0x55a108a76670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.283+0000 7fa68de05740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a76bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.283+0000 7fa68de05740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 0x55a108a7dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.283+0000 7fa683400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a76bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.283+0000 7fa683e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 0x55a108a76670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.283+0000 7fa683400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a76bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:39240/0 (socket says 172.21.15.18:39240) 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.284+0000 7fa683400640 1 -- 172.21.15.18:0/4076437825 learned_addr learned my addr 172.21.15.18:0/4076437825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.284+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1089cfaf0 con 0x55a108a72440 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.284+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10898df20 con 0x55a108a6d3b0 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.284+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10898dbc0 con 0x55a108a6ca70 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.284+0000 7fa68de05740 10 client.0 _ll_register_callbacks cb 0x55a1089bfa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.287+0000 7fa689000640 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 0x55a108a7dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.290+0000 7fa683400640 1 -- 172.21.15.18:0/4076437825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 msgr2=0x55a108a76670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:18.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.290+0000 7fa683400640 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 0x55a108a76670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.290+0000 7fa683400640 1 -- 172.21.15.18:0/4076437825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 msgr2=0x55a108a7dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:18.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.290+0000 7fa683400640 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 0x55a108a7dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.290+0000 7fa683400640 1 -- 172.21.15.18:0/4076437825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa684117930 con 0x55a108a6d3b0 2024-09-13T16:55:18.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.295+0000 7fa683400640 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a76bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa670099e50 tx=0x7fa67009a850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c83aea2b06df0f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:18.303 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.295+0000 7fa66e000640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:55:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.304+0000 7fa66e000640 1 -- 172.21.15.18:0/4076437825 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700a25d0 con 0x55a108a6d3b0 2024-09-13T16:55:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.304+0000 7fa66e000640 1 -- 172.21.15.18:0/4076437825 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa670004250 con 0x55a108a6d3b0 2024-09-13T16:55:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.304+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1089f9c90 con 0x55a108a6d3b0 2024-09-13T16:55:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.313+0000 7fa66e000640 1 -- 172.21.15.18:0/4076437825 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6700a2140 con 0x55a108a6d3b0 2024-09-13T16:55:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.313+0000 7fa68de05740 10 client.25598 fetch_fsmap learned FSMap version 28 2024-09-13T16:55:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.313+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a1089ce170 con 0x55a108a6d3b0 2024-09-13T16:55:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.314+0000 7fa66e000640 1 -- 172.21.15.18:0/4076437825 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a1089f9c90 con 0x55a108a6d3b0 2024-09-13T16:55:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.314+0000 7fa66e000640 1 -- 172.21.15.18:0/4076437825 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fa67001f060 con 0x55a108a6d3b0 2024-09-13T16:55:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.314+0000 7fa68de05740 10 client.25598 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:55:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.314+0000 7fa68de05740 10 client.25598 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:55:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.314+0000 7fa68de05740 20 client.25598 populate_metadata read hostname 'smithi018' 2024-09-13T16:55:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.314+0000 7fa68de05740 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a108a82050 0x55a108a84470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.314+0000 7fa68de05740 4 client.25598 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:55:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.314+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1089c27d0 con 0x55a108a82050 2024-09-13T16:55:18.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.315+0000 7fa683e00640 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a108a82050 0x55a108a84470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.317+0000 7fa683e00640 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a108a82050 0x55a108a84470 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9327ab48561ffef2 server_cookie=3cffb1c079e2fa8 in_seq=0 out_seq=0 2024-09-13T16:55:18.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.318+0000 7fa66e000640 10 client.25598 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:18.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.320+0000 7fa66e000640 1 -- 172.21.15.18:0/4076437825 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a1089c27d0 con 0x55a108a82050 2024-09-13T16:55:18.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.320+0000 7fa66e000640 10 client.25598 handle_command_reply: tid=0 2024-09-13T16:55:18.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.320+0000 7fa68de05740 1 client.25598 shutdown 2024-09-13T16:55:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.337+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 msgr2=0x55a108a76bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.337+0000 7fa68de05740 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a76bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa670099e50 tx=0x7fa67009a850 comp rx=0 tx=0).stop 2024-09-13T16:55:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.340+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 shutdown_connections 2024-09-13T16:55:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.340+0000 7fa68de05740 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a108a82050 0x55a108a84470 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.340+0000 7fa68de05740 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 0x55a108a7dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.340+0000 7fa68de05740 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a76bb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.340+0000 7fa68de05740 1 --2- 172.21.15.18:0/4076437825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 0x55a108a76670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.340+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 >> 172.21.15.18:0/4076437825 conn(0x55a108a680e0 msgr2=0x55a108a698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.347+0000 7fa66e000640 0 client.25598 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.348+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 shutdown_connections 2024-09-13T16:55:18.355 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.353+0000 7fa68de05740 1 -- 172.21.15.18:0/4076437825 wait complete. 2024-09-13T16:55:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.368+0000 7fa68de05740 20 client.25598 trim_cache size 0 max 16384 2024-09-13T16:55:18.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.594+0000 7fa68de05740 1 Processor -- start 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.601+0000 7fa68de05740 1 -- start start 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.602+0000 7fa68de05740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 0x55a108a6e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.602+0000 7fa68de05740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a7dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.602+0000 7fa68de05740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 0x55a108a6e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.603+0000 7fa68de05740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a108736e60 con 0x55a108a72440 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.603+0000 7fa68de05740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a108a761b0 con 0x55a108a6d3b0 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.603+0000 7fa68de05740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a108a74d80 con 0x55a108a6ca70 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.603+0000 7fa689000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 0x55a108a6e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.603+0000 7fa689000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 0x55a108a6e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50496/0 (socket says 172.21.15.18:50496) 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.603+0000 7fa689000640 1 -- 172.21.15.18:0/2458276475 learned_addr learned my addr 172.21.15.18:0/2458276475 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.603+0000 7fa683400640 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a7dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.604+0000 7fa683400640 1 -- 172.21.15.18:0/2458276475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 msgr2=0x55a108a6e2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:55:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.604+0000 7fa683e00640 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 0x55a108a6e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.604+0000 7fa683400640 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 0x55a108a6e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.604+0000 7fa683400640 1 -- 172.21.15.18:0/2458276475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 msgr2=0x55a108a6e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.604+0000 7fa683400640 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 0x55a108a6e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.604+0000 7fa683400640 1 -- 172.21.15.18:0/2458276475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a108970180 con 0x55a108a6d3b0 2024-09-13T16:55:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.604+0000 7fa689000640 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 0x55a108a6e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:55:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.604+0000 7fa683e00640 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 0x55a108a6e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:55:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.605+0000 7fa683400640 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a7dbb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa6700984a0 tx=0x7fa6700038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a18de9fcd1c48b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.605+0000 7fa67a000640 1 -- 172.21.15.18:0/2458276475 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700a25d0 con 0x55a108a6d3b0 2024-09-13T16:55:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.605+0000 7fa67a000640 1 -- 172.21.15.18:0/2458276475 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa670004250 con 0x55a108a6d3b0 2024-09-13T16:55:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.605+0000 7fa67a000640 1 -- 172.21.15.18:0/2458276475 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700a23a0 con 0x55a108a6d3b0 2024-09-13T16:55:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.606+0000 7fa68de05740 1 -- 172.21.15.18:0/2458276475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 msgr2=0x55a108a7dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.606+0000 7fa68de05740 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a7dbb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa6700984a0 tx=0x7fa6700038a0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.618+0000 7fa68de05740 1 -- 172.21.15.18:0/2458276475 shutdown_connections 2024-09-13T16:55:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.618+0000 7fa68de05740 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a72440 0x55a108a6e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.618+0000 7fa68de05740 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a6d3b0 0x55a108a7dbb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.618+0000 7fa68de05740 1 --2- 172.21.15.18:0/2458276475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6ca70 0x55a108a6e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.618+0000 7fa68de05740 1 -- 172.21.15.18:0/2458276475 >> 172.21.15.18:0/2458276475 conn(0x55a108a680e0 msgr2=0x55a108a718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:18.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.618+0000 7fa68de05740 1 -- 172.21.15.18:0/2458276475 shutdown_connections 2024-09-13T16:55:18.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.618+0000 7fa68de05740 1 -- 172.21.15.18:0/2458276475 wait complete. 2024-09-13T16:55:18.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.618+0000 7fa68de05740 1 -- start start 2024-09-13T16:55:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.619+0000 7fa68de05740 1 Processor -- start 2024-09-13T16:55:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.622+0000 7fa68de05740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 0x55a108a7d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.622+0000 7fa683e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 0x55a108a7d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.622+0000 7fa683e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 0x55a108a7d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50502/0 (socket says 172.21.15.18:50502) 2024-09-13T16:55:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.622+0000 7fa683e00640 1 -- 172.21.15.18:0/3013378294 learned_addr learned my addr 172.21.15.18:0/3013378294 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.623+0000 7fa68de05740 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6d3b0 0x55a108a7dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.623+0000 7fa68de05740 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a72440 0x55a108a7a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.623+0000 7fa683400640 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6d3b0 0x55a108a7dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.625+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a108a7a930 con 0x55a108a6ca70 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.625+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a108a7aaa0 con 0x55a108a72440 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.625+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a108a7ac60 con 0x55a108a6d3b0 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.625+0000 7fa68de05740 10 client.0 _ll_register_callbacks cb 0x7fa67c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.626+0000 7fa689000640 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a72440 0x55a108a7a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.627+0000 7fa683e00640 1 -- 172.21.15.18:0/3013378294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6d3b0 msgr2=0x55a108a7dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.627+0000 7fa683e00640 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6d3b0 0x55a108a7dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.627+0000 7fa683e00640 1 -- 172.21.15.18:0/3013378294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a72440 msgr2=0x55a108a7a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.627+0000 7fa683e00640 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a72440 0x55a108a7a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.627+0000 7fa683e00640 1 -- 172.21.15.18:0/3013378294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa684117930 con 0x55a108a6ca70 2024-09-13T16:55:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.627+0000 7fa683400640 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6d3b0 0x55a108a7dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:55:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.627+0000 7fa689000640 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a72440 0x55a108a7a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:55:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.634+0000 7fa683e00640 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 0x55a108a7d670 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa674000c00 tx=0x7fa6740047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dd1a34d85576fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.634+0000 7fa66e000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:55:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.635+0000 7fa66e000640 1 -- 172.21.15.18:0/3013378294 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674014e50 con 0x55a108a6ca70 2024-09-13T16:55:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.635+0000 7fa66e000640 1 -- 172.21.15.18:0/3013378294 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa674025150 con 0x55a108a6ca70 2024-09-13T16:55:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.635+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa67c003e30 con 0x55a108a6ca70 2024-09-13T16:55:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.645+0000 7fa66e000640 1 -- 172.21.15.18:0/3013378294 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa674025310 con 0x55a108a6ca70 2024-09-13T16:55:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.647+0000 7fa68de05740 10 client.15549 fetch_fsmap learned FSMap version 28 2024-09-13T16:55:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.647+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a108995560 con 0x55a108a6ca70 2024-09-13T16:55:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.648+0000 7fa66e000640 1 -- 172.21.15.18:0/3013378294 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa674029070 con 0x55a108a6ca70 2024-09-13T16:55:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.649+0000 7fa66e000640 1 -- 172.21.15.18:0/3013378294 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fa67401f040 con 0x55a108a6ca70 2024-09-13T16:55:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.649+0000 7fa68de05740 10 client.15549 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:55:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.649+0000 7fa68de05740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:55:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.650+0000 7fa68de05740 20 client.15549 populate_metadata read hostname 'smithi018' 2024-09-13T16:55:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.650+0000 7fa68de05740 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a108ad9c80 0x55a108adc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.650+0000 7fa68de05740 4 client.15549 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:55:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.650+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7fa67c003e30 con 0x55a108ad9c80 2024-09-13T16:55:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.653+0000 7fa683400640 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a108ad9c80 0x55a108adc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.653+0000 7fa683400640 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a108ad9c80 0x55a108adc0a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3271eb3ce07c0fd server_cookie=ec43f5f592857df3 in_seq=0 out_seq=0 2024-09-13T16:55:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:18.654+0000 7fa66e000640 10 client.15549 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:19.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:19 smithi094 ceph-mon[35259]: pgmap v476: 129 pgs: 129 active+clean; 360 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 243 op/s 2024-09-13T16:55:19.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:19 smithi018 ceph-mon[30981]: pgmap v476: 129 pgs: 129 active+clean; 360 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 243 op/s 2024-09-13T16:55:19.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:19 smithi144 ceph-mon[35328]: pgmap v476: 129 pgs: 129 active+clean; 360 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 243 op/s 2024-09-13T16:55:21.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:21 smithi018 ceph-mon[30981]: pgmap v477: 129 pgs: 129 active+clean; 384 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 359 op/s 2024-09-13T16:55:21.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:21 smithi094 ceph-mon[35259]: pgmap v477: 129 pgs: 129 active+clean; 384 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 359 op/s 2024-09-13T16:55:21.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:21 smithi144 ceph-mon[35328]: pgmap v477: 129 pgs: 129 active+clean; 384 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 359 op/s 2024-09-13T16:55:23.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:23 smithi094 ceph-mon[35259]: pgmap v478: 129 pgs: 129 active+clean; 417 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.7 MiB/s wr, 598 op/s 2024-09-13T16:55:23.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:23 smithi018 ceph-mon[30981]: pgmap v478: 129 pgs: 129 active+clean; 417 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.7 MiB/s wr, 598 op/s 2024-09-13T16:55:23.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:23 smithi144 ceph-mon[35328]: pgmap v478: 129 pgs: 129 active+clean; 417 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.7 MiB/s wr, 598 op/s 2024-09-13T16:55:25.372 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:25 smithi018 ceph-mon[30981]: pgmap v479: 129 pgs: 129 active+clean; 422 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.1 MiB/s wr, 642 op/s 2024-09-13T16:55:25.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:25 smithi094 ceph-mon[35259]: pgmap v479: 129 pgs: 129 active+clean; 422 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.1 MiB/s wr, 642 op/s 2024-09-13T16:55:25.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:25 smithi144 ceph-mon[35328]: pgmap v479: 129 pgs: 129 active+clean; 422 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.1 MiB/s wr, 642 op/s 2024-09-13T16:55:26.267 INFO:tasks.workunit.client.0.smithi018.stdout: 112 493210 631 353564 488 137957 923 2024-09-13T16:55:27.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:27 smithi094 ceph-mon[35259]: pgmap v480: 129 pgs: 129 active+clean; 417 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.9 MiB/s wr, 690 op/s 2024-09-13T16:55:27.726 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:27 smithi018 ceph-mon[30981]: pgmap v480: 129 pgs: 129 active+clean; 417 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.9 MiB/s wr, 690 op/s 2024-09-13T16:55:27.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:27 smithi144 ceph-mon[35328]: pgmap v480: 129 pgs: 129 active+clean; 417 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.9 MiB/s wr, 690 op/s 2024-09-13T16:55:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.758+0000 7fa66e000640 1 -- 172.21.15.18:0/3013378294 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7fa67c003e30 con 0x55a108ad9c80 2024-09-13T16:55:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.758+0000 7fa66e000640 10 client.15549 handle_command_reply: tid=0 2024-09-13T16:55:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.774+0000 7fa68de05740 1 client.15549 shutdown 2024-09-13T16:55:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.799+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 msgr2=0x55a108a7d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.799+0000 7fa68de05740 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 0x55a108a7d670 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa674000c00 tx=0x7fa6740047d0 comp rx=0 tx=0).stop 2024-09-13T16:55:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.800+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 shutdown_connections 2024-09-13T16:55:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.800+0000 7fa68de05740 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55a108ad9c80 0x55a108adc0a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.800+0000 7fa68de05740 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a108a72440 0x55a108a7a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.800+0000 7fa68de05740 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a108a6d3b0 0x55a108a7dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.800+0000 7fa68de05740 1 --2- 172.21.15.18:0/3013378294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a108a6ca70 0x55a108a7d670 secure :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa674000c00 tx=0x7fa6740047d0 comp rx=0 tx=0).stop 2024-09-13T16:55:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.800+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 >> 172.21.15.18:0/3013378294 conn(0x55a108a680e0 msgr2=0x55a108a71750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.800+0000 7fa66e000640 0 client.15549 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.817+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 shutdown_connections 2024-09-13T16:55:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.829+0000 7fa68de05740 1 -- 172.21.15.18:0/3013378294 wait complete. 2024-09-13T16:55:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:55:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:55:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:55:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:55:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.877+0000 7fa68de05740 20 client.15549 trim_cache size 0 max 16384 2024-09-13T16:55:28.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.904+0000 7fa68b000640 1 -- 172.21.15.18:0/4049754277 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6680a1290 msgr2=0x7fa6680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:28.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.904+0000 7fa68b000640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6680a1290 0x7fa6680a3750 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa6841a5b80 tx=0x7fa674008040 comp rx=0 tx=0).stop 2024-09-13T16:55:28.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.904+0000 7fa68b000640 1 -- 172.21.15.18:0/4049754277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa684109870 msgr2=0x7fa6841a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:28.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.904+0000 7fa68b000640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa684109870 0x7fa6841a51f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa67000e9c0 tx=0x7fa67000ee80 comp rx=0 tx=0).stop 2024-09-13T16:55:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.921+0000 7fa68b000640 1 -- 172.21.15.18:0/4049754277 shutdown_connections 2024-09-13T16:55:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.921+0000 7fa68b000640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6680a1290 0x7fa6680a3750 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.921+0000 7fa68b000640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa684109870 0x7fa6841a51f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.921+0000 7fa68b000640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa68410c240 0x7fa6841ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.921+0000 7fa68b000640 1 --2- 172.21.15.18:0/4049754277 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa684071120 0x7fa6841a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.921+0000 7fa68b000640 1 -- 172.21.15.18:0/4049754277 >> 172.21.15.18:0/4049754277 conn(0x7fa68406cf30 msgr2=0x7fa68410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.925+0000 7fa68b000640 1 -- 172.21.15.18:0/4049754277 shutdown_connections 2024-09-13T16:55:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:28.931+0000 7fa68b000640 1 -- 172.21.15.18:0/4049754277 wait complete. 2024-09-13T16:55:29.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:29 smithi094 ceph-mon[35259]: pgmap v481: 129 pgs: 129 active+clean; 422 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 637 op/s 2024-09-13T16:55:29.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:29 smithi018 ceph-mon[30981]: pgmap v481: 129 pgs: 129 active+clean; 422 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 637 op/s 2024-09-13T16:55:29.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:29 smithi144 ceph-mon[35328]: pgmap v481: 129 pgs: 129 active+clean; 422 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 637 op/s 2024-09-13T16:55:30.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:30 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:55:30.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:30 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:55:30.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:30 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:55:31.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:31 smithi094 ceph-mon[35259]: pgmap v482: 129 pgs: 129 active+clean; 422 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.3 MiB/s wr, 595 op/s 2024-09-13T16:55:31.717 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:31 smithi018 ceph-mon[30981]: pgmap v482: 129 pgs: 129 active+clean; 422 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.3 MiB/s wr, 595 op/s 2024-09-13T16:55:31.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:31 smithi144 ceph-mon[35328]: pgmap v482: 129 pgs: 129 active+clean; 422 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.3 MiB/s wr, 595 op/s 2024-09-13T16:55:33.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:33 smithi018 ceph-mon[30981]: pgmap v483: 129 pgs: 129 active+clean; 426 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 473 op/s 2024-09-13T16:55:33.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:33 smithi094 ceph-mon[35259]: pgmap v483: 129 pgs: 129 active+clean; 426 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 473 op/s 2024-09-13T16:55:33.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:33 smithi144 ceph-mon[35328]: pgmap v483: 129 pgs: 129 active+clean; 426 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 473 op/s 2024-09-13T16:55:35.689 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:35 smithi018 ceph-mon[30981]: pgmap v484: 129 pgs: 129 active+clean; 427 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 222 op/s 2024-09-13T16:55:35.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:35 smithi144 ceph-mon[35328]: pgmap v484: 129 pgs: 129 active+clean; 427 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 222 op/s 2024-09-13T16:55:35.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:35 smithi094 ceph-mon[35259]: pgmap v484: 129 pgs: 129 active+clean; 427 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 222 op/s 2024-09-13T16:55:36.279 INFO:tasks.workunit.client.0.smithi018.stdout: 120 517425 518 354862 340 156382 736 2024-09-13T16:55:37.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:37 smithi018 ceph-mon[30981]: pgmap v485: 129 pgs: 129 active+clean; 445 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 248 op/s 2024-09-13T16:55:37.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:37 smithi144 ceph-mon[35328]: pgmap v485: 129 pgs: 129 active+clean; 445 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 248 op/s 2024-09-13T16:55:37.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:37 smithi094 ceph-mon[35259]: pgmap v485: 129 pgs: 129 active+clean; 445 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 248 op/s 2024-09-13T16:55:39.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:39 smithi018 ceph-mon[30981]: pgmap v486: 129 pgs: 129 active+clean; 459 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-09-13T16:55:39.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:39 smithi144 ceph-mon[35328]: pgmap v486: 129 pgs: 129 active+clean; 459 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-09-13T16:55:39.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:39 smithi094 ceph-mon[35259]: pgmap v486: 129 pgs: 129 active+clean; 459 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-09-13T16:55:41.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:41 smithi018 ceph-mon[30981]: pgmap v487: 129 pgs: 129 active+clean; 470 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 310 op/s 2024-09-13T16:55:41.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:41 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:55:41.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:41 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:55:41.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:41 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:55:41.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:41 smithi144 ceph-mon[35328]: pgmap v487: 129 pgs: 129 active+clean; 470 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 310 op/s 2024-09-13T16:55:41.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:41 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:55:41.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:41 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:55:41.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:41 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:55:41.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:41 smithi094 ceph-mon[35259]: pgmap v487: 129 pgs: 129 active+clean; 470 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 310 op/s 2024-09-13T16:55:41.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:41 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:55:41.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:41 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:55:41.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:41 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:55:43.451 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:43 smithi018 ceph-mon[30981]: pgmap v488: 129 pgs: 129 active+clean; 499 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.1 MiB/s wr, 450 op/s 2024-09-13T16:55:43.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:43 smithi144 ceph-mon[35328]: pgmap v488: 129 pgs: 129 active+clean; 499 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.1 MiB/s wr, 450 op/s 2024-09-13T16:55:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.823+0000 7f803b000640 1 -- 172.21.15.18:0/2097021713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8034107800 msgr2=0x7f8034107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.823+0000 7f803b000640 1 --2- 172.21.15.18:0/2097021713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8034107800 0x7f8034107c00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f80280098e0 tx=0x7f802802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:55:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.841+0000 7f803b000640 1 -- 172.21.15.18:0/2097021713 shutdown_connections 2024-09-13T16:55:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.841+0000 7f803b000640 1 --2- 172.21.15.18:0/2097021713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034071db0 0x7f8034112c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.841+0000 7f803b000640 1 --2- 172.21.15.18:0/2097021713 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80340713f0 0x7f8034071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.841+0000 7f803b000640 1 --2- 172.21.15.18:0/2097021713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8034107800 0x7f8034107c00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.841+0000 7f803b000640 1 -- 172.21.15.18:0/2097021713 >> 172.21.15.18:0/2097021713 conn(0x7f803406cd10 msgr2=0x7f803406f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.871+0000 7f803b000640 1 -- 172.21.15.18:0/2097021713 shutdown_connections 2024-09-13T16:55:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.883+0000 7f803b000640 1 -- 172.21.15.18:0/2097021713 wait complete. 2024-09-13T16:55:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.885+0000 7f803b000640 1 Processor -- start 2024-09-13T16:55:43.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:43 smithi094 ceph-mon[35259]: pgmap v488: 129 pgs: 129 active+clean; 499 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.1 MiB/s wr, 450 op/s 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.915+0000 7f803b000640 1 -- start start 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.915+0000 7f803b000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80340713f0 0x7f8034117440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.915+0000 7f803b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8034071db0 0x7f8034117980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.915+0000 7f803b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034107800 0x7f803411a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.915+0000 7f803b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803411af10 con 0x7f8034071db0 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.915+0000 7f803b000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803411b080 con 0x7f80340713f0 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.915+0000 7f803b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803411b240 con 0x7f8034107800 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.916+0000 7f8039200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8034071db0 0x7f8034117980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.916+0000 7f8039200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8034071db0 0x7f8034117980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54490/0 (socket says 172.21.15.18:54490) 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.916+0000 7f8039200640 1 -- 172.21.15.18:0/3366639256 learned_addr learned my addr 172.21.15.18:0/3366639256 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.917+0000 7f8039200640 1 -- 172.21.15.18:0/3366639256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034107800 msgr2=0x7f803411a9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:55:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.917+0000 7f8039200640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034107800 0x7f803411a9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.917+0000 7f8039200640 1 -- 172.21.15.18:0/3366639256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80340713f0 msgr2=0x7f8034117440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:55:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.917+0000 7f8039200640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80340713f0 0x7f8034117440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.917+0000 7f8039200640 1 -- 172.21.15.18:0/3366639256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8028009490 con 0x7f8034071db0 2024-09-13T16:55:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.918+0000 7f8039200640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8034071db0 0x7f8034117980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f802000da90 tx=0x7f802000df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.939+0000 7f8032000640 1 -- 172.21.15.18:0/3366639256 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8020009c00 con 0x7f8034071db0 2024-09-13T16:55:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.939+0000 7f8032000640 1 -- 172.21.15.18:0/3366639256 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8020009d60 con 0x7f8034071db0 2024-09-13T16:55:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.939+0000 7f8032000640 1 -- 172.21.15.18:0/3366639256 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000f7e0 con 0x7f8034071db0 2024-09-13T16:55:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.958+0000 7f803b000640 1 -- 172.21.15.18:0/3366639256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803411b520 con 0x7f8034071db0 2024-09-13T16:55:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:43.958+0000 7f803b000640 1 -- 172.21.15.18:0/3366639256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80341b57d0 con 0x7f8034071db0 2024-09-13T16:55:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.035+0000 7f803f433740 1 Processor -- start 2024-09-13T16:55:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.035+0000 7f803f433740 1 -- start start 2024-09-13T16:55:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.047+0000 7f803f433740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff68080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.050+0000 7f803f433740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff6d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.051+0000 7f803f433740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff6d650 0x55f1aff6fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.054+0000 7f8032000640 1 -- 172.21.15.18:0/3366639256 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8020010460 con 0x7f8034071db0 2024-09-13T16:55:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.054+0000 7f803f433740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1afe73bb0 con 0x55f1aff67c80 2024-09-13T16:55:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.054+0000 7f803f433740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1afed1a70 con 0x55f1aff685c0 2024-09-13T16:55:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.054+0000 7f803f433740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1afecf200 con 0x55f1aff6d650 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.058+0000 7f8039c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff6d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.058+0000 7f8039c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff6d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42710/0 (socket says 172.21.15.18:42710) 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.058+0000 7f8039c00640 1 -- 172.21.15.18:0/1271184739 learned_addr learned my addr 172.21.15.18:0/1271184739 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.059+0000 7f803a600640 1 --2- 172.21.15.18:0/1271184739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff68080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.059+0000 7f8039c00640 1 -- 172.21.15.18:0/1271184739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff6d650 msgr2=0x55f1aff6fb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.059+0000 7f8039c00640 1 --2- 172.21.15.18:0/1271184739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff6d650 0x55f1aff6fb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.059+0000 7f8039c00640 1 -- 172.21.15.18:0/1271184739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 msgr2=0x55f1aff68080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.059+0000 7f8039c00640 1 --2- 172.21.15.18:0/1271184739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff68080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.059+0000 7f8039c00640 1 -- 172.21.15.18:0/1271184739 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1afe6c940 con 0x55f1aff685c0 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.059+0000 7f803a600640 1 --2- 172.21.15.18:0/1271184739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff68080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.060+0000 7f8039c00640 1 --2- 172.21.15.18:0/1271184739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff6d080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8028005770 tx=0x7f8028030340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba3d5b9c3ba05cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.060+0000 7f8026a00640 1 -- 172.21.15.18:0/1271184739 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028032bd0 con 0x55f1aff685c0 2024-09-13T16:55:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.060+0000 7f8026a00640 1 -- 172.21.15.18:0/1271184739 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8028032d30 con 0x55f1aff685c0 2024-09-13T16:55:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.060+0000 7f8026a00640 1 -- 172.21.15.18:0/1271184739 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280042a0 con 0x55f1aff685c0 2024-09-13T16:55:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.071+0000 7f8032000640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f801c0a1370 0x7f801c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.071+0000 7f8032000640 1 -- 172.21.15.18:0/3366639256 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f80200cc2d0 con 0x7f8034071db0 2024-09-13T16:55:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.091+0000 7f803f433740 1 -- 172.21.15.18:0/1271184739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 msgr2=0x55f1aff6d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.091+0000 7f803f433740 1 --2- 172.21.15.18:0/1271184739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff6d080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8028005770 tx=0x7f8028030340 comp rx=0 tx=0).stop 2024-09-13T16:55:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.096+0000 7f803a600640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f801c0a1370 0x7f801c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.101+0000 7f803f433740 1 -- 172.21.15.18:0/1271184739 shutdown_connections 2024-09-13T16:55:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.101+0000 7f803f433740 1 --2- 172.21.15.18:0/1271184739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff6d650 0x55f1aff6fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.101+0000 7f803f433740 1 --2- 172.21.15.18:0/1271184739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff6d080 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.101+0000 7f803f433740 1 --2- 172.21.15.18:0/1271184739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff68080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.101+0000 7f803f433740 1 -- 172.21.15.18:0/1271184739 >> 172.21.15.18:0/1271184739 conn(0x55f1aff632f0 msgr2=0x55f1aff636f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.102+0000 7f803a600640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f801c0a1370 0x7f801c0a3830 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f802c005fd0 tx=0x7f802c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.105+0000 7f803f433740 1 -- 172.21.15.18:0/1271184739 shutdown_connections 2024-09-13T16:55:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.118+0000 7f803f433740 1 -- 172.21.15.18:0/1271184739 wait complete. 2024-09-13T16:55:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.120+0000 7f803f433740 1 -- start start 2024-09-13T16:55:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.121+0000 7f803f433740 1 Processor -- start 2024-09-13T16:55:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.126+0000 7f803f433740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff71940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.126+0000 7f803f433740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff685c0 0x55f1aff71e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.127+0000 7f8039c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff71940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.133+0000 7f8039c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff71940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54510/0 (socket says 172.21.15.18:54510) 2024-09-13T16:55:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.147+0000 7f803f433740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff78ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.147+0000 7f803f433740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1afecaaf0 con 0x55f1aff67c80 2024-09-13T16:55:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.147+0000 7f803f433740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1afe88f20 con 0x55f1aff6d650 2024-09-13T16:55:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.147+0000 7f803f433740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1afe88bc0 con 0x55f1aff685c0 2024-09-13T16:55:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.148+0000 7f803f433740 10 client.0 _ll_register_callbacks cb 0x55f1afebaa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:55:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.149+0000 7f803a600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff78ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.149+0000 7f803a600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff78ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42718/0 (socket says 172.21.15.18:42718) 2024-09-13T16:55:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.149+0000 7f803a600640 1 -- 172.21.15.18:0/3132394887 learned_addr learned my addr 172.21.15.18:0/3132394887 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.163+0000 7f803a600640 1 -- 172.21.15.18:0/3132394887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff685c0 msgr2=0x55f1aff71e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:55:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.163+0000 7f803a600640 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff685c0 0x55f1aff71e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.163+0000 7f803a600640 1 -- 172.21.15.18:0/3132394887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 msgr2=0x55f1aff71940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.163+0000 7f803a600640 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff71940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.163+0000 7f803a600640 1 -- 172.21.15.18:0/3132394887 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803410a7d0 con 0x55f1aff6d650 2024-09-13T16:55:44.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.184+0000 7f8039c00640 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff71940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-13T16:55:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.185+0000 7f803a600640 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff78ec0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f802c01be00 tx=0x7f802c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c048263683ac6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.185+0000 7f801b400640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:55:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.186+0000 7f801b400640 1 -- 172.21.15.18:0/3132394887 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c01be30 con 0x55f1aff6d650 2024-09-13T16:55:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.186+0000 7f801b400640 1 -- 172.21.15.18:0/3132394887 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f802c003990 con 0x55f1aff6d650 2024-09-13T16:55:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.209+0000 7f803f433740 1 -- 172.21.15.18:0/3132394887 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1afef4c90 con 0x55f1aff6d650 2024-09-13T16:55:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.222+0000 7f801b400640 1 -- 172.21.15.18:0/3132394887 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f802c003b50 con 0x55f1aff6d650 2024-09-13T16:55:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.230+0000 7f803f433740 10 client.25613 fetch_fsmap learned FSMap version 28 2024-09-13T16:55:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.230+0000 7f803f433740 1 -- 172.21.15.18:0/3132394887 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f1afec9170 con 0x55f1aff6d650 2024-09-13T16:55:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.232+0000 7f801b400640 1 -- 172.21.15.18:0/3132394887 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f1afef4c90 con 0x55f1aff6d650 2024-09-13T16:55:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.232+0000 7f801b400640 1 -- 172.21.15.18:0/3132394887 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f802c024600 con 0x55f1aff6d650 2024-09-13T16:55:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.233+0000 7f803f433740 10 client.25613 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:55:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.233+0000 7f803f433740 10 client.25613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:55:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.233+0000 7f803f433740 20 client.25613 populate_metadata read hostname 'smithi018' 2024-09-13T16:55:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.233+0000 7f803f433740 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55f1aff7d600 0x55f1aff7fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.233+0000 7f803f433740 4 client.25613 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:55:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.233+0000 7f803f433740 1 -- 172.21.15.18:0/3132394887 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1afebd7d0 con 0x55f1aff7d600 2024-09-13T16:55:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.234+0000 7f8039c00640 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55f1aff7d600 0x55f1aff7fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.250+0000 7f801b400640 10 client.25613 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.250+0000 7f8039c00640 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55f1aff7d600 0x55f1aff7fa20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d40744f682677cbb server_cookie=17d326756fb7988e in_seq=0 out_seq=0 2024-09-13T16:55:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.253+0000 7f801b400640 1 -- 172.21.15.18:0/3132394887 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f1afebd7d0 con 0x55f1aff7d600 2024-09-13T16:55:44.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.253+0000 7f801b400640 10 client.25613 handle_command_reply: tid=0 2024-09-13T16:55:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.254+0000 7f803f433740 1 client.25613 shutdown 2024-09-13T16:55:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.255+0000 7f803f433740 1 -- 172.21.15.18:0/3132394887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 msgr2=0x55f1aff78ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.255+0000 7f803f433740 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff78ec0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f802c01be00 tx=0x7f802c004ab0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.259+0000 7f803f433740 1 -- 172.21.15.18:0/3132394887 shutdown_connections 2024-09-13T16:55:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.259+0000 7f803f433740 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55f1aff7d600 0x55f1aff7fa20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.259+0000 7f803f433740 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff78ec0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.259+0000 7f803f433740 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff685c0 0x55f1aff71e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.259+0000 7f803f433740 1 --2- 172.21.15.18:0/3132394887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff71940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.259+0000 7f803f433740 1 -- 172.21.15.18:0/3132394887 >> 172.21.15.18:0/3132394887 conn(0x55f1aff632f0 msgr2=0x55f1aff64b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.262+0000 7f801b400640 0 client.25613 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.262+0000 7f803f433740 1 -- 172.21.15.18:0/3132394887 shutdown_connections 2024-09-13T16:55:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.262+0000 7f803f433740 1 -- 172.21.15.18:0/3132394887 wait complete. 2024-09-13T16:55:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.277+0000 7f803f433740 20 client.25613 trim_cache size 0 max 16384 2024-09-13T16:55:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.806+0000 7f803f433740 1 Processor -- start 2024-09-13T16:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.831+0000 7f803f433740 1 -- start start 2024-09-13T16:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.831+0000 7f803f433740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff69520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.831+0000 7f803f433740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff685c0 0x55f1aff78e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.831+0000 7f803f433740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff69a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.831+0000 7f803f433740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1afc31e60 con 0x55f1aff67c80 2024-09-13T16:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.831+0000 7f803f433740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1aff651b0 con 0x55f1aff6d650 2024-09-13T16:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.831+0000 7f803f433740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1aff70220 con 0x55f1aff685c0 2024-09-13T16:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.832+0000 7f803a600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff69a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.832+0000 7f803a600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff69a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42720/0 (socket says 172.21.15.18:42720) 2024-09-13T16:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.832+0000 7f803a600640 1 -- 172.21.15.18:0/2743746399 learned_addr learned my addr 172.21.15.18:0/2743746399 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.832+0000 7f8039200640 1 --2- 172.21.15.18:0/2743746399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff685c0 0x55f1aff78e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.832+0000 7f803a600640 1 -- 172.21.15.18:0/2743746399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff685c0 msgr2=0x55f1aff78e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.832+0000 7f803a600640 1 --2- 172.21.15.18:0/2743746399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff685c0 0x55f1aff78e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.832+0000 7f803a600640 1 -- 172.21.15.18:0/2743746399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 msgr2=0x55f1aff69520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:55:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.832+0000 7f803a600640 1 --2- 172.21.15.18:0/2743746399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff69520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.832+0000 7f803a600640 1 -- 172.21.15.18:0/2743746399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1afe6b180 con 0x55f1aff6d650 2024-09-13T16:55:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.838+0000 7f803a600640 1 --2- 172.21.15.18:0/2743746399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff69a60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f802c024990 tx=0x7f802c005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cdbdd3879c393bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.862+0000 7f8027400640 1 -- 172.21.15.18:0/2743746399 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c033070 con 0x55f1aff6d650 2024-09-13T16:55:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.862+0000 7f8027400640 1 -- 172.21.15.18:0/2743746399 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f802c024c80 con 0x55f1aff6d650 2024-09-13T16:55:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.862+0000 7f8027400640 1 -- 172.21.15.18:0/2743746399 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c003e50 con 0x55f1aff6d650 2024-09-13T16:55:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.899+0000 7f803f433740 1 -- 172.21.15.18:0/2743746399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 msgr2=0x55f1aff69a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.899+0000 7f803f433740 1 --2- 172.21.15.18:0/2743746399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff69a60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f802c024990 tx=0x7f802c005c70 comp rx=0 tx=0).stop 2024-09-13T16:55:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.915+0000 7f803f433740 1 -- 172.21.15.18:0/2743746399 shutdown_connections 2024-09-13T16:55:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.915+0000 7f803f433740 1 --2- 172.21.15.18:0/2743746399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff6d650 0x55f1aff69a60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.915+0000 7f803f433740 1 --2- 172.21.15.18:0/2743746399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff685c0 0x55f1aff78e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.915+0000 7f803f433740 1 --2- 172.21.15.18:0/2743746399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff69520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.915+0000 7f803f433740 1 -- 172.21.15.18:0/2743746399 >> 172.21.15.18:0/2743746399 conn(0x55f1aff632f0 msgr2=0x55f1aff636d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.921+0000 7f803f433740 1 -- 172.21.15.18:0/2743746399 shutdown_connections 2024-09-13T16:55:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.923+0000 7f803f433740 1 -- 172.21.15.18:0/2743746399 wait complete. 2024-09-13T16:55:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.923+0000 7f803f433740 1 -- start start 2024-09-13T16:55:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.923+0000 7f803f433740 1 Processor -- start 2024-09-13T16:55:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.941+0000 7f803f433740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff78a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.941+0000 7f803f433740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff78f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.941+0000 7f803f433740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff6d650 0x55f1aff75670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.941+0000 7f8039c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff78a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.941+0000 7f8039c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff78a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54524/0 (socket says 172.21.15.18:54524) 2024-09-13T16:55:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.942+0000 7f8039200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff78f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.942+0000 7f8039200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff78f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42732/0 (socket says 172.21.15.18:42732) 2024-09-13T16:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.942+0000 7f803f433740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1aff75d70 con 0x55f1aff67c80 2024-09-13T16:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.942+0000 7f803f433740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1aff75ee0 con 0x55f1aff685c0 2024-09-13T16:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.942+0000 7f803f433740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1aff760a0 con 0x55f1aff6d650 2024-09-13T16:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.942+0000 7f803f433740 10 client.0 _ll_register_callbacks cb 0x7f8028035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.942+0000 7f8039c00640 1 -- 172.21.15.18:0/3277486647 learned_addr learned my addr 172.21.15.18:0/3277486647 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.943+0000 7f8039c00640 1 -- 172.21.15.18:0/3277486647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff6d650 msgr2=0x55f1aff75670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.943+0000 7f8039c00640 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff6d650 0x55f1aff75670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.943+0000 7f8039c00640 1 -- 172.21.15.18:0/3277486647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 msgr2=0x55f1aff78f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.943+0000 7f8039c00640 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff78f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.943+0000 7f8039c00640 1 -- 172.21.15.18:0/3277486647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1afec9170 con 0x55f1aff67c80 2024-09-13T16:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.944+0000 7f8039c00640 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff78a10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f802802a910 tx=0x7f8028030fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83102034a3267ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:55:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.973+0000 7f801b400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:55:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.973+0000 7f801b400640 1 -- 172.21.15.18:0/3277486647 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028030930 con 0x55f1aff67c80 2024-09-13T16:55:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.973+0000 7f801b400640 1 -- 172.21.15.18:0/3277486647 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f8028030a90 con 0x55f1aff67c80 2024-09-13T16:55:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:44.999+0000 7f803f433740 1 -- 172.21.15.18:0/3277486647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8028032d30 con 0x55f1aff67c80 2024-09-13T16:55:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.011+0000 7f801b400640 1 -- 172.21.15.18:0/3277486647 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8028032440 con 0x55f1aff67c80 2024-09-13T16:55:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.033+0000 7f803f433740 10 client.15558 fetch_fsmap learned FSMap version 28 2024-09-13T16:55:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.033+0000 7f803f433740 1 -- 172.21.15.18:0/3277486647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f1afe90560 con 0x55f1aff67c80 2024-09-13T16:55:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.038+0000 7f801b400640 1 -- 172.21.15.18:0/3277486647 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8028032d30 con 0x55f1aff67c80 2024-09-13T16:55:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.038+0000 7f801b400640 1 -- 172.21.15.18:0/3277486647 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f8028052070 con 0x55f1aff67c80 2024-09-13T16:55:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.038+0000 7f803f433740 10 client.15558 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T16:55:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.038+0000 7f803f433740 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:55:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.038+0000 7f803f433740 20 client.15558 populate_metadata read hostname 'smithi018' 2024-09-13T16:55:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.038+0000 7f803f433740 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55f1affd5010 0x55f1affd7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:55:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.038+0000 7f803f433740 4 client.15558 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:55:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.038+0000 7f803f433740 1 -- 172.21.15.18:0/3277486647 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f1afbbe300 con 0x55f1affd5010 2024-09-13T16:55:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.039+0000 7f8039200640 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55f1affd5010 0x55f1affd7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:55:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.040+0000 7f8039200640 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55f1affd5010 0x55f1affd7430 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35950713bfb4020b server_cookie=602d6ee88ce4b39b in_seq=0 out_seq=0 2024-09-13T16:55:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:45.040+0000 7f801b400640 10 client.15558 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:45.720 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:45 smithi018 ceph-mon[30981]: pgmap v489: 129 pgs: 129 active+clean; 503 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 437 op/s 2024-09-13T16:55:45.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:45 smithi144 ceph-mon[35328]: pgmap v489: 129 pgs: 129 active+clean; 503 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 437 op/s 2024-09-13T16:55:45.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:45 smithi094 ceph-mon[35259]: pgmap v489: 129 pgs: 129 active+clean; 503 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 437 op/s 2024-09-13T16:55:46.279 INFO:tasks.workunit.client.0.smithi018.stdout: 126 485437 435 335783 399 160032 1017 2024-09-13T16:55:47.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:47 smithi144 ceph-mon[35328]: pgmap v490: 129 pgs: 129 active+clean; 511 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.7 MiB/s wr, 478 op/s 2024-09-13T16:55:47.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:47 smithi094 ceph-mon[35259]: pgmap v490: 129 pgs: 129 active+clean; 511 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.7 MiB/s wr, 478 op/s 2024-09-13T16:55:47.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:47 smithi018 ceph-mon[30981]: pgmap v490: 129 pgs: 129 active+clean; 511 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.7 MiB/s wr, 478 op/s 2024-09-13T16:55:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.682+0000 7f801b400640 1 -- 172.21.15.18:0/3277486647 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f1afbbe300 con 0x55f1affd5010 2024-09-13T16:55:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.682+0000 7f801b400640 10 client.15558 handle_command_reply: tid=0 2024-09-13T16:55:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.682+0000 7f803f433740 1 client.15558 shutdown 2024-09-13T16:55:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.684+0000 7f803f433740 1 -- 172.21.15.18:0/3277486647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 msgr2=0x55f1aff78a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.684+0000 7f803f433740 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff78a10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f802802a910 tx=0x7f8028030fa0 comp rx=0 tx=0).stop 2024-09-13T16:55:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.687+0000 7f803f433740 1 -- 172.21.15.18:0/3277486647 shutdown_connections 2024-09-13T16:55:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.687+0000 7f803f433740 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55f1affd5010 0x55f1affd7430 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.687+0000 7f803f433740 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1aff6d650 0x55f1aff75670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.687+0000 7f803f433740 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f1aff685c0 0x55f1aff78f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.687+0000 7f803f433740 1 --2- 172.21.15.18:0/3277486647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1aff67c80 0x55f1aff78a10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.688+0000 7f803f433740 1 -- 172.21.15.18:0/3277486647 >> 172.21.15.18:0/3277486647 conn(0x55f1aff632f0 msgr2=0x55f1aff69520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.688+0000 7f801b400640 0 client.15558 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:55:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.690+0000 7f803f433740 1 -- 172.21.15.18:0/3277486647 shutdown_connections 2024-09-13T16:55:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.696+0000 7f803f433740 1 -- 172.21.15.18:0/3277486647 wait complete. 2024-09-13T16:55:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.699+0000 7f803f433740 20 client.15558 trim_cache size 0 max 16384 2024-09-13T16:55:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:55:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:55:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:55:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:55:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.744+0000 7f803b000640 1 -- 172.21.15.18:0/3366639256 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f801c0a1370 msgr2=0x7f801c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.744+0000 7f803b000640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f801c0a1370 0x7f801c0a3830 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f802c005fd0 tx=0x7f802c0095c0 comp rx=0 tx=0).stop 2024-09-13T16:55:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.744+0000 7f803b000640 1 -- 172.21.15.18:0/3366639256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8034071db0 msgr2=0x7f8034117980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:55:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.744+0000 7f803b000640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8034071db0 0x7f8034117980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f802000da90 tx=0x7f802000df50 comp rx=0 tx=0).stop 2024-09-13T16:55:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.773+0000 7f803b000640 1 -- 172.21.15.18:0/3366639256 shutdown_connections 2024-09-13T16:55:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.773+0000 7f803b000640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f801c0a1370 0x7f801c0a3830 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.773+0000 7f803b000640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8034071db0 0x7f8034117980 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.773+0000 7f803b000640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034107800 0x7f803411a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.773+0000 7f803b000640 1 --2- 172.21.15.18:0/3366639256 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80340713f0 0x7f8034117440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:55:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.773+0000 7f803b000640 1 -- 172.21.15.18:0/3366639256 >> 172.21.15.18:0/3366639256 conn(0x7f803406cd10 msgr2=0x7f803406d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:55:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.784+0000 7f803b000640 1 -- 172.21.15.18:0/3366639256 shutdown_connections 2024-09-13T16:55:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:55:48.784+0000 7f803b000640 1 -- 172.21.15.18:0/3366639256 wait complete. 2024-09-13T16:55:49.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:49 smithi144 ceph-mon[35328]: pgmap v491: 129 pgs: 129 active+clean; 516 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.6 MiB/s wr, 584 op/s 2024-09-13T16:55:49.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:49 smithi094 ceph-mon[35259]: pgmap v491: 129 pgs: 129 active+clean; 516 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.6 MiB/s wr, 584 op/s 2024-09-13T16:55:49.984 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:49 smithi018 ceph-mon[30981]: pgmap v491: 129 pgs: 129 active+clean; 516 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.6 MiB/s wr, 584 op/s 2024-09-13T16:55:51.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:51 smithi018 ceph-mon[30981]: pgmap v492: 129 pgs: 129 active+clean; 518 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 837 op/s 2024-09-13T16:55:51.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:51 smithi144 ceph-mon[35328]: pgmap v492: 129 pgs: 129 active+clean; 518 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 837 op/s 2024-09-13T16:55:51.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:51 smithi094 ceph-mon[35259]: pgmap v492: 129 pgs: 129 active+clean; 518 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 837 op/s 2024-09-13T16:55:53.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:53 smithi144 ceph-mon[35328]: pgmap v493: 129 pgs: 129 active+clean; 510 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 1.17k op/s 2024-09-13T16:55:53.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:53 smithi094 ceph-mon[35259]: pgmap v493: 129 pgs: 129 active+clean; 510 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 1.17k op/s 2024-09-13T16:55:53.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:53 smithi018 ceph-mon[30981]: pgmap v493: 129 pgs: 129 active+clean; 510 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 1.17k op/s 2024-09-13T16:55:54.784 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:54 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:55:54.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:54 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:55:55.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:54 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:55:55.687 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:55 smithi018 ceph-mon[30981]: pgmap v494: 129 pgs: 129 active+clean; 509 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 1.03k op/s 2024-09-13T16:55:55.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:55 smithi094 ceph-mon[35259]: pgmap v494: 129 pgs: 129 active+clean; 509 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 1.03k op/s 2024-09-13T16:55:56.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:55 smithi144 ceph-mon[35328]: pgmap v494: 129 pgs: 129 active+clean; 509 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 1.03k op/s 2024-09-13T16:55:56.279 INFO:tasks.workunit.client.0.smithi018.stdout: 135 482024 562 336568 532 162960 1445 2024-09-13T16:55:57.685 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:57 smithi018 ceph-mon[30981]: pgmap v495: 129 pgs: 129 active+clean; 521 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 1.05k op/s 2024-09-13T16:55:57.824 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:57 smithi144 ceph-mon[35328]: pgmap v495: 129 pgs: 129 active+clean; 521 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 1.05k op/s 2024-09-13T16:55:57.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:57 smithi094 ceph-mon[35259]: pgmap v495: 129 pgs: 129 active+clean; 521 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 1.05k op/s 2024-09-13T16:55:59.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:55:59 smithi094 ceph-mon[35259]: pgmap v496: 129 pgs: 129 active+clean; 534 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 1.12k op/s 2024-09-13T16:55:59.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:55:59 smithi018 ceph-mon[30981]: pgmap v496: 129 pgs: 129 active+clean; 534 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 1.12k op/s 2024-09-13T16:56:00.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:55:59 smithi144 ceph-mon[35328]: pgmap v496: 129 pgs: 129 active+clean; 534 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 1.12k op/s 2024-09-13T16:56:01.589 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:01 smithi018 ceph-mon[30981]: pgmap v497: 129 pgs: 129 active+clean; 549 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 1.00k op/s 2024-09-13T16:56:01.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:01 smithi094 ceph-mon[35259]: pgmap v497: 129 pgs: 129 active+clean; 549 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 1.00k op/s 2024-09-13T16:56:02.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:01 smithi144 ceph-mon[35328]: pgmap v497: 129 pgs: 129 active+clean; 549 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 1.00k op/s 2024-09-13T16:56:03.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:03 smithi094 ceph-mon[35259]: pgmap v498: 129 pgs: 129 active+clean; 568 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 794 op/s 2024-09-13T16:56:03.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:03 smithi018 ceph-mon[30981]: pgmap v498: 129 pgs: 129 active+clean; 568 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 794 op/s 2024-09-13T16:56:04.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:03 smithi144 ceph-mon[35328]: pgmap v498: 129 pgs: 129 active+clean; 568 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 794 op/s 2024-09-13T16:56:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.260+0000 7f9e2d400640 1 -- 172.21.15.18:0/4194139813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e28070f40 msgr2=0x7f9e28071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.260+0000 7f9e2d400640 1 --2- 172.21.15.18:0/4194139813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e28070f40 0x7f9e28071320 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009c30 tx=0x7f9e2002a740 comp rx=0 tx=0).stop 2024-09-13T16:56:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.277+0000 7f9e2d400640 1 -- 172.21.15.18:0/4194139813 shutdown_connections 2024-09-13T16:56:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.277+0000 7f9e2d400640 1 --2- 172.21.15.18:0/4194139813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e2810bdc0 0x7f9e2810e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.277+0000 7f9e2d400640 1 --2- 172.21.15.18:0/4194139813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e28071860 0x7f9e2810b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.277+0000 7f9e2d400640 1 --2- 172.21.15.18:0/4194139813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e28070f40 0x7f9e28071320 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.277+0000 7f9e2d400640 1 -- 172.21.15.18:0/4194139813 >> 172.21.15.18:0/4194139813 conn(0x7f9e2806cd10 msgr2=0x7f9e2806f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:05.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.322+0000 7f9e2d400640 1 -- 172.21.15.18:0/4194139813 shutdown_connections 2024-09-13T16:56:05.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.327+0000 7f9e2d400640 1 -- 172.21.15.18:0/4194139813 wait complete. 2024-09-13T16:56:05.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.328+0000 7f9e2d400640 1 Processor -- start 2024-09-13T16:56:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.353+0000 7f9e2d400640 1 -- start start 2024-09-13T16:56:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.353+0000 7f9e2d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e28070f40 0x7f9e2819c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.353+0000 7f9e2d400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e28071860 0x7f9e2819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.353+0000 7f9e2d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e2810bdc0 0x7f9e281a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.353+0000 7f9e2d400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e281a3cb0 con 0x7f9e2810bdc0 2024-09-13T16:56:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.353+0000 7f9e2d400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e281a3e20 con 0x7f9e28071860 2024-09-13T16:56:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.353+0000 7f9e2d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e281a3fe0 con 0x7f9e28070f40 2024-09-13T16:56:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.354+0000 7f9e2ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e2810bdc0 0x7f9e281a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.358+0000 7f9e2ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e2810bdc0 0x7f9e281a3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59020/0 (socket says 172.21.15.18:59020) 2024-09-13T16:56:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.358+0000 7f9e2ca00640 1 -- 172.21.15.18:0/952718572 learned_addr learned my addr 172.21.15.18:0/952718572 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.360+0000 7f9e27e00640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e28070f40 0x7f9e2819c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.364+0000 7f9e27400640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e28071860 0x7f9e2819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.366+0000 7f9e27400640 1 -- 172.21.15.18:0/952718572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e28070f40 msgr2=0x7f9e2819c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:05.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.366+0000 7f9e27400640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e28070f40 0x7f9e2819c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.366+0000 7f9e27400640 1 -- 172.21.15.18:0/952718572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e2810bdc0 msgr2=0x7f9e281a3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:05.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.366+0000 7f9e27400640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e2810bdc0 0x7f9e281a3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.366+0000 7f9e27400640 1 -- 172.21.15.18:0/952718572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e20009840 con 0x7f9e28071860 2024-09-13T16:56:05.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.367+0000 7f9e27400640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e28071860 0x7f9e2819cd50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009fd0 tx=0x7f9e1800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:05.378 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.377+0000 7f9e2ca00640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e2810bdc0 0x7f9e281a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:56:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.377+0000 7f9e24c00640 1 -- 172.21.15.18:0/952718572 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18011830 con 0x7f9e28071860 2024-09-13T16:56:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.377+0000 7f9e24c00640 1 -- 172.21.15.18:0/952718572 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e18011e50 con 0x7f9e28071860 2024-09-13T16:56:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.377+0000 7f9e24c00640 1 -- 172.21.15.18:0/952718572 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800f2e0 con 0x7f9e28071860 2024-09-13T16:56:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.388+0000 7f9e2d400640 1 -- 172.21.15.18:0/952718572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e281a42c0 con 0x7f9e28071860 2024-09-13T16:56:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.388+0000 7f9e2d400640 1 -- 172.21.15.18:0/952718572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e281a47d0 con 0x7f9e28071860 2024-09-13T16:56:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.436+0000 7f9e319bf740 1 Processor -- start 2024-09-13T16:56:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.444+0000 7f9e319bf740 1 -- start start 2024-09-13T16:56:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.444+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c818189c80 0x55c81818a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.446+0000 7f9e24c00640 1 -- 172.21.15.18:0/952718572 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9e18011990 con 0x7f9e28071860 2024-09-13T16:56:05.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.454+0000 7f9e24c00640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9e0c0a1370 0x7f9e0c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.455+0000 7f9e27e00640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9e0c0a1370 0x7f9e0c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.456+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.456+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 0x55c818191b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.456+0000 7f9e319bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c818095bb0 con 0x55c81818f650 2024-09-13T16:56:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.456+0000 7f9e319bf740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8180f3a70 con 0x55c81818a5c0 2024-09-13T16:56:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.456+0000 7f9e319bf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8180f1200 con 0x55c818189c80 2024-09-13T16:56:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.456+0000 7f9e2ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 0x55c818191b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.456+0000 7f9e2ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c818189c80 0x55c81818a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.458+0000 7f9e24c00640 1 -- 172.21.15.18:0/952718572 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9e180cc6e0 con 0x7f9e28071860 2024-09-13T16:56:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.458+0000 7f9e27e00640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9e0c0a1370 0x7f9e0c0a3830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9e20006010 tx=0x7f9e20000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:05.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.466+0000 7f9e27400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.466+0000 7f9e27400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42474/0 (socket says 172.21.15.18:42474) 2024-09-13T16:56:05.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.466+0000 7f9e27400640 1 -- 172.21.15.18:0/2155303531 learned_addr learned my addr 172.21.15.18:0/2155303531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:05.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.466+0000 7f9e27400640 1 -- 172.21.15.18:0/2155303531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c818189c80 msgr2=0x55c81818a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:05.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.466+0000 7f9e27400640 1 --2- 172.21.15.18:0/2155303531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c818189c80 0x55c81818a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.466+0000 7f9e27400640 1 -- 172.21.15.18:0/2155303531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 msgr2=0x55c818191b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:05.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.468+0000 7f9e27400640 1 --2- 172.21.15.18:0/2155303531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 0x55c818191b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.468+0000 7f9e27400640 1 -- 172.21.15.18:0/2155303531 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c81808e940 con 0x55c81818a5c0 2024-09-13T16:56:05.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.468+0000 7f9e2ca00640 1 --2- 172.21.15.18:0/2155303531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 0x55c818191b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:56:05.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.469+0000 7f9e27400640 1 --2- 172.21.15.18:0/2155303531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818f080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9e180c9dc0 tx=0x7f9e180108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12dd67ab400d0f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.474+0000 7f9e1d600640 1 -- 172.21.15.18:0/2155303531 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18099e70 con 0x55c81818a5c0 2024-09-13T16:56:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.474+0000 7f9e1d600640 1 -- 172.21.15.18:0/2155303531 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e18099770 con 0x55c81818a5c0 2024-09-13T16:56:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.474+0000 7f9e1d600640 1 -- 172.21.15.18:0/2155303531 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e180105f0 con 0x55c81818a5c0 2024-09-13T16:56:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.479+0000 7f9e319bf740 1 -- 172.21.15.18:0/2155303531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 msgr2=0x55c81818f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.479+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2155303531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818f080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9e180c9dc0 tx=0x7f9e180108c0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.483+0000 7f9e319bf740 1 -- 172.21.15.18:0/2155303531 shutdown_connections 2024-09-13T16:56:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.483+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2155303531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 0x55c818191b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.483+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2155303531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818f080 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.483+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2155303531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c818189c80 0x55c81818a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.483+0000 7f9e319bf740 1 -- 172.21.15.18:0/2155303531 >> 172.21.15.18:0/2155303531 conn(0x55c8181852f0 msgr2=0x55c8181856f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:05.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.483+0000 7f9e319bf740 1 -- 172.21.15.18:0/2155303531 shutdown_connections 2024-09-13T16:56:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.487+0000 7f9e319bf740 1 -- 172.21.15.18:0/2155303531 wait complete. 2024-09-13T16:56:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.487+0000 7f9e319bf740 1 -- start start 2024-09-13T16:56:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.488+0000 7f9e319bf740 1 Processor -- start 2024-09-13T16:56:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.489+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c818189c80 0x55c8181939d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.489+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c818193f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.490+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c818189c80 0x55c8181939d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.490+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c818189c80 0x55c8181939d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59044/0 (socket says 172.21.15.18:59044) 2024-09-13T16:56:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.490+0000 7f9e27e00640 1 -- 172.21.15.18:0/3083176320 learned_addr learned my addr 172.21.15.18:0/3083176320 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.491+0000 7f9e319bf740 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818f650 0x55c81819af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.491+0000 7f9e27400640 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c818193f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.491+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8180ecaf0 con 0x55c818189c80 2024-09-13T16:56:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.491+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8180aaf20 con 0x55c81818a5c0 2024-09-13T16:56:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.491+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8180aabc0 con 0x55c81818f650 2024-09-13T16:56:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.492+0000 7f9e2ca00640 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818f650 0x55c81819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.493+0000 7f9e27e00640 1 -- 172.21.15.18:0/3083176320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818f650 msgr2=0x55c81819af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.493+0000 7f9e27e00640 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818f650 0x55c81819af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.493+0000 7f9e27e00640 1 -- 172.21.15.18:0/3083176320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 msgr2=0x55c818193f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.493+0000 7f9e27e00640 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c818193f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.493+0000 7f9e27e00640 1 -- 172.21.15.18:0/3083176320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e281a47d0 con 0x55c818189c80 2024-09-13T16:56:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.494+0000 7f9e27e00640 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c818189c80 0x55c8181939d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009c30 tx=0x7f9e2002a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6097dda9a257881 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.495+0000 7f9e319bf740 10 client.0 _ll_register_callbacks cb 0x55c8180dca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:56:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.495+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c818116c90 con 0x55c818189c80 2024-09-13T16:56:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.506+0000 7f9e12000640 10 client.15570 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:56:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.506+0000 7f9e12000640 1 -- 172.21.15.18:0/3083176320 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20004510 con 0x55c818189c80 2024-09-13T16:56:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.506+0000 7f9e12000640 1 -- 172.21.15.18:0/3083176320 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9e20043070 con 0x55c818189c80 2024-09-13T16:56:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.506+0000 7f9e12000640 1 -- 172.21.15.18:0/3083176320 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e20004670 con 0x55c818189c80 2024-09-13T16:56:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.522+0000 7f9e319bf740 10 client.15570 fetch_fsmap learned FSMap version 29 2024-09-13T16:56:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.522+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=29}) v3 -- 0x55c8180eb170 con 0x55c818189c80 2024-09-13T16:56:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.523+0000 7f9e12000640 1 -- 172.21.15.18:0/3083176320 <== mon.0 v2:172.21.15.18:3300/0 4 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9e2004a450 con 0x55c818189c80 2024-09-13T16:56:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.523+0000 7f9e319bf740 10 client.15570 fetch_fsmap finished waiting for FSMap version 29 2024-09-13T16:56:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.523+0000 7f9e319bf740 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:56:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.523+0000 7f9e319bf740 20 client.15570 populate_metadata read hostname 'smithi018' 2024-09-13T16:56:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.523+0000 7f9e319bf740 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55c81819f2b0 0x55c8181a1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.524+0000 7f9e319bf740 4 client.15570 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:56:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.524+0000 7f9e27400640 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55c81819f2b0 0x55c8181a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.524+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8180df7d0 con 0x55c81819f2b0 2024-09-13T16:56:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.524+0000 7f9e27400640 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55c81819f2b0 0x55c8181a1770 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c96ae7a66d7488b9 server_cookie=3fb1ff36ff0daf88 in_seq=0 out_seq=0 2024-09-13T16:56:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.524+0000 7f9e12000640 10 client.15570 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.528+0000 7f9e12000640 1 -- 172.21.15.18:0/3083176320 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c8180df7d0 con 0x55c81819f2b0 2024-09-13T16:56:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.528+0000 7f9e12000640 10 client.15570 handle_command_reply: tid=0 2024-09-13T16:56:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.532+0000 7f9e319bf740 1 client.15570 shutdown 2024-09-13T16:56:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.536+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c818189c80 msgr2=0x55c8181939d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.536+0000 7f9e319bf740 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c818189c80 0x55c8181939d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009c30 tx=0x7f9e2002a740 comp rx=0 tx=0).stop 2024-09-13T16:56:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.536+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 shutdown_connections 2024-09-13T16:56:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.536+0000 7f9e319bf740 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55c81819f2b0 0x55c8181a1770 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.536+0000 7f9e319bf740 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818f650 0x55c81819af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.536+0000 7f9e319bf740 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c818193f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.536+0000 7f9e319bf740 1 --2- 172.21.15.18:0/3083176320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c818189c80 0x55c8181939d0 secure :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009c30 tx=0x7f9e2002a740 comp rx=0 tx=0).stop 2024-09-13T16:56:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.536+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 >> 172.21.15.18:0/3083176320 conn(0x55c8181852f0 msgr2=0x55c818186b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.536+0000 7f9e12000640 0 client.15570 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.539+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 shutdown_connections 2024-09-13T16:56:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.539+0000 7f9e319bf740 1 -- 172.21.15.18:0/3083176320 wait complete. 2024-09-13T16:56:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.539+0000 7f9e319bf740 20 client.15570 trim_cache size 0 max 16384 2024-09-13T16:56:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.761+0000 7f9e319bf740 1 Processor -- start 2024-09-13T16:56:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.783+0000 7f9e319bf740 1 -- start start 2024-09-13T16:56:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.783+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.783+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 0x55c81819ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.784+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.784+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42484/0 (socket says 172.21.15.18:42484) 2024-09-13T16:56:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.785+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818bba0 0x55c818193780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.785+0000 7f9e319bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c817e53e60 con 0x55c81818f650 2024-09-13T16:56:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.785+0000 7f9e319bf740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c818193540 con 0x55c81818a5c0 2024-09-13T16:56:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.785+0000 7f9e319bf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c81818c070 con 0x55c81818bba0 2024-09-13T16:56:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.786+0000 7f9e27400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 0x55c81819ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.786+0000 7f9e2ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818bba0 0x55c818193780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.786+0000 7f9e2ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818bba0 0x55c818193780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:48578/0 (socket says 172.21.15.18:48578) 2024-09-13T16:56:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.786+0000 7f9e2ca00640 1 -- 172.21.15.18:0/2413911076 learned_addr learned my addr 172.21.15.18:0/2413911076 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.787+0000 7f9e27400640 1 -- 172.21.15.18:0/2413911076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818bba0 msgr2=0x55c818193780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.787+0000 7f9e27400640 1 --2- 172.21.15.18:0/2413911076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818bba0 0x55c818193780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.787+0000 7f9e27400640 1 -- 172.21.15.18:0/2413911076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 msgr2=0x55c81818b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.787+0000 7f9e27400640 1 --2- 172.21.15.18:0/2413911076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.787+0000 7f9e27400640 1 -- 172.21.15.18:0/2413911076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c81808d180 con 0x55c81818f650 2024-09-13T16:56:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.791+0000 7f9e27400640 1 --2- 172.21.15.18:0/2413911076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 0x55c81819ae20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9e18099470 tx=0x7f9e180108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec34f1235ee343 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.791+0000 7f9e27e00640 1 --2- 172.21.15.18:0/2413911076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-13T16:56:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.791+0000 7f9e1e000640 1 -- 172.21.15.18:0/2413911076 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e180ad410 con 0x55c81818f650 2024-09-13T16:56:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.792+0000 7f9e1e000640 1 -- 172.21.15.18:0/2413911076 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e180a1bf0 con 0x55c81818f650 2024-09-13T16:56:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.792+0000 7f9e1e000640 1 -- 172.21.15.18:0/2413911076 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e180b90b0 con 0x55c81818f650 2024-09-13T16:56:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.804+0000 7f9e319bf740 1 -- 172.21.15.18:0/2413911076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 msgr2=0x55c81819ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.804+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2413911076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 0x55c81819ae20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9e18099470 tx=0x7f9e180108c0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.804+0000 7f9e319bf740 1 -- 172.21.15.18:0/2413911076 shutdown_connections 2024-09-13T16:56:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.804+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2413911076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81818f650 0x55c81819ae20 secure :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9e18099470 tx=0x7f9e180108c0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.804+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2413911076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818bba0 0x55c818193780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.804+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2413911076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818a5c0 0x55c81818b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.804+0000 7f9e319bf740 1 -- 172.21.15.18:0/2413911076 >> 172.21.15.18:0/2413911076 conn(0x55c8181852f0 msgr2=0x55c8181a6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.808+0000 7f9e319bf740 1 -- 172.21.15.18:0/2413911076 shutdown_connections 2024-09-13T16:56:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.808+0000 7f9e319bf740 1 -- 172.21.15.18:0/2413911076 wait complete. 2024-09-13T16:56:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.808+0000 7f9e319bf740 1 -- start start 2024-09-13T16:56:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.809+0000 7f9e319bf740 1 Processor -- start 2024-09-13T16:56:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.811+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818a5c0 0x55c818199840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.813+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818bba0 0x55c818199d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.813+0000 7f9e319bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81819a2c0 0x55c8181f5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.813+0000 7f9e27400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818bba0 0x55c818199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.813+0000 7f9e27400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818bba0 0x55c818199d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:42486/0 (socket says 172.21.15.18:42486) 2024-09-13T16:56:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.814+0000 7f9e2ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81819a2c0 0x55c8181f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.814+0000 7f9e2ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81819a2c0 0x55c8181f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59064/0 (socket says 172.21.15.18:59064) 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.814+0000 7f9e319bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8181f5dc0 con 0x55c81819a2c0 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.814+0000 7f9e319bf740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8181f5f00 con 0x55c81818bba0 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.814+0000 7f9e319bf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8181f6070 con 0x55c81818a5c0 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.814+0000 7f9e319bf740 10 client.0 _ll_register_callbacks cb 0x7f9e18010fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.814+0000 7f9e27400640 1 -- 172.21.15.18:0/2189318346 learned_addr learned my addr 172.21.15.18:0/2189318346 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.814+0000 7f9e27e00640 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818a5c0 0x55c818199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.815+0000 7f9e27400640 1 -- 172.21.15.18:0/2189318346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818a5c0 msgr2=0x55c818199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.815+0000 7f9e27400640 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818a5c0 0x55c818199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.815+0000 7f9e27400640 1 -- 172.21.15.18:0/2189318346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81819a2c0 msgr2=0x55c8181f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.815+0000 7f9e27400640 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81819a2c0 0x55c8181f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.815+0000 7f9e27400640 1 -- 172.21.15.18:0/2189318346 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c81808e940 con 0x55c81818bba0 2024-09-13T16:56:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.815+0000 7f9e2ca00640 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81819a2c0 0x55c8181f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:56:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.815+0000 7f9e27400640 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818bba0 0x55c818199d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9e18096150 tx=0x7f9e18006cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=534adebbe39ff261 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.817+0000 7f9e12000640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:56:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.817+0000 7f9e12000640 1 -- 172.21.15.18:0/2189318346 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e180ad410 con 0x55c81818bba0 2024-09-13T16:56:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.817+0000 7f9e12000640 1 -- 172.21.15.18:0/2189318346 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9e180a1e40 con 0x55c81818bba0 2024-09-13T16:56:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.821+0000 7f9e319bf740 1 -- 172.21.15.18:0/2189318346 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c81819b920 con 0x55c81818bba0 2024-09-13T16:56:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.822+0000 7f9e12000640 1 -- 172.21.15.18:0/2189318346 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e180cc400 con 0x55c81818bba0 2024-09-13T16:56:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.823+0000 7f9e319bf740 10 client.25631 fetch_fsmap learned FSMap version 29 2024-09-13T16:56:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.823+0000 7f9e319bf740 1 -- 172.21.15.18:0/2189318346 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c8180b2560 con 0x55c81818bba0 2024-09-13T16:56:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.823+0000 7f9e12000640 1 -- 172.21.15.18:0/2189318346 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c81819b920 con 0x55c81818bba0 2024-09-13T16:56:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.823+0000 7f9e12000640 1 -- 172.21.15.18:0/2189318346 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9e1809d170 con 0x55c81818bba0 2024-09-13T16:56:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.823+0000 7f9e319bf740 10 client.25631 fetch_fsmap finished waiting for FSMap version 29 2024-09-13T16:56:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.823+0000 7f9e319bf740 10 client.25631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:56:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.823+0000 7f9e319bf740 20 client.25631 populate_metadata read hostname 'smithi018' 2024-09-13T16:56:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.823+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55c8181f74f0 0x55c8181f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.823+0000 7f9e319bf740 4 client.25631 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:56:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.823+0000 7f9e319bf740 1 -- 172.21.15.18:0/2189318346 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f9e18099770 con 0x55c8181f74f0 2024-09-13T16:56:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.824+0000 7f9e27e00640 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55c8181f74f0 0x55c8181f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.825+0000 7f9e12000640 10 client.25631 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:05.838+0000 7f9e27e00640 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55c8181f74f0 0x55c8181f98e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1febd95b6a670958 server_cookie=f683dc58bbe30bba in_seq=0 out_seq=0 2024-09-13T16:56:05.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:05 smithi094 ceph-mon[35259]: pgmap v499: 129 pgs: 129 active+clean; 580 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 430 op/s 2024-09-13T16:56:05.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:05 smithi018 ceph-mon[30981]: pgmap v499: 129 pgs: 129 active+clean; 580 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 430 op/s 2024-09-13T16:56:06.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:05 smithi144 ceph-mon[35328]: pgmap v499: 129 pgs: 129 active+clean; 580 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 430 op/s 2024-09-13T16:56:06.283 INFO:tasks.workunit.client.0.smithi018.stdout: 142 475748 491 335808 447 180210 920 2024-09-13T16:56:07.749 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:07 smithi018 ceph-mon[30981]: pgmap v500: 129 pgs: 129 active+clean; 591 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.6 MiB/s wr, 486 op/s 2024-09-13T16:56:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.736+0000 7f9e12000640 1 -- 172.21.15.18:0/2189318346 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f9e18099770 con 0x55c8181f74f0 2024-09-13T16:56:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.736+0000 7f9e12000640 10 client.25631 handle_command_reply: tid=0 2024-09-13T16:56:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.766+0000 7f9e319bf740 1 client.25631 shutdown 2024-09-13T16:56:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.818+0000 7f9e319bf740 1 -- 172.21.15.18:0/2189318346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818bba0 msgr2=0x55c818199d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.818+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818bba0 0x55c818199d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9e18096150 tx=0x7f9e18006cb0 comp rx=0 tx=0).stop 2024-09-13T16:56:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.840+0000 7f9e319bf740 1 -- 172.21.15.18:0/2189318346 shutdown_connections 2024-09-13T16:56:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.840+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55c8181f74f0 0x55c8181f98e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.840+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c81819a2c0 0x55c8181f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.840+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55c81818bba0 0x55c818199d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.840+0000 7f9e319bf740 1 --2- 172.21.15.18:0/2189318346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c81818a5c0 0x55c818199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.840+0000 7f9e319bf740 1 -- 172.21.15.18:0/2189318346 >> 172.21.15.18:0/2189318346 conn(0x55c8181852f0 msgr2=0x55c818183c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.840+0000 7f9e12000640 0 client.25631 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.868+0000 7f9e319bf740 1 -- 172.21.15.18:0/2189318346 shutdown_connections 2024-09-13T16:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.876+0000 7f9e319bf740 1 -- 172.21.15.18:0/2189318346 wait complete. 2024-09-13T16:56:07.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:07 smithi094 ceph-mon[35259]: pgmap v500: 129 pgs: 129 active+clean; 591 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.6 MiB/s wr, 486 op/s 2024-09-13T16:56:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.927+0000 7f9e319bf740 20 client.25631 trim_cache size 0 max 16384 2024-09-13T16:56:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:56:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:56:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:56:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:56:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.979+0000 7f9e2d400640 1 -- 172.21.15.18:0/952718572 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9e0c0a1370 msgr2=0x7f9e0c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.979+0000 7f9e2d400640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9e0c0a1370 0x7f9e0c0a3830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9e20006010 tx=0x7f9e20000f40 comp rx=0 tx=0).stop 2024-09-13T16:56:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.979+0000 7f9e2d400640 1 -- 172.21.15.18:0/952718572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e28071860 msgr2=0x7f9e2819cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.979+0000 7f9e2d400640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e28071860 0x7f9e2819cd50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009fd0 tx=0x7f9e1800b870 comp rx=0 tx=0).stop 2024-09-13T16:56:07.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.990+0000 7f9e2d400640 1 -- 172.21.15.18:0/952718572 shutdown_connections 2024-09-13T16:56:07.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.990+0000 7f9e2d400640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f9e0c0a1370 0x7f9e0c0a3830 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:07.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.990+0000 7f9e2d400640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e2810bdc0 0x7f9e281a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:07.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.990+0000 7f9e2d400640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e28071860 0x7f9e2819cd50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:07.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.990+0000 7f9e2d400640 1 --2- 172.21.15.18:0/952718572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e28070f40 0x7f9e2819c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:07.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:07.990+0000 7f9e2d400640 1 -- 172.21.15.18:0/952718572 >> 172.21.15.18:0/952718572 conn(0x7f9e2806cd10 msgr2=0x7f9e2806ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:08.005+0000 7f9e2d400640 1 -- 172.21.15.18:0/952718572 shutdown_connections 2024-09-13T16:56:08.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:08.015+0000 7f9e2d400640 1 -- 172.21.15.18:0/952718572 wait complete. 2024-09-13T16:56:08.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:07 smithi144 ceph-mon[35328]: pgmap v500: 129 pgs: 129 active+clean; 591 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.6 MiB/s wr, 486 op/s 2024-09-13T16:56:09.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:09 smithi094 ceph-mon[35259]: pgmap v501: 129 pgs: 129 active+clean; 597 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.2 MiB/s wr, 647 op/s 2024-09-13T16:56:09.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:09 smithi018 ceph-mon[30981]: pgmap v501: 129 pgs: 129 active+clean; 597 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.2 MiB/s wr, 647 op/s 2024-09-13T16:56:10.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:09 smithi144 ceph-mon[35328]: pgmap v501: 129 pgs: 129 active+clean; 597 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.2 MiB/s wr, 647 op/s 2024-09-13T16:56:11.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:11 smithi094 ceph-mon[35259]: pgmap v502: 129 pgs: 129 active+clean; 591 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.2 MiB/s wr, 705 op/s 2024-09-13T16:56:11.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:11 smithi018 ceph-mon[30981]: pgmap v502: 129 pgs: 129 active+clean; 591 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.2 MiB/s wr, 705 op/s 2024-09-13T16:56:12.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:11 smithi144 ceph-mon[35328]: pgmap v502: 129 pgs: 129 active+clean; 591 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.2 MiB/s wr, 705 op/s 2024-09-13T16:56:13.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:13 smithi094 ceph-mon[35259]: pgmap v503: 129 pgs: 129 active+clean; 588 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 732 op/s 2024-09-13T16:56:13.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:13 smithi018 ceph-mon[30981]: pgmap v503: 129 pgs: 129 active+clean; 588 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 732 op/s 2024-09-13T16:56:14.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:13 smithi144 ceph-mon[35328]: pgmap v503: 129 pgs: 129 active+clean; 588 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 732 op/s 2024-09-13T16:56:15.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:15 smithi094 ceph-mon[35259]: pgmap v504: 129 pgs: 129 active+clean; 586 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.6 MiB/s wr, 655 op/s 2024-09-13T16:56:15.926 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:15 smithi018 ceph-mon[30981]: pgmap v504: 129 pgs: 129 active+clean; 586 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.6 MiB/s wr, 655 op/s 2024-09-13T16:56:16.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:15 smithi144 ceph-mon[35328]: pgmap v504: 129 pgs: 129 active+clean; 586 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.6 MiB/s wr, 655 op/s 2024-09-13T16:56:16.281 INFO:tasks.workunit.client.0.smithi018.stdout: 151 500436 490 351821 499 199920 1527 2024-09-13T16:56:17.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:17 smithi018 ceph-mon[30981]: pgmap v505: 129 pgs: 129 active+clean; 592 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 622 op/s 2024-09-13T16:56:17.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:17 smithi094 ceph-mon[35259]: pgmap v505: 129 pgs: 129 active+clean; 592 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 622 op/s 2024-09-13T16:56:18.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:17 smithi144 ceph-mon[35328]: pgmap v505: 129 pgs: 129 active+clean; 592 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 622 op/s 2024-09-13T16:56:19.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:19 smithi018 ceph-mon[30981]: pgmap v506: 129 pgs: 129 active+clean; 605 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 645 op/s 2024-09-13T16:56:19.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:19 smithi094 ceph-mon[35259]: pgmap v506: 129 pgs: 129 active+clean; 605 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 645 op/s 2024-09-13T16:56:20.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:19 smithi144 ceph-mon[35328]: pgmap v506: 129 pgs: 129 active+clean; 605 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 645 op/s 2024-09-13T16:56:21.641 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:21 smithi018 ceph-mon[30981]: pgmap v507: 129 pgs: 129 active+clean; 622 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 534 op/s 2024-09-13T16:56:21.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:21 smithi094 ceph-mon[35259]: pgmap v507: 129 pgs: 129 active+clean; 622 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 534 op/s 2024-09-13T16:56:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.005+0000 7f9856800640 1 -- 172.21.15.18:0/2612576430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f98480a5670 msgr2=0x7f98480a5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.005+0000 7f9856800640 1 --2- 172.21.15.18:0/2612576430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f98480a5670 0x7f98480a5af0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f983c009900 tx=0x7f983c02a4a0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.005+0000 7f9856800640 1 -- 172.21.15.18:0/2612576430 shutdown_connections 2024-09-13T16:56:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.005+0000 7f9856800640 1 --2- 172.21.15.18:0/2612576430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98480a6030 0x7f98480aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.005+0000 7f9856800640 1 --2- 172.21.15.18:0/2612576430 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f98480a5670 0x7f98480a5af0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.005+0000 7f9856800640 1 --2- 172.21.15.18:0/2612576430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98480a4540 0x7f98480a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.005+0000 7f9856800640 1 -- 172.21.15.18:0/2612576430 >> 172.21.15.18:0/2612576430 conn(0x7f984809fba0 msgr2=0x7f98480a2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.006+0000 7f9856800640 1 -- 172.21.15.18:0/2612576430 shutdown_connections 2024-09-13T16:56:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.006+0000 7f9856800640 1 -- 172.21.15.18:0/2612576430 wait complete. 2024-09-13T16:56:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.009+0000 7f9856800640 1 Processor -- start 2024-09-13T16:56:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.011+0000 7f9856800640 1 -- start start 2024-09-13T16:56:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.011+0000 7f9856800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f98480a4540 0x7f98480b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.011+0000 7f9856800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98480a5670 0x7f98480b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.012+0000 7f984f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f98480a4540 0x7f98480b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.012+0000 7f984f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f98480a4540 0x7f98480b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:58640/0 (socket says 172.21.15.18:58640) 2024-09-13T16:56:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.012+0000 7f984f400640 1 -- 172.21.15.18:0/3994453626 learned_addr learned my addr 172.21.15.18:0/3994453626 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.012+0000 7f984ea00640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98480a5670 0x7f98480b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.012+0000 7f9856800640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98480a6030 0x7f9848152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.013+0000 7f984fe00640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98480a6030 0x7f9848152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.013+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480b6650 con 0x7f98480a6030 2024-09-13T16:56:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.013+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480b67c0 con 0x7f98480a4540 2024-09-13T16:56:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.013+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98481533c0 con 0x7f98480a5670 2024-09-13T16:56:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.014+0000 7f984fe00640 1 -- 172.21.15.18:0/3994453626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98480a5670 msgr2=0x7f98480b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.014+0000 7f984fe00640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98480a5670 0x7f98480b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.014+0000 7f984fe00640 1 -- 172.21.15.18:0/3994453626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f98480a4540 msgr2=0x7f98480b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.014+0000 7f984fe00640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f98480a4540 0x7f98480b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.014+0000 7f984fe00640 1 -- 172.21.15.18:0/3994453626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c009560 con 0x7f98480a6030 2024-09-13T16:56:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.014+0000 7f984fe00640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98480a6030 0x7f9848152e80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9850065c00 tx=0x7f985006c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.017+0000 7f9843e00640 1 -- 172.21.15.18:0/3994453626 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850078070 con 0x7f98480a6030 2024-09-13T16:56:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.017+0000 7f9843e00640 1 -- 172.21.15.18:0/3994453626 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f985004ea60 con 0x7f98480a6030 2024-09-13T16:56:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.017+0000 7f9843e00640 1 -- 172.21.15.18:0/3994453626 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850074e20 con 0x7f98480a6030 2024-09-13T16:56:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.017+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9848153620 con 0x7f98480a6030 2024-09-13T16:56:22.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:21 smithi144 ceph-mon[35328]: pgmap v507: 129 pgs: 129 active+clean; 622 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 534 op/s 2024-09-13T16:56:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.019+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9848153b30 con 0x7f98480a6030 2024-09-13T16:56:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.027+0000 7f98596da740 1 Processor -- start 2024-09-13T16:56:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.037+0000 7f9843e00640 1 -- 172.21.15.18:0/3994453626 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f98500745b0 con 0x7f98480a6030 2024-09-13T16:56:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.040+0000 7f9843e00640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f98380a1260 0x7f98380a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.040+0000 7f9843e00640 1 -- 172.21.15.18:0/3994453626 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f985012dae0 con 0x7f98480a6030 2024-09-13T16:56:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.041+0000 7f98596da740 1 -- start start 2024-09-13T16:56:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.041+0000 7f98596da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f37c80 0x560f76f38080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.041+0000 7f98596da740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f385c0 0x560f76f3d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.041+0000 7f98596da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f3d650 0x560f76f3fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.041+0000 7f98596da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76e43bb0 con 0x560f76f3d650 2024-09-13T16:56:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.041+0000 7f98596da740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76ea1a70 con 0x560f76f385c0 2024-09-13T16:56:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.041+0000 7f98596da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76e9f200 con 0x560f76f37c80 2024-09-13T16:56:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.042+0000 7f984f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f37c80 0x560f76f38080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.042+0000 7f984f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f37c80 0x560f76f38080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:33176/0 (socket says 172.21.15.18:33176) 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.042+0000 7f984f400640 1 -- 172.21.15.18:0/4063003080 learned_addr learned my addr 172.21.15.18:0/4063003080 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.042+0000 7f984fe00640 1 --2- 172.21.15.18:0/4063003080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f3d650 0x560f76f3fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.043+0000 7f984ea00640 1 --2- 172.21.15.18:0/4063003080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f385c0 0x560f76f3d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.043+0000 7f984ea00640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f98380a1260 0x7f98380a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.044+0000 7f984fe00640 1 -- 172.21.15.18:0/4063003080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f37c80 msgr2=0x560f76f38080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.044+0000 7f984fe00640 1 --2- 172.21.15.18:0/4063003080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f37c80 0x560f76f38080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.044+0000 7f984fe00640 1 -- 172.21.15.18:0/4063003080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f385c0 msgr2=0x560f76f3d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.044+0000 7f984fe00640 1 --2- 172.21.15.18:0/4063003080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f385c0 0x560f76f3d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.044+0000 7f984fe00640 1 -- 172.21.15.18:0/4063003080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f76e3c940 con 0x560f76f3d650 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.046+0000 7f984f400640 1 --2- 172.21.15.18:0/4063003080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f37c80 0x560f76f38080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:56:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.046+0000 7f984ea00640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f98380a1260 0x7f98380a3720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f983c0057c0 tx=0x7f983c004110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.059+0000 7f984fe00640 1 --2- 172.21.15.18:0/4063003080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f3d650 0x560f76f3fb10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f985012b220 tx=0x7f9850066570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3016a891fed024d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.068+0000 7f9840c00640 1 -- 172.21.15.18:0/4063003080 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98500fabf0 con 0x560f76f3d650 2024-09-13T16:56:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.068+0000 7f9840c00640 1 -- 172.21.15.18:0/4063003080 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98500fea20 con 0x560f76f3d650 2024-09-13T16:56:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.068+0000 7f9840c00640 1 -- 172.21.15.18:0/4063003080 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850102e40 con 0x560f76f3d650 2024-09-13T16:56:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.070+0000 7f98596da740 1 -- 172.21.15.18:0/4063003080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f3d650 msgr2=0x560f76f3fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.070+0000 7f98596da740 1 --2- 172.21.15.18:0/4063003080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f3d650 0x560f76f3fb10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f985012b220 tx=0x7f9850066570 comp rx=0 tx=0).stop 2024-09-13T16:56:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.070+0000 7f98596da740 1 -- 172.21.15.18:0/4063003080 shutdown_connections 2024-09-13T16:56:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.070+0000 7f98596da740 1 --2- 172.21.15.18:0/4063003080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f3d650 0x560f76f3fb10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.070+0000 7f98596da740 1 --2- 172.21.15.18:0/4063003080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f385c0 0x560f76f3d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.070+0000 7f98596da740 1 --2- 172.21.15.18:0/4063003080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f37c80 0x560f76f38080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.070+0000 7f98596da740 1 -- 172.21.15.18:0/4063003080 >> 172.21.15.18:0/4063003080 conn(0x560f76f332f0 msgr2=0x560f76f336f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.074+0000 7f98596da740 1 -- 172.21.15.18:0/4063003080 shutdown_connections 2024-09-13T16:56:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.074+0000 7f98596da740 1 -- 172.21.15.18:0/4063003080 wait complete. 2024-09-13T16:56:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.074+0000 7f98596da740 1 -- start start 2024-09-13T16:56:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.075+0000 7f98596da740 1 Processor -- start 2024-09-13T16:56:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.082+0000 7f98596da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 0x560f76f41880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.082+0000 7f98596da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f385c0 0x560f76f41dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.082+0000 7f98596da740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f3d650 0x560f76f48e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.082+0000 7f98596da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76e9aaf0 con 0x560f76f37c80 2024-09-13T16:56:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.082+0000 7f98596da740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76e58f20 con 0x560f76f3d650 2024-09-13T16:56:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.082+0000 7f98596da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76e58bc0 con 0x560f76f385c0 2024-09-13T16:56:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.083+0000 7f98596da740 10 client.0 _ll_register_callbacks cb 0x560f76e8aa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:56:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.083+0000 7f984fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f3d650 0x560f76f48e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.083+0000 7f984fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f3d650 0x560f76f48e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:58660/0 (socket says 172.21.15.18:58660) 2024-09-13T16:56:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.083+0000 7f984fe00640 1 -- 172.21.15.18:0/2835518241 learned_addr learned my addr 172.21.15.18:0/2835518241 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.084+0000 7f984ea00640 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f385c0 0x560f76f41dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.084+0000 7f984fe00640 1 -- 172.21.15.18:0/2835518241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f385c0 msgr2=0x560f76f41dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.084+0000 7f984fe00640 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f385c0 0x560f76f41dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.084+0000 7f984fe00640 1 -- 172.21.15.18:0/2835518241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 msgr2=0x560f76f41880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.084+0000 7f984fe00640 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 0x560f76f41880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.084+0000 7f984fe00640 1 -- 172.21.15.18:0/2835518241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9848153b30 con 0x560f76f3d650 2024-09-13T16:56:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.084+0000 7f984fe00640 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f3d650 0x560f76f48e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f98500f7660 tx=0x7f98500feb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f3a68f88a9a3513 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.088+0000 7f9835600640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:56:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.088+0000 7f9835600640 1 -- 172.21.15.18:0/2835518241 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850103070 con 0x560f76f3d650 2024-09-13T16:56:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.088+0000 7f9835600640 1 -- 172.21.15.18:0/2835518241 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f98500fabf0 con 0x560f76f3d650 2024-09-13T16:56:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.088+0000 7f98596da740 1 -- 172.21.15.18:0/2835518241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f76ec4c90 con 0x560f76f3d650 2024-09-13T16:56:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.088+0000 7f9835600640 1 -- 172.21.15.18:0/2835518241 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9850102df0 con 0x560f76f3d650 2024-09-13T16:56:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.089+0000 7f98596da740 10 client.25643 fetch_fsmap learned FSMap version 29 2024-09-13T16:56:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.089+0000 7f98596da740 1 -- 172.21.15.18:0/2835518241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560f76e99170 con 0x560f76f3d650 2024-09-13T16:56:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.098+0000 7f9835600640 1 -- 172.21.15.18:0/2835518241 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560f76ec4c90 con 0x560f76f3d650 2024-09-13T16:56:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.098+0000 7f9835600640 1 -- 172.21.15.18:0/2835518241 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f985010eac0 con 0x560f76f3d650 2024-09-13T16:56:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.098+0000 7f98596da740 10 client.25643 fetch_fsmap finished waiting for FSMap version 29 2024-09-13T16:56:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.098+0000 7f98596da740 10 client.25643 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:56:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.098+0000 7f98596da740 20 client.25643 populate_metadata read hostname 'smithi018' 2024-09-13T16:56:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.098+0000 7f98596da740 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x560f76f4d150 0x560f76f4f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.098+0000 7f98596da740 4 client.25643 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:56:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.098+0000 7f98596da740 1 -- 172.21.15.18:0/2835518241 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f76e8d7d0 con 0x560f76f4d150 2024-09-13T16:56:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.099+0000 7f984f400640 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x560f76f4d150 0x560f76f4f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.101+0000 7f984f400640 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x560f76f4d150 0x560f76f4f540 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=355464a119e4338a server_cookie=ffa76cc313115363 in_seq=0 out_seq=0 2024-09-13T16:56:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.101+0000 7f9835600640 10 client.25643 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.103+0000 7f9835600640 1 -- 172.21.15.18:0/2835518241 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560f76e8d7d0 con 0x560f76f4d150 2024-09-13T16:56:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.103+0000 7f9835600640 10 client.25643 handle_command_reply: tid=0 2024-09-13T16:56:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.103+0000 7f98596da740 1 client.25643 shutdown 2024-09-13T16:56:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.106+0000 7f98596da740 1 -- 172.21.15.18:0/2835518241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f3d650 msgr2=0x560f76f48e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.106+0000 7f98596da740 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f3d650 0x560f76f48e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f98500f7660 tx=0x7f98500feb90 comp rx=0 tx=0).stop 2024-09-13T16:56:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.106+0000 7f98596da740 1 -- 172.21.15.18:0/2835518241 shutdown_connections 2024-09-13T16:56:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.106+0000 7f98596da740 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x560f76f4d150 0x560f76f4f540 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.109+0000 7f98596da740 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f3d650 0x560f76f48e00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.109+0000 7f98596da740 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f385c0 0x560f76f41dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.109+0000 7f9835600640 0 client.25643 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.109+0000 7f98596da740 1 --2- 172.21.15.18:0/2835518241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 0x560f76f41880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.109+0000 7f98596da740 1 -- 172.21.15.18:0/2835518241 >> 172.21.15.18:0/2835518241 conn(0x560f76f332f0 msgr2=0x560f76f34b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.109+0000 7f98596da740 1 -- 172.21.15.18:0/2835518241 shutdown_connections 2024-09-13T16:56:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.109+0000 7f98596da740 1 -- 172.21.15.18:0/2835518241 wait complete. 2024-09-13T16:56:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.113+0000 7f98596da740 20 client.25643 trim_cache size 0 max 16384 2024-09-13T16:56:22.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.176+0000 7f98596da740 1 Processor -- start 2024-09-13T16:56:22.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.176+0000 7f98596da740 1 -- start start 2024-09-13T16:56:22.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.176+0000 7f98596da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 0x560f76f39540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.176+0000 7f98596da740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f385c0 0x560f76f48dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.176+0000 7f98596da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 0x560f76f39a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.177+0000 7f98596da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76c01e60 con 0x560f76f37c80 2024-09-13T16:56:22.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.177+0000 7f98596da740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76f49f80 con 0x560f76f385c0 2024-09-13T16:56:22.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.177+0000 7f98596da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76f2d900 con 0x560f76f3d650 2024-09-13T16:56:22.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.177+0000 7f984f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 0x560f76f39540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.177+0000 7f984f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 0x560f76f39540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41694/0 (socket says 172.21.15.18:41694) 2024-09-13T16:56:22.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.177+0000 7f984f400640 1 -- 172.21.15.18:0/3370450325 learned_addr learned my addr 172.21.15.18:0/3370450325 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:22.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.178+0000 7f984fe00640 1 --2- 172.21.15.18:0/3370450325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 0x560f76f39a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.178+0000 7f984ea00640 1 --2- 172.21.15.18:0/3370450325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f385c0 0x560f76f48dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.181+0000 7f984f400640 1 -- 172.21.15.18:0/3370450325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 msgr2=0x560f76f39a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.181+0000 7f984f400640 1 --2- 172.21.15.18:0/3370450325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 0x560f76f39a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.181+0000 7f984f400640 1 -- 172.21.15.18:0/3370450325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f385c0 msgr2=0x560f76f48dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.181+0000 7f984f400640 1 --2- 172.21.15.18:0/3370450325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f385c0 0x560f76f48dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.181+0000 7f984f400640 1 -- 172.21.15.18:0/3370450325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f76e3b180 con 0x560f76f37c80 2024-09-13T16:56:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.181+0000 7f984f400640 1 --2- 172.21.15.18:0/3370450325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 0x560f76f39540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x560f76f40d40 tx=0x7f984400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6719e3ac0cfe85b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.186+0000 7f9841600640 1 -- 172.21.15.18:0/3370450325 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9844039040 con 0x560f76f37c80 2024-09-13T16:56:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.187+0000 7f9841600640 1 -- 172.21.15.18:0/3370450325 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f984403f070 con 0x560f76f37c80 2024-09-13T16:56:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.187+0000 7f9841600640 1 -- 172.21.15.18:0/3370450325 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984403b7e0 con 0x560f76f37c80 2024-09-13T16:56:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.190+0000 7f98596da740 1 -- 172.21.15.18:0/3370450325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 msgr2=0x560f76f39540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.190+0000 7f98596da740 1 --2- 172.21.15.18:0/3370450325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 0x560f76f39540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x560f76f40d40 tx=0x7f984400a640 comp rx=0 tx=0).stop 2024-09-13T16:56:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.192+0000 7f98596da740 1 -- 172.21.15.18:0/3370450325 shutdown_connections 2024-09-13T16:56:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.192+0000 7f98596da740 1 --2- 172.21.15.18:0/3370450325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 0x560f76f39a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.192+0000 7f98596da740 1 --2- 172.21.15.18:0/3370450325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f385c0 0x560f76f48dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.192+0000 7f98596da740 1 --2- 172.21.15.18:0/3370450325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f37c80 0x560f76f39540 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.192+0000 7f98596da740 1 -- 172.21.15.18:0/3370450325 >> 172.21.15.18:0/3370450325 conn(0x560f76f332f0 msgr2=0x560f76f53ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:22.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.194+0000 7f98596da740 1 -- 172.21.15.18:0/3370450325 shutdown_connections 2024-09-13T16:56:22.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.194+0000 7f98596da740 1 -- 172.21.15.18:0/3370450325 wait complete. 2024-09-13T16:56:22.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.194+0000 7f98596da740 1 -- start start 2024-09-13T16:56:22.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.195+0000 7f98596da740 1 Processor -- start 2024-09-13T16:56:22.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.198+0000 7f98596da740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f37c80 0x560f76f487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.198+0000 7f98596da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f385c0 0x560f76f48d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.198+0000 7f98596da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 0x560f76f45340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.199+0000 7f98596da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76f45a90 con 0x560f76f385c0 2024-09-13T16:56:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.199+0000 7f98596da740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76f45c00 con 0x560f76f37c80 2024-09-13T16:56:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.199+0000 7f984fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 0x560f76f45340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.199+0000 7f98596da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f76f45dc0 con 0x560f76f3d650 2024-09-13T16:56:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.200+0000 7f984f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f37c80 0x560f76f487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.200+0000 7f984f400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f37c80 0x560f76f487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:58676/0 (socket says 172.21.15.18:58676) 2024-09-13T16:56:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.200+0000 7f984f400640 1 -- 172.21.15.18:0/3070686060 learned_addr learned my addr 172.21.15.18:0/3070686060 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.200+0000 7f98596da740 10 client.0 _ll_register_callbacks cb 0x7f985004f220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:56:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.200+0000 7f984ea00640 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f385c0 0x560f76f48d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.203+0000 7f984f400640 1 -- 172.21.15.18:0/3070686060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 msgr2=0x560f76f45340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.203+0000 7f984f400640 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 0x560f76f45340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.203+0000 7f984f400640 1 -- 172.21.15.18:0/3070686060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f385c0 msgr2=0x560f76f48d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.203+0000 7f984f400640 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f385c0 0x560f76f48d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.204+0000 7f984f400640 1 -- 172.21.15.18:0/3070686060 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984400a930 con 0x560f76f37c80 2024-09-13T16:56:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.204+0000 7f984ea00640 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f385c0 0x560f76f48d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:56:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.204+0000 7f984fe00640 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 0x560f76f45340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:56:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.204+0000 7f984f400640 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f37c80 0x560f76f487d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f984403b430 tx=0x7f984400afd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4c76af3ed6320de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.204+0000 7f9835600640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:56:22.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.214+0000 7f9835600640 1 -- 172.21.15.18:0/3070686060 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984403b970 con 0x560f76f37c80 2024-09-13T16:56:22.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.215+0000 7f9835600640 1 -- 172.21.15.18:0/3070686060 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f9844005040 con 0x560f76f37c80 2024-09-13T16:56:22.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.215+0000 7f98596da740 1 -- 172.21.15.18:0/3070686060 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f76f2eb50 con 0x560f76f37c80 2024-09-13T16:56:22.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.219+0000 7f9835600640 1 -- 172.21.15.18:0/3070686060 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9844005200 con 0x560f76f37c80 2024-09-13T16:56:22.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.220+0000 7f98596da740 10 client.25649 fetch_fsmap learned FSMap version 29 2024-09-13T16:56:22.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.220+0000 7f98596da740 1 -- 172.21.15.18:0/3070686060 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560f76e60560 con 0x560f76f37c80 2024-09-13T16:56:22.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.221+0000 7f9835600640 1 -- 172.21.15.18:0/3070686060 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560f76f2eb50 con 0x560f76f37c80 2024-09-13T16:56:22.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.222+0000 7f9835600640 1 -- 172.21.15.18:0/3070686060 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f984404a020 con 0x560f76f37c80 2024-09-13T16:56:22.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.223+0000 7f98596da740 10 client.25649 fetch_fsmap finished waiting for FSMap version 29 2024-09-13T16:56:22.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.223+0000 7f98596da740 10 client.25649 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:56:22.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.223+0000 7f98596da740 20 client.25649 populate_metadata read hostname 'smithi018' 2024-09-13T16:56:22.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.223+0000 7f98596da740 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x560f76fa4b50 0x560f76fa6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:22.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.223+0000 7f98596da740 4 client.25649 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:56:22.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.223+0000 7f98596da740 1 -- 172.21.15.18:0/3070686060 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f98500fea20 con 0x560f76fa4b50 2024-09-13T16:56:22.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.224+0000 7f984ea00640 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x560f76fa4b50 0x560f76fa6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:22.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.226+0000 7f9835600640 10 client.25649 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:22.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:22.226+0000 7f984ea00640 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x560f76fa4b50 0x560f76fa6f40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dca463d5e69ed0ac server_cookie=758f3a85465afbec in_seq=0 out_seq=0 2024-09-13T16:56:23.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:23 smithi094 ceph-mon[35259]: pgmap v508: 129 pgs: 129 active+clean; 628 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 404 op/s 2024-09-13T16:56:23.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:23 smithi018 ceph-mon[30981]: pgmap v508: 129 pgs: 129 active+clean; 628 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 404 op/s 2024-09-13T16:56:24.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:23 smithi144 ceph-mon[35328]: pgmap v508: 129 pgs: 129 active+clean; 628 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 404 op/s 2024-09-13T16:56:25.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:25 smithi018 ceph-mon[30981]: pgmap v509: 129 pgs: 129 active+clean; 644 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.6 MiB/s wr, 391 op/s 2024-09-13T16:56:26.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:25 smithi144 ceph-mon[35328]: pgmap v509: 129 pgs: 129 active+clean; 644 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.6 MiB/s wr, 391 op/s 2024-09-13T16:56:26.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:25 smithi094 ceph-mon[35259]: pgmap v509: 129 pgs: 129 active+clean; 644 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.6 MiB/s wr, 391 op/s 2024-09-13T16:56:26.288 INFO:tasks.workunit.client.0.smithi018.stdout: 158 397833 287 283322 363 170174 672 2024-09-13T16:56:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.443+0000 7f9835600640 1 -- 172.21.15.18:0/3070686060 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f98500fea20 con 0x560f76fa4b50 2024-09-13T16:56:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.443+0000 7f9835600640 10 client.25649 handle_command_reply: tid=0 2024-09-13T16:56:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.454+0000 7f98596da740 1 client.25649 shutdown 2024-09-13T16:56:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.460+0000 7f98596da740 1 -- 172.21.15.18:0/3070686060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f37c80 msgr2=0x560f76f487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.460+0000 7f98596da740 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f37c80 0x560f76f487d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f984403b430 tx=0x7f984400afd0 comp rx=0 tx=0).stop 2024-09-13T16:56:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.463+0000 7f98596da740 1 -- 172.21.15.18:0/3070686060 shutdown_connections 2024-09-13T16:56:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.463+0000 7f98596da740 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x560f76fa4b50 0x560f76fa6f40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.463+0000 7f98596da740 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560f76f385c0 0x560f76f48d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.463+0000 7f98596da740 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560f76f3d650 0x560f76f45340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.463+0000 7f98596da740 1 --2- 172.21.15.18:0/3070686060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560f76f37c80 0x560f76f487d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.463+0000 7f98596da740 1 -- 172.21.15.18:0/3070686060 >> 172.21.15.18:0/3070686060 conn(0x560f76f332f0 msgr2=0x560f76f39540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.463+0000 7f9835600640 0 client.25649 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:26.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.471+0000 7f98596da740 1 -- 172.21.15.18:0/3070686060 shutdown_connections 2024-09-13T16:56:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.480+0000 7f98596da740 1 -- 172.21.15.18:0/3070686060 wait complete. 2024-09-13T16:56:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.489+0000 7f98596da740 20 client.25649 trim_cache size 0 max 16384 2024-09-13T16:56:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:56:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:56:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:56:26.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:56:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.510+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f98380a1260 msgr2=0x7f98380a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.510+0000 7f9856800640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f98380a1260 0x7f98380a3720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f983c0057c0 tx=0x7f983c004110 comp rx=0 tx=0).stop 2024-09-13T16:56:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.510+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98480a6030 msgr2=0x7f9848152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.510+0000 7f9856800640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98480a6030 0x7f9848152e80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9850065c00 tx=0x7f985006c430 comp rx=0 tx=0).stop 2024-09-13T16:56:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.510+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 shutdown_connections 2024-09-13T16:56:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.510+0000 7f9856800640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f98380a1260 0x7f98380a3720 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.510+0000 7f9856800640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98480a6030 0x7f9848152e80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.510+0000 7f9856800640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98480a5670 0x7f98480b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.510+0000 7f9856800640 1 --2- 172.21.15.18:0/3994453626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f98480a4540 0x7f98480b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.510+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 >> 172.21.15.18:0/3994453626 conn(0x7f984809fba0 msgr2=0x7f98480a8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.522+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 shutdown_connections 2024-09-13T16:56:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:26.522+0000 7f9856800640 1 -- 172.21.15.18:0/3994453626 wait complete. 2024-09-13T16:56:27.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:27 smithi018 ceph-mon[30981]: pgmap v510: 129 pgs: 129 active+clean; 656 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.4 MiB/s wr, 617 op/s 2024-09-13T16:56:28.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:27 smithi144 ceph-mon[35328]: pgmap v510: 129 pgs: 129 active+clean; 656 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.4 MiB/s wr, 617 op/s 2024-09-13T16:56:28.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:27 smithi094 ceph-mon[35259]: pgmap v510: 129 pgs: 129 active+clean; 656 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.4 MiB/s wr, 617 op/s 2024-09-13T16:56:29.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:29 smithi018 ceph-mon[30981]: pgmap v511: 129 pgs: 129 active+clean; 675 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.7 MiB/s wr, 1.11k op/s 2024-09-13T16:56:29.963 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:29 smithi094 ceph-mon[35259]: pgmap v511: 129 pgs: 129 active+clean; 675 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.7 MiB/s wr, 1.11k op/s 2024-09-13T16:56:30.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:29 smithi144 ceph-mon[35328]: pgmap v511: 129 pgs: 129 active+clean; 675 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.7 MiB/s wr, 1.11k op/s 2024-09-13T16:56:31.941 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:31 smithi018 ceph-mon[30981]: pgmap v512: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.8 MiB/s wr, 1.14k op/s 2024-09-13T16:56:32.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:31 smithi144 ceph-mon[35328]: pgmap v512: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.8 MiB/s wr, 1.14k op/s 2024-09-13T16:56:32.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:31 smithi094 ceph-mon[35259]: pgmap v512: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.8 MiB/s wr, 1.14k op/s 2024-09-13T16:56:33.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:33 smithi018 ceph-mon[30981]: pgmap v513: 129 pgs: 129 active+clean; 675 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 1.07k op/s 2024-09-13T16:56:34.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:33 smithi144 ceph-mon[35328]: pgmap v513: 129 pgs: 129 active+clean; 675 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 1.07k op/s 2024-09-13T16:56:34.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:33 smithi094 ceph-mon[35259]: pgmap v513: 129 pgs: 129 active+clean; 675 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 1.07k op/s 2024-09-13T16:56:35.961 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:35 smithi018 ceph-mon[30981]: pgmap v514: 129 pgs: 129 active+clean; 678 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.4 MiB/s wr, 1.08k op/s 2024-09-13T16:56:36.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:35 smithi144 ceph-mon[35328]: pgmap v514: 129 pgs: 129 active+clean; 678 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.4 MiB/s wr, 1.08k op/s 2024-09-13T16:56:36.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:35 smithi094 ceph-mon[35259]: pgmap v514: 129 pgs: 129 active+clean; 678 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.4 MiB/s wr, 1.08k op/s 2024-09-13T16:56:36.288 INFO:tasks.workunit.client.0.smithi018.stdout: 177 455069 1254 321689 1016 200933 2881 2024-09-13T16:56:37.858 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:37 smithi018 ceph-mon[30981]: pgmap v515: 129 pgs: 129 active+clean; 687 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 1.02k op/s 2024-09-13T16:56:38.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:37 smithi144 ceph-mon[35328]: pgmap v515: 129 pgs: 129 active+clean; 687 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 1.02k op/s 2024-09-13T16:56:38.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:37 smithi094 ceph-mon[35259]: pgmap v515: 129 pgs: 129 active+clean; 687 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 1.02k op/s 2024-09-13T16:56:39.916 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:39 smithi018 ceph-mon[30981]: pgmap v516: 129 pgs: 129 active+clean; 686 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.9 MiB/s wr, 794 op/s 2024-09-13T16:56:40.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:39 smithi144 ceph-mon[35328]: pgmap v516: 129 pgs: 129 active+clean; 686 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.9 MiB/s wr, 794 op/s 2024-09-13T16:56:40.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:39 smithi094 ceph-mon[35259]: pgmap v516: 129 pgs: 129 active+clean; 686 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.9 MiB/s wr, 794 op/s 2024-09-13T16:56:42.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:41 smithi144 ceph-mon[35328]: pgmap v517: 129 pgs: 129 active+clean; 713 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.6 MiB/s wr, 421 op/s 2024-09-13T16:56:42.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:41 smithi094 ceph-mon[35259]: pgmap v517: 129 pgs: 129 active+clean; 713 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.6 MiB/s wr, 421 op/s 2024-09-13T16:56:42.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:41 smithi018 ceph-mon[30981]: pgmap v517: 129 pgs: 129 active+clean; 713 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.6 MiB/s wr, 421 op/s 2024-09-13T16:56:43.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:42 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:56:43.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:42 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:56:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.132+0000 7ff649400640 1 -- 172.21.15.18:0/563652299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff644109870 msgr2=0x7ff64410bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.132+0000 7ff649400640 1 --2- 172.21.15.18:0/563652299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff644109870 0x7ff64410bd00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff63001a910 tx=0x7ff63003b470 comp rx=0 tx=0).stop 2024-09-13T16:56:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.158+0000 7ff649400640 1 -- 172.21.15.18:0/563652299 shutdown_connections 2024-09-13T16:56:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.158+0000 7ff649400640 1 --2- 172.21.15.18:0/563652299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff644109870 0x7ff64410bd00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.158+0000 7ff649400640 1 --2- 172.21.15.18:0/563652299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff64410c240 0x7ff6441173f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.158+0000 7ff649400640 1 --2- 172.21.15.18:0/563652299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff644071120 0x7ff644071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.158+0000 7ff649400640 1 -- 172.21.15.18:0/563652299 >> 172.21.15.18:0/563652299 conn(0x7ff64406cf30 msgr2=0x7ff64406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:43.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:42 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:56:43.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:42 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:56:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.182+0000 7ff649400640 1 -- 172.21.15.18:0/563652299 shutdown_connections 2024-09-13T16:56:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.182+0000 7ff649400640 1 -- 172.21.15.18:0/563652299 wait complete. 2024-09-13T16:56:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.184+0000 7ff649400640 1 Processor -- start 2024-09-13T16:56:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.187+0000 7ff649400640 1 -- start start 2024-09-13T16:56:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.193+0000 7ff649400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff644071120 0x7ff64419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.206+0000 7ff649400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff644109870 0x7ff64419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.206+0000 7ff649400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff64410c240 0x7ff6441a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.207+0000 7ff643200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff64410c240 0x7ff6441a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:43.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:42 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:56:43.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:42 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:56:43.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.208+0000 7ff643200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff64410c240 0x7ff6441a39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55436/0 (socket says 172.21.15.18:55436) 2024-09-13T16:56:43.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.215+0000 7ff649400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6441a3f80 con 0x7ff64410c240 2024-09-13T16:56:43.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.215+0000 7ff649400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6441a40c0 con 0x7ff644071120 2024-09-13T16:56:43.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.215+0000 7ff649400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6441a4280 con 0x7ff644109870 2024-09-13T16:56:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.215+0000 7ff643200640 1 -- 172.21.15.18:0/3704517188 learned_addr learned my addr 172.21.15.18:0/3704517188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.217+0000 7ff643200640 1 -- 172.21.15.18:0/3704517188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff644109870 msgr2=0x7ff64419cf30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:56:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.217+0000 7ff643200640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff644109870 0x7ff64419cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.217+0000 7ff643200640 1 -- 172.21.15.18:0/3704517188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff644071120 msgr2=0x7ff64419c9f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:56:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.217+0000 7ff643200640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff644071120 0x7ff64419c9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.217+0000 7ff643200640 1 -- 172.21.15.18:0/3704517188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63001a570 con 0x7ff64410c240 2024-09-13T16:56:43.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.229+0000 7ff643200640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff64410c240 0x7ff6441a39b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00eaa0 tx=0x7ff63c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:43.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.234+0000 7ff63b400640 1 -- 172.21.15.18:0/3704517188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c00cdb0 con 0x7ff64410c240 2024-09-13T16:56:43.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.234+0000 7ff63b400640 1 -- 172.21.15.18:0/3704517188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff63c005020 con 0x7ff64410c240 2024-09-13T16:56:43.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.234+0000 7ff63b400640 1 -- 172.21.15.18:0/3704517188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0116b0 con 0x7ff64410c240 2024-09-13T16:56:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.273+0000 7ff649400640 1 -- 172.21.15.18:0/3704517188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6441a4500 con 0x7ff64410c240 2024-09-13T16:56:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.273+0000 7ff649400640 1 -- 172.21.15.18:0/3704517188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6441a4a40 con 0x7ff64410c240 2024-09-13T16:56:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.353+0000 7ff64c278740 1 Processor -- start 2024-09-13T16:56:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.333+0000 7ff63b400640 1 -- 172.21.15.18:0/3704517188 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff63c005190 con 0x7ff64410c240 2024-09-13T16:56:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.371+0000 7ff63b400640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6280a1290 0x7ff6280a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.384+0000 7ff63b400640 1 -- 172.21.15.18:0/3704517188 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7ff63c0cd140 con 0x7ff64410c240 2024-09-13T16:56:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.389+0000 7ff641e00640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6280a1290 0x7ff6280a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.406+0000 7ff641e00640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6280a1290 0x7ff6280a3750 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff630005ab0 tx=0x7ff630005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.408+0000 7ff64c278740 1 -- start start 2024-09-13T16:56:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.409+0000 7ff64c278740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907acfa70 0x562907acfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.409+0000 7ff64c278740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad03b0 0x562907ad4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.409+0000 7ff64c278740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 0x562907ad7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.409+0000 7ff642800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907acfa70 0x562907acfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.409+0000 7ff642800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907acfa70 0x562907acfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:55864/0 (socket says 172.21.15.18:55864) 2024-09-13T16:56:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.410+0000 7ff64c278740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629079dbbb0 con 0x562907ad5440 2024-09-13T16:56:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.410+0000 7ff64c278740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x562907a39a70 con 0x562907acfa70 2024-09-13T16:56:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.410+0000 7ff64c278740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562907a37200 con 0x562907ad03b0 2024-09-13T16:56:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.412+0000 7ff642800640 1 -- 172.21.15.18:0/3825098188 learned_addr learned my addr 172.21.15.18:0/3825098188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.412+0000 7ff641e00640 1 --2- 172.21.15.18:0/3825098188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad03b0 0x562907ad4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.412+0000 7ff642800640 1 -- 172.21.15.18:0/3825098188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad03b0 msgr2=0x562907ad4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.412+0000 7ff642800640 1 --2- 172.21.15.18:0/3825098188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad03b0 0x562907ad4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.412+0000 7ff642800640 1 -- 172.21.15.18:0/3825098188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 msgr2=0x562907ad7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.412+0000 7ff642800640 1 --2- 172.21.15.18:0/3825098188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 0x562907ad7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.412+0000 7ff642800640 1 -- 172.21.15.18:0/3825098188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629079d4940 con 0x562907acfa70 2024-09-13T16:56:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.417+0000 7ff642800640 1 --2- 172.21.15.18:0/3825098188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907acfa70 0x562907acfe70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff634009770 tx=0x7ff634009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbe07f4b500b8e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.429+0000 7ff62fe00640 1 -- 172.21.15.18:0/3825098188 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63400bad0 con 0x562907acfa70 2024-09-13T16:56:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.429+0000 7ff62fe00640 1 -- 172.21.15.18:0/3825098188 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff634009e80 con 0x562907acfa70 2024-09-13T16:56:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.429+0000 7ff62fe00640 1 -- 172.21.15.18:0/3825098188 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340105e0 con 0x562907acfa70 2024-09-13T16:56:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.452+0000 7ff64c278740 1 -- 172.21.15.18:0/3825098188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907acfa70 msgr2=0x562907acfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.452+0000 7ff64c278740 1 --2- 172.21.15.18:0/3825098188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907acfa70 0x562907acfe70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff634009770 tx=0x7ff634009c30 comp rx=0 tx=0).stop 2024-09-13T16:56:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.485+0000 7ff64c278740 1 -- 172.21.15.18:0/3825098188 shutdown_connections 2024-09-13T16:56:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.485+0000 7ff64c278740 1 --2- 172.21.15.18:0/3825098188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 0x562907ad7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.485+0000 7ff64c278740 1 --2- 172.21.15.18:0/3825098188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad03b0 0x562907ad4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.485+0000 7ff64c278740 1 --2- 172.21.15.18:0/3825098188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907acfa70 0x562907acfe70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.485+0000 7ff64c278740 1 -- 172.21.15.18:0/3825098188 >> 172.21.15.18:0/3825098188 conn(0x562907acb0e0 msgr2=0x562907acb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.491+0000 7ff64c278740 1 -- 172.21.15.18:0/3825098188 shutdown_connections 2024-09-13T16:56:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.491+0000 7ff64c278740 1 -- 172.21.15.18:0/3825098188 wait complete. 2024-09-13T16:56:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.492+0000 7ff64c278740 1 -- start start 2024-09-13T16:56:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.492+0000 7ff64c278740 1 Processor -- start 2024-09-13T16:56:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.503+0000 7ff64c278740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.523+0000 7ff64c278740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907ad9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.526+0000 7ff64c278740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 0x562907ae0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.527+0000 7ff64c278740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562907a32af0 con 0x562907ad5440 2024-09-13T16:56:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.527+0000 7ff64c278740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629079f0f20 con 0x562907ad03b0 2024-09-13T16:56:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.527+0000 7ff64c278740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629079f0bc0 con 0x562907acfa70 2024-09-13T16:56:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.529+0000 7ff642800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.530+0000 7ff64c278740 10 client.0 _ll_register_callbacks cb 0x562907a22a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:56:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.534+0000 7ff642800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:43502/0 (socket says 172.21.15.18:43502) 2024-09-13T16:56:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.534+0000 7ff642800640 1 -- 172.21.15.18:0/987239543 learned_addr learned my addr 172.21.15.18:0/987239543 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.534+0000 7ff641e00640 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907ad9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.534+0000 7ff643200640 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 0x562907ae0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.539+0000 7ff642800640 1 -- 172.21.15.18:0/987239543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 msgr2=0x562907ad9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.539+0000 7ff642800640 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907ad9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.539+0000 7ff642800640 1 -- 172.21.15.18:0/987239543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 msgr2=0x562907ae0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.539+0000 7ff642800640 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 0x562907ae0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.539+0000 7ff642800640 1 -- 172.21.15.18:0/987239543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6340093a0 con 0x562907acfa70 2024-09-13T16:56:43.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.563+0000 7ff642800640 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad98e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff634006c00 tx=0x7ff634011790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c519d55f31be227 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:43.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.583+0000 7ff62cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:56:43.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.583+0000 7ff62cc00640 1 -- 172.21.15.18:0/987239543 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63400bce0 con 0x562907acfa70 2024-09-13T16:56:43.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.584+0000 7ff62cc00640 1 -- 172.21.15.18:0/987239543 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7ff63400be40 con 0x562907acfa70 2024-09-13T16:56:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.615+0000 7ff64c278740 1 -- 172.21.15.18:0/987239543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562907a257d0 con 0x562907acfa70 2024-09-13T16:56:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.615+0000 7ff62cc00640 1 -- 172.21.15.18:0/987239543 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff634004040 con 0x562907acfa70 2024-09-13T16:56:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.615+0000 7ff64c278740 10 client.25600 fetch_fsmap learned FSMap version 30 2024-09-13T16:56:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.615+0000 7ff64c278740 1 -- 172.21.15.18:0/987239543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x562907a31170 con 0x562907acfa70 2024-09-13T16:56:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.620+0000 7ff62cc00640 1 -- 172.21.15.18:0/987239543 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562907a257d0 con 0x562907acfa70 2024-09-13T16:56:43.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.620+0000 7ff62cc00640 1 -- 172.21.15.18:0/987239543 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) v1 ==== 7482+0+0 (secure 0 0 0) 0x7ff63401a420 con 0x562907acfa70 2024-09-13T16:56:43.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.622+0000 7ff64c278740 10 client.25600 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:56:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.622+0000 7ff64c278740 10 client.25600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:56:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.622+0000 7ff64c278740 20 client.25600 populate_metadata read hostname 'smithi018' 2024-09-13T16:56:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.622+0000 7ff64c278740 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x562907ae5430 0x562907ae7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.622+0000 7ff64c278740 4 client.25600 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:56:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.622+0000 7ff64c278740 1 -- 172.21.15.18:0/987239543 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562907726300 con 0x562907ae5430 2024-09-13T16:56:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.623+0000 7ff641e00640 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x562907ae5430 0x562907ae7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.658+0000 7ff641e00640 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x562907ae5430 0x562907ae7850 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e05a1f2e7805458f server_cookie=91c81aaf8981e64f in_seq=0 out_seq=0 2024-09-13T16:56:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.661+0000 7ff62cc00640 10 client.25600 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.672+0000 7ff62cc00640 1 -- 172.21.15.18:0/987239543 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562907726300 con 0x562907ae5430 2024-09-13T16:56:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.672+0000 7ff62cc00640 10 client.25600 handle_command_reply: tid=0 2024-09-13T16:56:43.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.673+0000 7ff64c278740 1 client.25600 shutdown 2024-09-13T16:56:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.690+0000 7ff64c278740 1 -- 172.21.15.18:0/987239543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 msgr2=0x562907ad98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.690+0000 7ff64c278740 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad98e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff634006c00 tx=0x7ff634011790 comp rx=0 tx=0).stop 2024-09-13T16:56:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.694+0000 7ff64c278740 1 -- 172.21.15.18:0/987239543 shutdown_connections 2024-09-13T16:56:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.694+0000 7ff64c278740 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x562907ae5430 0x562907ae7850 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.694+0000 7ff64c278740 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 0x562907ae0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.694+0000 7ff64c278740 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907ad9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.694+0000 7ff64c278740 1 --2- 172.21.15.18:0/987239543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad98e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.694+0000 7ff64c278740 1 -- 172.21.15.18:0/987239543 >> 172.21.15.18:0/987239543 conn(0x562907acb0e0 msgr2=0x562907acc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.729+0000 7ff62cc00640 0 client.25600 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.729+0000 7ff64c278740 1 -- 172.21.15.18:0/987239543 shutdown_connections 2024-09-13T16:56:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.738+0000 7ff64c278740 1 -- 172.21.15.18:0/987239543 wait complete. 2024-09-13T16:56:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:43.798+0000 7ff64c278740 20 client.25600 trim_cache size 0 max 16384 2024-09-13T16:56:44.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:43 smithi144 ceph-mon[35328]: pgmap v518: 129 pgs: 129 active+clean; 724 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 387 op/s 2024-09-13T16:56:44.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:43 smithi018 ceph-mon[30981]: pgmap v518: 129 pgs: 129 active+clean; 724 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 387 op/s 2024-09-13T16:56:44.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:43 smithi094 ceph-mon[35259]: pgmap v518: 129 pgs: 129 active+clean; 724 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 387 op/s 2024-09-13T16:56:44.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.405+0000 7ff64c278740 1 Processor -- start 2024-09-13T16:56:44.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.406+0000 7ff64c278740 1 -- start start 2024-09-13T16:56:44.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.408+0000 7ff64c278740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:44.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.408+0000 7ff64c278740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907ae0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:44.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.408+0000 7ff642800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:44.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.408+0000 7ff642800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:43516/0 (socket says 172.21.15.18:43516) 2024-09-13T16:56:44.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.410+0000 7ff642800640 1 -- 172.21.15.18:0/989950701 learned_addr learned my addr 172.21.15.18:0/989950701 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:44.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.410+0000 7ff641e00640 1 --2- 172.21.15.18:0/989950701 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907ae0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.421+0000 7ff64c278740 1 --2- 172.21.15.18:0/989950701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 0x562907ad18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.421+0000 7ff64c278740 1 -- 172.21.15.18:0/989950701 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562907799e60 con 0x562907ad5440 2024-09-13T16:56:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.421+0000 7ff64c278740 1 -- 172.21.15.18:0/989950701 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x562907acaa20 con 0x562907ad03b0 2024-09-13T16:56:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.421+0000 7ff64c278740 1 -- 172.21.15.18:0/989950701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562907ad0790 con 0x562907acfa70 2024-09-13T16:56:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.429+0000 7ff641e00640 1 -- 172.21.15.18:0/989950701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 msgr2=0x562907ad13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.429+0000 7ff641e00640 1 --2- 172.21.15.18:0/989950701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:44.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.429+0000 7ff641e00640 1 -- 172.21.15.18:0/989950701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 msgr2=0x562907ad18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:44.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.429+0000 7ff641e00640 1 --2- 172.21.15.18:0/989950701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 0x562907ad18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:44.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.429+0000 7ff641e00640 1 -- 172.21.15.18:0/989950701 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629079d3180 con 0x562907ad03b0 2024-09-13T16:56:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.454+0000 7ff641e00640 1 --2- 172.21.15.18:0/989950701 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907ae0e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff63001a860 tx=0x7ff63004b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92e3444b41a6c28a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.477+0000 7ff638c00640 1 -- 172.21.15.18:0/989950701 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63005f070 con 0x562907ad03b0 2024-09-13T16:56:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.477+0000 7ff638c00640 1 -- 172.21.15.18:0/989950701 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff630004fc0 con 0x562907ad03b0 2024-09-13T16:56:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.477+0000 7ff638c00640 1 -- 172.21.15.18:0/989950701 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630061530 con 0x562907ad03b0 2024-09-13T16:56:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.478+0000 7ff64c278740 1 -- 172.21.15.18:0/989950701 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 msgr2=0x562907ae0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.478+0000 7ff64c278740 1 --2- 172.21.15.18:0/989950701 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907ae0e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff63001a860 tx=0x7ff63004b000 comp rx=0 tx=0).stop 2024-09-13T16:56:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.495+0000 7ff64c278740 1 -- 172.21.15.18:0/989950701 shutdown_connections 2024-09-13T16:56:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.495+0000 7ff64c278740 1 --2- 172.21.15.18:0/989950701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907ad5440 0x562907ad18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.495+0000 7ff64c278740 1 --2- 172.21.15.18:0/989950701 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907ae0e20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.495+0000 7ff64c278740 1 --2- 172.21.15.18:0/989950701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907acfa70 0x562907ad13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.495+0000 7ff64c278740 1 -- 172.21.15.18:0/989950701 >> 172.21.15.18:0/989950701 conn(0x562907acb0e0 msgr2=0x562907aec1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.519+0000 7ff64c278740 1 -- 172.21.15.18:0/989950701 shutdown_connections 2024-09-13T16:56:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.529+0000 7ff64c278740 1 -- 172.21.15.18:0/989950701 wait complete. 2024-09-13T16:56:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.529+0000 7ff64c278740 1 -- start start 2024-09-13T16:56:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.530+0000 7ff64c278740 1 Processor -- start 2024-09-13T16:56:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.566+0000 7ff64c278740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907acfa70 0x562907ae0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.566+0000 7ff64c278740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907add7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.566+0000 7ff64c278740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad5440 0x562907addd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.566+0000 7ff64c278740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562907ade3c0 con 0x562907acfa70 2024-09-13T16:56:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.566+0000 7ff64c278740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x562907b3b920 con 0x562907ad03b0 2024-09-13T16:56:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.566+0000 7ff64c278740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562907b3ba90 con 0x562907ad5440 2024-09-13T16:56:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.566+0000 7ff64c278740 10 client.0 _ll_register_callbacks cb 0x7ff634006f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:56:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.569+0000 7ff643200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad5440 0x562907addd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.569+0000 7ff643200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad5440 0x562907addd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:43532/0 (socket says 172.21.15.18:43532) 2024-09-13T16:56:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.569+0000 7ff643200640 1 -- 172.21.15.18:0/3359917331 learned_addr learned my addr 172.21.15.18:0/3359917331 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:56:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.570+0000 7ff643200640 1 -- 172.21.15.18:0/3359917331 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 msgr2=0x562907add7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:56:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.570+0000 7ff643200640 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907add7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.570+0000 7ff643200640 1 -- 172.21.15.18:0/3359917331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907acfa70 msgr2=0x562907ae0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:56:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.570+0000 7ff643200640 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907acfa70 0x562907ae0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.570+0000 7ff643200640 1 -- 172.21.15.18:0/3359917331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff644117930 con 0x562907ad5440 2024-09-13T16:56:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.570+0000 7ff643200640 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad5440 0x562907addd10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff63c099f50 tx=0x7ff63c09a390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b9465d5490387b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.581+0000 7ff62cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:56:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.581+0000 7ff62cc00640 1 -- 172.21.15.18:0/3359917331 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0ca990 con 0x562907ad5440 2024-09-13T16:56:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.581+0000 7ff62cc00640 1 -- 172.21.15.18:0/3359917331 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7ff63c005470 con 0x562907ad5440 2024-09-13T16:56:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.581+0000 7ff64c278740 1 -- 172.21.15.18:0/3359917331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562907a5cc90 con 0x562907ad5440 2024-09-13T16:56:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.604+0000 7ff62cc00640 1 -- 172.21.15.18:0/3359917331 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff63c0a2240 con 0x562907ad5440 2024-09-13T16:56:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.647+0000 7ff64c278740 10 client.25606 fetch_fsmap learned FSMap version 30 2024-09-13T16:56:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.647+0000 7ff64c278740 1 -- 172.21.15.18:0/3359917331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5629079f8560 con 0x562907ad5440 2024-09-13T16:56:44.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.656+0000 7ff62cc00640 1 -- 172.21.15.18:0/3359917331 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562907a5cc90 con 0x562907ad5440 2024-09-13T16:56:44.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.656+0000 7ff62cc00640 1 -- 172.21.15.18:0/3359917331 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) v1 ==== 7482+0+0 (secure 0 0 0) 0x7ff63c018030 con 0x562907ad5440 2024-09-13T16:56:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.656+0000 7ff64c278740 10 client.25606 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:56:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.656+0000 7ff64c278740 10 client.25606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:56:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.656+0000 7ff64c278740 20 client.25606 populate_metadata read hostname 'smithi018' 2024-09-13T16:56:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.656+0000 7ff64c278740 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x562907b3d590 0x562907b3f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.656+0000 7ff64c278740 4 client.25606 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:56:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.656+0000 7ff64c278740 1 -- 172.21.15.18:0/3359917331 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562907737600 con 0x562907b3d590 2024-09-13T16:56:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.670+0000 7ff642800640 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x562907b3d590 0x562907b3f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:44.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.706+0000 7ff642800640 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x562907b3d590 0x562907b3f9b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f305dc68413a1c server_cookie=e8ab2aad58549dcd in_seq=0 out_seq=0 2024-09-13T16:56:44.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:44.720+0000 7ff62cc00640 10 client.25606 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:46.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:45 smithi018 ceph-mon[30981]: pgmap v519: 129 pgs: 129 active+clean; 732 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 406 op/s 2024-09-13T16:56:46.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:45 smithi094 ceph-mon[35259]: pgmap v519: 129 pgs: 129 active+clean; 732 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 406 op/s 2024-09-13T16:56:46.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:45 smithi144 ceph-mon[35328]: pgmap v519: 129 pgs: 129 active+clean; 732 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 406 op/s 2024-09-13T16:56:46.303 INFO:tasks.workunit.client.0.smithi018.stdout: 191 401966 550 288750 638 178270 742 2024-09-13T16:56:48.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:47 smithi094 ceph-mon[35259]: pgmap v520: 129 pgs: 129 active+clean; 757 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.7 MiB/s wr, 539 op/s 2024-09-13T16:56:48.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:47 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:56:48.182 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:47 smithi018 ceph-mon[30981]: pgmap v520: 129 pgs: 129 active+clean; 757 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.7 MiB/s wr, 539 op/s 2024-09-13T16:56:48.182 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:47 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:56:48.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:47 smithi144 ceph-mon[35328]: pgmap v520: 129 pgs: 129 active+clean; 757 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.7 MiB/s wr, 539 op/s 2024-09-13T16:56:48.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:47 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:56:49.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:49 smithi018 ceph-mon[30981]: pgmap v521: 129 pgs: 129 active+clean; 778 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.7 MiB/s wr, 623 op/s 2024-09-13T16:56:50.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:49 smithi094 ceph-mon[35259]: pgmap v521: 129 pgs: 129 active+clean; 778 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.7 MiB/s wr, 623 op/s 2024-09-13T16:56:50.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:49 smithi144 ceph-mon[35328]: pgmap v521: 129 pgs: 129 active+clean; 778 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.7 MiB/s wr, 623 op/s 2024-09-13T16:56:52.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:51 smithi094 ceph-mon[35259]: pgmap v522: 129 pgs: 129 active+clean; 805 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.06k op/s 2024-09-13T16:56:52.199 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:51 smithi018 ceph-mon[30981]: pgmap v522: 129 pgs: 129 active+clean; 805 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.06k op/s 2024-09-13T16:56:52.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:51 smithi144 ceph-mon[35328]: pgmap v522: 129 pgs: 129 active+clean; 805 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.06k op/s 2024-09-13T16:56:54.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:53 smithi094 ceph-mon[35259]: pgmap v523: 129 pgs: 129 active+clean; 813 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.2 MiB/s wr, 1.30k op/s 2024-09-13T16:56:54.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:53 smithi018 ceph-mon[30981]: pgmap v523: 129 pgs: 129 active+clean; 813 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.2 MiB/s wr, 1.30k op/s 2024-09-13T16:56:54.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:53 smithi144 ceph-mon[35328]: pgmap v523: 129 pgs: 129 active+clean; 813 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.2 MiB/s wr, 1.30k op/s 2024-09-13T16:56:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.024+0000 7ff62cc00640 1 -- 172.21.15.18:0/3359917331 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562907737600 con 0x562907b3d590 2024-09-13T16:56:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.024+0000 7ff62cc00640 10 client.25606 handle_command_reply: tid=0 2024-09-13T16:56:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.024+0000 7ff64c278740 1 client.25606 shutdown 2024-09-13T16:56:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.032+0000 7ff64c278740 1 -- 172.21.15.18:0/3359917331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad5440 msgr2=0x562907addd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.032+0000 7ff64c278740 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad5440 0x562907addd10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff63c099f50 tx=0x7ff63c09a390 comp rx=0 tx=0).stop 2024-09-13T16:56:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.034+0000 7ff64c278740 1 -- 172.21.15.18:0/3359917331 shutdown_connections 2024-09-13T16:56:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.034+0000 7ff64c278740 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x562907b3d590 0x562907b3f9b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.034+0000 7ff64c278740 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562907ad5440 0x562907addd10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.034+0000 7ff64c278740 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x562907ad03b0 0x562907add7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.034+0000 7ff64c278740 1 --2- 172.21.15.18:0/3359917331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562907acfa70 0x562907ae0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.034+0000 7ff64c278740 1 -- 172.21.15.18:0/3359917331 >> 172.21.15.18:0/3359917331 conn(0x562907acb0e0 msgr2=0x562907ad13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.036+0000 7ff62cc00640 0 client.25606 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:56:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.060+0000 7ff64c278740 1 -- 172.21.15.18:0/3359917331 shutdown_connections 2024-09-13T16:56:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.066+0000 7ff64c278740 1 -- 172.21.15.18:0/3359917331 wait complete. 2024-09-13T16:56:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.085+0000 7ff64c278740 20 client.25606 trim_cache size 0 max 16384 2024-09-13T16:56:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:56:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:56:55.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:56:55.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:56:55.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.101+0000 7ff649400640 1 -- 172.21.15.18:0/3704517188 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6280a1290 msgr2=0x7ff6280a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:55.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.102+0000 7ff649400640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6280a1290 0x7ff6280a3750 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff630005ab0 tx=0x7ff630005fd0 comp rx=0 tx=0).stop 2024-09-13T16:56:55.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.102+0000 7ff649400640 1 -- 172.21.15.18:0/3704517188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff64410c240 msgr2=0x7ff6441a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:55.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.102+0000 7ff649400640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff64410c240 0x7ff6441a39b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00eaa0 tx=0x7ff63c00ef60 comp rx=0 tx=0).stop 2024-09-13T16:56:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.137+0000 7ff649400640 1 -- 172.21.15.18:0/3704517188 shutdown_connections 2024-09-13T16:56:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.137+0000 7ff649400640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff6280a1290 0x7ff6280a3750 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.137+0000 7ff649400640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff64410c240 0x7ff6441a39b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.137+0000 7ff649400640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff644109870 0x7ff64419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.137+0000 7ff649400640 1 --2- 172.21.15.18:0/3704517188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff644071120 0x7ff64419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.137+0000 7ff649400640 1 -- 172.21.15.18:0/3704517188 >> 172.21.15.18:0/3704517188 conn(0x7ff64406cf30 msgr2=0x7ff64406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.137+0000 7ff649400640 1 -- 172.21.15.18:0/3704517188 shutdown_connections 2024-09-13T16:56:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:56:55.137+0000 7ff649400640 1 -- 172.21.15.18:0/3704517188 wait complete. 2024-09-13T16:56:56.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:55 smithi094 ceph-mon[35259]: pgmap v524: 129 pgs: 129 active+clean; 818 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 1.36k op/s 2024-09-13T16:56:56.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:55 smithi018 ceph-mon[30981]: pgmap v524: 129 pgs: 129 active+clean; 818 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 1.36k op/s 2024-09-13T16:56:56.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:55 smithi144 ceph-mon[35328]: pgmap v524: 129 pgs: 129 active+clean; 818 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 1.36k op/s 2024-09-13T16:56:56.303 INFO:tasks.workunit.client.0.smithi018.stdout: 196 406633 359 292649 294 184670 975 2024-09-13T16:56:58.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:57 smithi094 ceph-mon[35259]: pgmap v525: 129 pgs: 129 active+clean; 824 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.5 MiB/s wr, 1.63k op/s 2024-09-13T16:56:58.212 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:57 smithi018 ceph-mon[30981]: pgmap v525: 129 pgs: 129 active+clean; 824 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.5 MiB/s wr, 1.63k op/s 2024-09-13T16:56:58.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:57 smithi144 ceph-mon[35328]: pgmap v525: 129 pgs: 129 active+clean; 824 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.5 MiB/s wr, 1.63k op/s 2024-09-13T16:56:59.964 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:59 smithi018 ceph-mon[30981]: pgmap v526: 129 pgs: 129 active+clean; 813 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 1.49k op/s 2024-09-13T16:56:59.964 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:56:59.964 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:56:59.964 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:56:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:57:00.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:59 smithi094 ceph-mon[35259]: pgmap v526: 129 pgs: 129 active+clean; 813 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 1.49k op/s 2024-09-13T16:57:00.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:57:00.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:57:00.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:56:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:57:00.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:59 smithi144 ceph-mon[35328]: pgmap v526: 129 pgs: 129 active+clean; 813 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 1.49k op/s 2024-09-13T16:57:00.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:57:00.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:57:00.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:56:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' 2024-09-13T16:57:02.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:01 smithi094 ceph-mon[35259]: pgmap v527: 129 pgs: 129 active+clean; 809 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 1.43k op/s 2024-09-13T16:57:02.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:01 smithi018 ceph-mon[30981]: pgmap v527: 129 pgs: 129 active+clean; 809 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 1.43k op/s 2024-09-13T16:57:02.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:01 smithi144 ceph-mon[35328]: pgmap v527: 129 pgs: 129 active+clean; 809 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 1.43k op/s 2024-09-13T16:57:04.161 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:03 smithi094 ceph-mon[35259]: pgmap v528: 129 pgs: 129 active+clean; 824 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 1.02k op/s 2024-09-13T16:57:04.240 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:03 smithi018 ceph-mon[30981]: pgmap v528: 129 pgs: 129 active+clean; 824 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 1.02k op/s 2024-09-13T16:57:04.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:03 smithi144 ceph-mon[35328]: pgmap v528: 129 pgs: 129 active+clean; 824 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 1.02k op/s 2024-09-13T16:57:06.167 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:05 smithi018 ceph-mon[30981]: pgmap v529: 129 pgs: 129 active+clean; 832 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 676 op/s 2024-09-13T16:57:06.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:05 smithi144 ceph-mon[35328]: pgmap v529: 129 pgs: 129 active+clean; 832 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 676 op/s 2024-09-13T16:57:06.306 INFO:tasks.workunit.client.0.smithi018.stdout: 209 459087 584 327995 822 217317 844 2024-09-13T16:57:06.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:05 smithi094 ceph-mon[35259]: pgmap v529: 129 pgs: 129 active+clean; 832 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 676 op/s 2024-09-13T16:57:08.186 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:07 smithi018 ceph-mon[30981]: pgmap v530: 129 pgs: 129 active+clean; 847 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 596 op/s 2024-09-13T16:57:08.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:07 smithi144 ceph-mon[35328]: pgmap v530: 129 pgs: 129 active+clean; 847 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 596 op/s 2024-09-13T16:57:08.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:07 smithi094 ceph-mon[35259]: pgmap v530: 129 pgs: 129 active+clean; 847 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 596 op/s 2024-09-13T16:57:09.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:08 smithi144 ceph-mon[35328]: pgmap v531: 129 pgs: 129 active+clean; 858 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 345 op/s 2024-09-13T16:57:09.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:08 smithi094 ceph-mon[35259]: pgmap v531: 129 pgs: 129 active+clean; 858 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 345 op/s 2024-09-13T16:57:09.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:08 smithi018 ceph-mon[30981]: pgmap v531: 129 pgs: 129 active+clean; 858 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 345 op/s 2024-09-13T16:57:11.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:11 smithi094 ceph-mon[35259]: pgmap v532: 129 pgs: 129 active+clean; 875 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.7 MiB/s wr, 383 op/s 2024-09-13T16:57:11.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:11 smithi018 ceph-mon[30981]: pgmap v532: 129 pgs: 129 active+clean; 875 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.7 MiB/s wr, 383 op/s 2024-09-13T16:57:11.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:11 smithi144 ceph-mon[35328]: pgmap v532: 129 pgs: 129 active+clean; 875 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.7 MiB/s wr, 383 op/s 2024-09-13T16:57:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.087+0000 7f91c6a00640 1 -- 172.21.15.18:0/1932679309 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8031800 con 0x7f91c8071860 2024-09-13T16:57:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.089+0000 7f91cdc00640 1 -- 172.21.15.18:0/1932679309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 msgr2=0x7f91c810b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.089+0000 7f91cdc00640 1 --2- 172.21.15.18:0/1932679309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 0x7f91c810b770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009900 tx=0x7f91b802a440 comp rx=0 tx=0).stop 2024-09-13T16:57:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.107+0000 7f91cdc00640 1 -- 172.21.15.18:0/1932679309 shutdown_connections 2024-09-13T16:57:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.107+0000 7f91cdc00640 1 --2- 172.21.15.18:0/1932679309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91c810bdc0 0x7f91c810e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.107+0000 7f91cdc00640 1 --2- 172.21.15.18:0/1932679309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 0x7f91c810b770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.107+0000 7f91cdc00640 1 --2- 172.21.15.18:0/1932679309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91c8070f40 0x7f91c8071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.107+0000 7f91cdc00640 1 -- 172.21.15.18:0/1932679309 >> 172.21.15.18:0/1932679309 conn(0x7f91c806cd10 msgr2=0x7f91c806f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.116+0000 7f91cdc00640 1 -- 172.21.15.18:0/1932679309 shutdown_connections 2024-09-13T16:57:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.120+0000 7f91cdc00640 1 -- 172.21.15.18:0/1932679309 wait complete. 2024-09-13T16:57:12.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.125+0000 7f91cdc00640 1 Processor -- start 2024-09-13T16:57:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.130+0000 7f91cdc00640 1 -- start start 2024-09-13T16:57:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.131+0000 7f91cdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91c8070f40 0x7f91c81a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.140+0000 7f91cdc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 0x7f91c81a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.140+0000 7f91cdc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91c810bdc0 0x7f91c81abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.140+0000 7f91cdc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c81ac2b0 con 0x7f91c810bdc0 2024-09-13T16:57:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.140+0000 7f91cdc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c81ac420 con 0x7f91c8071860 2024-09-13T16:57:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.140+0000 7f91cdc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c81ac5e0 con 0x7f91c8070f40 2024-09-13T16:57:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.141+0000 7f91cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91c810bdc0 0x7f91c81abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.141+0000 7f91cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91c810bdc0 0x7f91c81abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34884/0 (socket says 172.21.15.18:34884) 2024-09-13T16:57:12.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.141+0000 7f91cd200640 1 -- 172.21.15.18:0/3098791529 learned_addr learned my addr 172.21.15.18:0/3098791529 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:12.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.144+0000 7f91cd200640 1 -- 172.21.15.18:0/3098791529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91c8070f40 msgr2=0x7f91c81a47c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:57:12.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.144+0000 7f91cd200640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91c8070f40 0x7f91c81a47c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.144+0000 7f91cd200640 1 -- 172.21.15.18:0/3098791529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 msgr2=0x7f91c81a4d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:57:12.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.144+0000 7f91cd200640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 0x7f91c81a4d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.144+0000 7f91cd200640 1 -- 172.21.15.18:0/3098791529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8009560 con 0x7f91c810bdc0 2024-09-13T16:57:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.144+0000 7f91cd200640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91c810bdc0 0x7f91c81abd70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f91c000cad0 tx=0x7f91c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.160+0000 7f91c4c00640 1 -- 172.21.15.18:0/3098791529 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000ae20 con 0x7f91c810bdc0 2024-09-13T16:57:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.160+0000 7f91c4c00640 1 -- 172.21.15.18:0/3098791529 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91c0005020 con 0x7f91c810bdc0 2024-09-13T16:57:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.160+0000 7f91c4c00640 1 -- 172.21.15.18:0/3098791529 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000f6b0 con 0x7f91c810bdc0 2024-09-13T16:57:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.160+0000 7f91cdc00640 1 -- 172.21.15.18:0/3098791529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c810ec40 con 0x7f91c810bdc0 2024-09-13T16:57:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.160+0000 7f91cdc00640 1 -- 172.21.15.18:0/3098791529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c810f180 con 0x7f91c810bdc0 2024-09-13T16:57:12.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.195+0000 7f91d1fc3740 1 Processor -- start 2024-09-13T16:57:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.209+0000 7f91c4c00640 1 -- 172.21.15.18:0/3098791529 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f91c000f810 con 0x7f91c810bdc0 2024-09-13T16:57:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.215+0000 7f91c4c00640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f91ac0a1370 0x7f91ac0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.215+0000 7f91c4c00640 1 -- 172.21.15.18:0/3098791529 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f91c00dddf0 con 0x7f91c810bdc0 2024-09-13T16:57:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.217+0000 7f91d1fc3740 1 -- start start 2024-09-13T16:57:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.218+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c75e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.218+0000 7f91c7400640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f91ac0a1370 0x7f91ac0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.219+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c763040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.219+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c765ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.220+0000 7f91d1fc3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c669bb0 con 0x561a6c763610 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.220+0000 7f91d1fc3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c6c7a70 con 0x561a6c75dc40 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.220+0000 7f91d1fc3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c6c5200 con 0x561a6c75e580 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.221+0000 7f91c7400640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f91ac0a1370 0x7f91ac0a3830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009230 tx=0x7f91b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.222+0000 7f91c7e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c75e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.222+0000 7f91c7e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c75e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:41854/0 (socket says 172.21.15.18:41854) 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.222+0000 7f91c7e00640 1 -- 172.21.15.18:0/4089218660 learned_addr learned my addr 172.21.15.18:0/4089218660 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.225+0000 7f91cd200640 1 --2- 172.21.15.18:0/4089218660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c765ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.226+0000 7f91c7400640 1 --2- 172.21.15.18:0/4089218660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c763040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.227+0000 7f91cd200640 1 -- 172.21.15.18:0/4089218660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 msgr2=0x561a6c763040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.227+0000 7f91cd200640 1 --2- 172.21.15.18:0/4089218660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c763040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.227+0000 7f91cd200640 1 -- 172.21.15.18:0/4089218660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 msgr2=0x561a6c75e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.227+0000 7f91cd200640 1 --2- 172.21.15.18:0/4089218660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c75e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.227+0000 7f91cd200640 1 -- 172.21.15.18:0/4089218660 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a6c662940 con 0x561a6c763610 2024-09-13T16:57:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.228+0000 7f91cd200640 1 --2- 172.21.15.18:0/4089218660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c765ad0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f91c00aae10 tx=0x7f91c00aaaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8963b3edbf5053 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.249+0000 7f91cdc00640 1 -- 172.21.15.18:0/4089218660 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00b3300 con 0x561a6c763610 2024-09-13T16:57:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.249+0000 7f91cdc00640 1 -- 172.21.15.18:0/4089218660 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91c00abe90 con 0x561a6c763610 2024-09-13T16:57:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.249+0000 7f91cdc00640 1 -- 172.21.15.18:0/4089218660 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00b2e70 con 0x561a6c763610 2024-09-13T16:57:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.271+0000 7f91d1fc3740 1 -- 172.21.15.18:0/4089218660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 msgr2=0x561a6c765ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.271+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/4089218660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c765ad0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f91c00aae10 tx=0x7f91c00aaaf0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.305+0000 7f91d1fc3740 1 -- 172.21.15.18:0/4089218660 shutdown_connections 2024-09-13T16:57:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.305+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/4089218660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c765ad0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.305+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/4089218660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c763040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.305+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/4089218660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c75e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.305+0000 7f91d1fc3740 1 -- 172.21.15.18:0/4089218660 >> 172.21.15.18:0/4089218660 conn(0x561a6c7595a0 msgr2=0x561a6c7599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.305+0000 7f91d1fc3740 1 -- 172.21.15.18:0/4089218660 shutdown_connections 2024-09-13T16:57:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.305+0000 7f91d1fc3740 1 -- 172.21.15.18:0/4089218660 wait complete. 2024-09-13T16:57:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.306+0000 7f91d1fc3740 1 -- start start 2024-09-13T16:57:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.310+0000 7f91d1fc3740 1 Processor -- start 2024-09-13T16:57:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.311+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c767940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.313+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c767e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.313+0000 7f91c7e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c767940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.313+0000 7f91c7e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c767940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:41858/0 (socket says 172.21.15.18:41858) 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.313+0000 7f91c7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c767e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.314+0000 7f91c7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c767e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:34744/0 (socket says 172.21.15.18:34744) 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.314+0000 7f91c7e00640 1 -- 172.21.15.18:0/3588410664 learned_addr learned my addr 172.21.15.18:0/3588410664 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.314+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.314+0000 7f91cd200640 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.314+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c6c0af0 con 0x561a6c763610 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.314+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c67ef20 con 0x561a6c75dc40 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.314+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c67ebc0 con 0x561a6c75e580 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.316+0000 7f91cd200640 1 -- 172.21.15.18:0/3588410664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 msgr2=0x561a6c767e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.316+0000 7f91cd200640 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c767e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.316+0000 7f91cd200640 1 -- 172.21.15.18:0/3588410664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 msgr2=0x561a6c767940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.316+0000 7f91cd200640 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c767940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.316+0000 7f91cd200640 1 -- 172.21.15.18:0/3588410664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c810f180 con 0x561a6c763610 2024-09-13T16:57:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.316+0000 7f91cd200640 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76eec0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f91c00a91d0 tx=0x7f91c00b30a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa29bf4e0cf8f248 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.317+0000 7f91d1fc3740 10 client.0 _ll_register_callbacks cb 0x561a6c6b0a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:57:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.317+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a6c6eac90 con 0x561a6c763610 2024-09-13T16:57:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.346+0000 7f91b2000640 10 client.15603 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:57:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.346+0000 7f91b2000640 1 -- 172.21.15.18:0/3588410664 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00c7070 con 0x561a6c763610 2024-09-13T16:57:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.346+0000 7f91b2000640 1 -- 172.21.15.18:0/3588410664 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f91c00b3300 con 0x561a6c763610 2024-09-13T16:57:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.346+0000 7f91b2000640 1 -- 172.21.15.18:0/3588410664 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91c00a9220 con 0x561a6c763610 2024-09-13T16:57:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.355+0000 7f91d1fc3740 10 client.15603 fetch_fsmap learned FSMap version 31 2024-09-13T16:57:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.355+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=31}) v3 -- 0x561a6c6bf170 con 0x561a6c763610 2024-09-13T16:57:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.356+0000 7f91b2000640 1 -- 172.21.15.18:0/3588410664 <== mon.0 v2:172.21.15.18:3300/0 4 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f91c00a6c70 con 0x561a6c763610 2024-09-13T16:57:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.356+0000 7f91d1fc3740 10 client.15603 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T16:57:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.356+0000 7f91d1fc3740 10 client.15603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:57:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.356+0000 7f91d1fc3740 20 client.15603 populate_metadata read hostname 'smithi018' 2024-09-13T16:57:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.356+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561a6c772d30 0x561a6c7751f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.356+0000 7f91d1fc3740 4 client.15603 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:57:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.356+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a6c6b37d0 con 0x561a6c772d30 2024-09-13T16:57:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.356+0000 7f91c7e00640 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561a6c772d30 0x561a6c7751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.357+0000 7f91c7e00640 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561a6c772d30 0x561a6c7751f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c196e822ae6c1889 server_cookie=1f2ede3c7f4594a0 in_seq=0 out_seq=0 2024-09-13T16:57:12.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.357+0000 7f91b2000640 10 client.15603 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:12.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.360+0000 7f91b2000640 1 -- 172.21.15.18:0/3588410664 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561a6c6b37d0 con 0x561a6c772d30 2024-09-13T16:57:12.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.360+0000 7f91b2000640 10 client.15603 handle_command_reply: tid=0 2024-09-13T16:57:12.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.360+0000 7f91d1fc3740 1 client.15603 shutdown 2024-09-13T16:57:12.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.361+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 msgr2=0x561a6c76eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:12.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.361+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76eec0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f91c00a91d0 tx=0x7f91c00b30a0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.361+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 shutdown_connections 2024-09-13T16:57:12.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.361+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561a6c772d30 0x561a6c7751f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.361+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76eec0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.361+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c767e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.362+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/3588410664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c767940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.362+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 >> 172.21.15.18:0/3588410664 conn(0x561a6c7595a0 msgr2=0x561a6c75adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:12.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.362+0000 7f91b2000640 0 client.15603 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:12.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.362+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 shutdown_connections 2024-09-13T16:57:12.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.364+0000 7f91d1fc3740 1 -- 172.21.15.18:0/3588410664 wait complete. 2024-09-13T16:57:12.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.364+0000 7f91d1fc3740 20 client.15603 trim_cache size 0 max 16384 2024-09-13T16:57:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.608+0000 7f91d1fc3740 1 Processor -- start 2024-09-13T16:57:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.618+0000 7f91d1fc3740 1 -- start start 2024-09-13T16:57:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.618+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c758e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.618+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c76ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.618+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c7676f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.618+0000 7f91d1fc3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c427e60 con 0x561a6c763610 2024-09-13T16:57:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.618+0000 7f91d1fc3740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c76f4a0 con 0x561a6c75dc40 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.618+0000 7f91d1fc3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c6b37d0 con 0x561a6c75e580 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.619+0000 7f91c7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c76ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.619+0000 7f91c7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c76ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:34750/0 (socket says 172.21.15.18:34750) 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.619+0000 7f91c7400640 1 -- 172.21.15.18:0/1397101044 learned_addr learned my addr 172.21.15.18:0/1397101044 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.620+0000 7f91cd200640 1 --2- 172.21.15.18:0/1397101044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c7676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.621+0000 7f91cd200640 1 -- 172.21.15.18:0/1397101044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 msgr2=0x561a6c76ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.621+0000 7f91cd200640 1 --2- 172.21.15.18:0/1397101044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c76ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.621+0000 7f91cd200640 1 -- 172.21.15.18:0/1397101044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 msgr2=0x561a6c758e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.621+0000 7f91cd200640 1 --2- 172.21.15.18:0/1397101044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c758e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.621+0000 7f91cd200640 1 -- 172.21.15.18:0/1397101044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a6c661180 con 0x561a6c763610 2024-09-13T16:57:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.621+0000 7f91cd200640 1 --2- 172.21.15.18:0/1397101044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c7676f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f91c000a6e0 tx=0x7f91c00c2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b78ab77d0a587f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.638+0000 7f91bd600640 1 -- 172.21.15.18:0/1397101044 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00a6ff0 con 0x561a6c763610 2024-09-13T16:57:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.638+0000 7f91bd600640 1 -- 172.21.15.18:0/1397101044 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561a6c6eac90 con 0x561a6c763610 2024-09-13T16:57:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.638+0000 7f91bd600640 1 -- 172.21.15.18:0/1397101044 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0005470 con 0x561a6c763610 2024-09-13T16:57:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.639+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1397101044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 msgr2=0x561a6c7676f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.639+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/1397101044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c7676f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f91c000a6e0 tx=0x7f91c00c2000 comp rx=0 tx=0).stop 2024-09-13T16:57:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.648+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1397101044 shutdown_connections 2024-09-13T16:57:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.648+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/1397101044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c7676f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.648+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/1397101044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75e580 0x561a6c76ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.648+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/1397101044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75dc40 0x561a6c758e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.648+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1397101044 >> 172.21.15.18:0/1397101044 conn(0x561a6c7595a0 msgr2=0x561a6c75f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.649+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1397101044 shutdown_connections 2024-09-13T16:57:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.649+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1397101044 wait complete. 2024-09-13T16:57:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.649+0000 7f91d1fc3740 1 -- start start 2024-09-13T16:57:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.650+0000 7f91d1fc3740 1 Processor -- start 2024-09-13T16:57:12.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.657+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75dc40 0x561a6c76e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.657+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75e580 0x561a6c76eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.657+0000 7f91d1fc3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.658+0000 7f91cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.658+0000 7f91cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34938/0 (socket says 172.21.15.18:34938) 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.659+0000 7f91c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75dc40 0x561a6c76e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.659+0000 7f91c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75dc40 0x561a6c76e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:34758/0 (socket says 172.21.15.18:34758) 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.659+0000 7f91cd200640 1 -- 172.21.15.18:0/1442171400 learned_addr learned my addr 172.21.15.18:0/1442171400 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.659+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c76b6f0 con 0x561a6c763610 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.659+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c76b860 con 0x561a6c75e580 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.659+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6c76ba20 con 0x561a6c75dc40 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.659+0000 7f91cd200640 1 -- 172.21.15.18:0/1442171400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75dc40 msgr2=0x561a6c76e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.659+0000 7f91cd200640 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75dc40 0x561a6c76e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.659+0000 7f91cd200640 1 -- 172.21.15.18:0/1442171400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75e580 msgr2=0x561a6c76eb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:57:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.659+0000 7f91cd200640 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75e580 0x561a6c76eb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.660+0000 7f91cd200640 1 -- 172.21.15.18:0/1442171400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a6c6bf170 con 0x561a6c763610 2024-09-13T16:57:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.662+0000 7f91d1fc3740 10 client.0 _ll_register_callbacks cb 0x7f91c00a71c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:57:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.662+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91c00abe90 con 0x561a6c763610 2024-09-13T16:57:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.662+0000 7f91cd200640 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76b180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f91c0004df0 tx=0x7f91c00a72f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340011e6912ed8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.664+0000 7f91b2000640 10 client.15609 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:57:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.664+0000 7f91b2000640 1 -- 172.21.15.18:0/1442171400 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00c7070 con 0x561a6c763610 2024-09-13T16:57:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.664+0000 7f91b2000640 1 -- 172.21.15.18:0/1442171400 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f91c00b3300 con 0x561a6c763610 2024-09-13T16:57:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.664+0000 7f91b2000640 1 -- 172.21.15.18:0/1442171400 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91c0004e70 con 0x561a6c763610 2024-09-13T16:57:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.666+0000 7f91d1fc3740 10 client.15609 fetch_fsmap learned FSMap version 31 2024-09-13T16:57:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.666+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=31}) v3 -- 0x561a6c686560 con 0x561a6c763610 2024-09-13T16:57:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.666+0000 7f91b2000640 1 -- 172.21.15.18:0/1442171400 <== mon.0 v2:172.21.15.18:3300/0 4 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f91c000fac0 con 0x561a6c763610 2024-09-13T16:57:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.666+0000 7f91d1fc3740 10 client.15609 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T16:57:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.666+0000 7f91d1fc3740 10 client.15609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:57:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.666+0000 7f91d1fc3740 20 client.15609 populate_metadata read hostname 'smithi018' 2024-09-13T16:57:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.667+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561a6c7c9f20 0x561a6c7cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.667+0000 7f91d1fc3740 4 client.15609 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:57:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.667+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561a6c3b4300 con 0x561a6c7c9f20 2024-09-13T16:57:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.667+0000 7f91c7e00640 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561a6c7c9f20 0x561a6c7cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.672+0000 7f91c7e00640 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561a6c7c9f20 0x561a6c7cc350 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ce76299e257ffe0 server_cookie=4136437e1e3a45e9 in_seq=0 out_seq=0 2024-09-13T16:57:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:12.672+0000 7f91b2000640 10 client.15609 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:13.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:13 smithi094 ceph-mon[35259]: pgmap v533: 129 pgs: 129 active+clean; 882 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.7 MiB/s wr, 399 op/s 2024-09-13T16:57:13.478 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:13 smithi018 ceph-mon[30981]: pgmap v533: 129 pgs: 129 active+clean; 882 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.7 MiB/s wr, 399 op/s 2024-09-13T16:57:13.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:13 smithi144 ceph-mon[35328]: pgmap v533: 129 pgs: 129 active+clean; 882 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.7 MiB/s wr, 399 op/s 2024-09-13T16:57:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.133+0000 7f91bf400640 1 -- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91c810bdc0 msgr2=0x7f91c81abd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.133+0000 7f91bf400640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91c810bdc0 0x7f91c81abd70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f91c000cad0 tx=0x7f91c000cf90 comp rx=0 tx=0).stop 2024-09-13T16:57:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.134+0000 7f91bf400640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91a0003660 0x7f91a0005ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:15.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.138+0000 7f91c7400640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91a0003660 0x7f91a0005ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:15.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.141+0000 7f91bf400640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 0x7f91a0008690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.219+0000 7f91cd200640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 0x7f91a0008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:15.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.221+0000 7f91bf400640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91c8070f40 0x7f91a000b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:15.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.222+0000 7f91bf400640 1 -- 172.21.15.18:0/3098791529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a000bb90 con 0x7f91a0003660 2024-09-13T16:57:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.222+0000 7f91bf400640 1 -- 172.21.15.18:0/3098791529 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a000bcd0 con 0x7f91c8071860 2024-09-13T16:57:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.222+0000 7f91bf400640 1 -- 172.21.15.18:0/3098791529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a000be90 con 0x7f91c8070f40 2024-09-13T16:57:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.224+0000 7f91c7e00640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91c8070f40 0x7f91a000b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.225+0000 7f91cd200640 1 -- 172.21.15.18:0/3098791529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91c8070f40 msgr2=0x7f91a000b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.225+0000 7f91cd200640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91c8070f40 0x7f91a000b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.225+0000 7f91cd200640 1 -- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91a0003660 msgr2=0x7f91a0005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.225+0000 7f91cd200640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91a0003660 0x7f91a0005ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.225+0000 7f91cd200640 1 -- 172.21.15.18:0/3098791529 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=4+}) v3 -- 0x7f91a000c170 con 0x7f91c8071860 2024-09-13T16:57:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.228+0000 7f91cd200640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 0x7f91a0008690 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f91c00db8a0 tx=0x7f91c0007560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.261+0000 7f91c4c00640 1 -- 172.21.15.18:0/3098791529 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000fe40 con 0x7f91c8071860 2024-09-13T16:57:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.261+0000 7f91c4c00640 1 -- 172.21.15.18:0/3098791529 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91c00abe90 con 0x7f91c8071860 2024-09-13T16:57:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:15.261+0000 7f91c4c00640 1 -- 172.21.15.18:0/3098791529 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f91c00bed50 con 0x7f91c8071860 2024-09-13T16:57:15.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:15 smithi094 ceph-mon[35259]: pgmap v534: 129 pgs: 129 active+clean; 882 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 344 op/s 2024-09-13T16:57:15.498 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:15 smithi018 ceph-mon[30981]: pgmap v534: 129 pgs: 129 active+clean; 882 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 344 op/s 2024-09-13T16:57:15.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:15 smithi144 ceph-mon[35328]: pgmap v534: 129 pgs: 129 active+clean; 882 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 344 op/s 2024-09-13T16:57:16.310 INFO:tasks.workunit.client.0.smithi018.stdout: 221 447225 619 317988 557 203329 684 2024-09-13T16:57:17.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:17 smithi094 ceph-mon[35259]: pgmap v535: 129 pgs: 129 active+clean; 888 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 644 op/s 2024-09-13T16:57:17.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:17 smithi018 ceph-mon[30981]: pgmap v535: 129 pgs: 129 active+clean; 888 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 644 op/s 2024-09-13T16:57:17.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:17 smithi144 ceph-mon[35328]: pgmap v535: 129 pgs: 129 active+clean; 888 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 644 op/s 2024-09-13T16:57:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.560+0000 7f91b2000640 1 -- 172.21.15.18:0/1442171400 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561a6c3b4300 con 0x561a6c7c9f20 2024-09-13T16:57:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.560+0000 7f91b2000640 10 client.15609 handle_command_reply: tid=0 2024-09-13T16:57:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.584+0000 7f91d1fc3740 1 client.15609 shutdown 2024-09-13T16:57:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.584+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 msgr2=0x561a6c76b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.584+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76b180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f91c0004df0 tx=0x7f91c00a72f0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.584+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 shutdown_connections 2024-09-13T16:57:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.584+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561a6c7c9f20 0x561a6c7cc350 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.585+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a6c763610 0x561a6c76b180 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.585+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561a6c75e580 0x561a6c76eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.585+0000 7f91d1fc3740 1 --2- 172.21.15.18:0/1442171400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a6c75dc40 0x561a6c76e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.585+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 >> 172.21.15.18:0/1442171400 conn(0x561a6c7595a0 msgr2=0x561a6c7676f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.585+0000 7f91b2000640 0 client.15609 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.602+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 shutdown_connections 2024-09-13T16:57:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.611+0000 7f91d1fc3740 1 -- 172.21.15.18:0/1442171400 wait complete. 2024-09-13T16:57:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.611+0000 7f91d1fc3740 20 client.15609 trim_cache size 0 max 16384 2024-09-13T16:57:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:57:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:57:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:57:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:57:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.614+0000 7f91be000640 1 -- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f91ac0a1370 msgr2=0x7f91ac0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.614+0000 7f91be000640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f91ac0a1370 0x7f91ac0a3830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009230 tx=0x7f91b8000bc0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.614+0000 7f91be000640 1 -- 172.21.15.18:0/3098791529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 msgr2=0x7f91a0008690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.614+0000 7f91be000640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 0x7f91a0008690 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f91c00db8a0 tx=0x7f91c0007560 comp rx=0 tx=0).stop 2024-09-13T16:57:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.614+0000 7f91be000640 1 -- 172.21.15.18:0/3098791529 shutdown_connections 2024-09-13T16:57:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.614+0000 7f91be000640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91a0003660 0x7f91a0005ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.614+0000 7f91be000640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f91ac0a1370 0x7f91ac0a3830 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.614+0000 7f91be000640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91c8070f40 0x7f91a000b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.614+0000 7f91be000640 1 --2- 172.21.15.18:0/3098791529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91c8071860 0x7f91a0008690 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.614+0000 7f91be000640 1 -- 172.21.15.18:0/3098791529 >> 172.21.15.18:0/3098791529 conn(0x7f91c806cd10 msgr2=0x7f91c806e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.623+0000 7f91be000640 1 -- 172.21.15.18:0/3098791529 shutdown_connections 2024-09-13T16:57:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:18.625+0000 7f91be000640 1 -- 172.21.15.18:0/3098791529 wait complete. 2024-09-13T16:57:19.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:19 smithi094 ceph-mon[35259]: pgmap v536: 129 pgs: 129 active+clean; 899 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 1.02k op/s 2024-09-13T16:57:19.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:19 smithi018 ceph-mon[30981]: pgmap v536: 129 pgs: 129 active+clean; 899 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 1.02k op/s 2024-09-13T16:57:19.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:19 smithi144 ceph-mon[35328]: pgmap v536: 129 pgs: 129 active+clean; 899 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 1.02k op/s 2024-09-13T16:57:22.218 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:21 smithi018 ceph-mon[30981]: pgmap v537: 129 pgs: 129 active+clean; 907 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 1.10k op/s 2024-09-13T16:57:22.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:21 smithi144 ceph-mon[35328]: pgmap v537: 129 pgs: 129 active+clean; 907 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 1.10k op/s 2024-09-13T16:57:22.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:21 smithi094 ceph-mon[35259]: pgmap v537: 129 pgs: 129 active+clean; 907 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 1.10k op/s 2024-09-13T16:57:24.216 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:23 smithi018 ceph-mon[30981]: pgmap v538: 129 pgs: 129 active+clean; 916 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 1.14k op/s 2024-09-13T16:57:24.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:23 smithi144 ceph-mon[35328]: pgmap v538: 129 pgs: 129 active+clean; 916 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 1.14k op/s 2024-09-13T16:57:24.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:23 smithi094 ceph-mon[35259]: pgmap v538: 129 pgs: 129 active+clean; 916 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 1.14k op/s 2024-09-13T16:57:26.217 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:25 smithi018 ceph-mon[30981]: pgmap v539: 129 pgs: 129 active+clean; 923 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.3 MiB/s wr, 1.16k op/s 2024-09-13T16:57:26.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:25 smithi144 ceph-mon[35328]: pgmap v539: 129 pgs: 129 active+clean; 923 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.3 MiB/s wr, 1.16k op/s 2024-09-13T16:57:26.308 INFO:tasks.workunit.client.0.smithi018.stdout: 242 473455 1111 339983 1215 211481 106 2024-09-13T16:57:26.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:25 smithi094 ceph-mon[35259]: pgmap v539: 129 pgs: 129 active+clean; 923 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.3 MiB/s wr, 1.16k op/s 2024-09-13T16:57:27.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:27 smithi144 ceph-mon[35328]: pgmap v540: 129 pgs: 129 active+clean; 941 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.8 MiB/s wr, 1.22k op/s 2024-09-13T16:57:27.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:27 smithi094 ceph-mon[35259]: pgmap v540: 129 pgs: 129 active+clean; 941 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.8 MiB/s wr, 1.22k op/s 2024-09-13T16:57:27.482 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:27 smithi018 ceph-mon[30981]: pgmap v540: 129 pgs: 129 active+clean; 941 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.8 MiB/s wr, 1.22k op/s 2024-09-13T16:57:29.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:29 smithi144 ceph-mon[35328]: pgmap v541: 129 pgs: 129 active+clean; 954 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.4 MiB/s wr, 955 op/s 2024-09-13T16:57:29.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:29 smithi094 ceph-mon[35259]: pgmap v541: 129 pgs: 129 active+clean; 954 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.4 MiB/s wr, 955 op/s 2024-09-13T16:57:29.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:29 smithi018 ceph-mon[30981]: pgmap v541: 129 pgs: 129 active+clean; 954 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.4 MiB/s wr, 955 op/s 2024-09-13T16:57:31.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:31 smithi144 ceph-mon[35328]: pgmap v542: 129 pgs: 129 active+clean; 961 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 540 op/s 2024-09-13T16:57:31.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:31 smithi094 ceph-mon[35259]: pgmap v542: 129 pgs: 129 active+clean; 961 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 540 op/s 2024-09-13T16:57:31.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:31 smithi018 ceph-mon[30981]: pgmap v542: 129 pgs: 129 active+clean; 961 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 540 op/s 2024-09-13T16:57:33.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:33 smithi094 ceph-mon[35259]: pgmap v543: 129 pgs: 129 active+clean; 965 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 419 op/s 2024-09-13T16:57:33.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:33 smithi018 ceph-mon[30981]: pgmap v543: 129 pgs: 129 active+clean; 965 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 419 op/s 2024-09-13T16:57:33.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:33 smithi144 ceph-mon[35328]: pgmap v543: 129 pgs: 129 active+clean; 965 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 419 op/s 2024-09-13T16:57:33.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.635+0000 7fa6ef200640 1 -- 172.21.15.18:0/657598960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f0107740 msgr2=0x7fa6f0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.635+0000 7fa6ef200640 1 --2- 172.21.15.18:0/657598960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f0107740 0x7fa6f0107bc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009950 tx=0x7fa6dc02a480 comp rx=0 tx=0).stop 2024-09-13T16:57:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.651+0000 7fa6ef200640 1 -- 172.21.15.18:0/657598960 shutdown_connections 2024-09-13T16:57:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.651+0000 7fa6ef200640 1 --2- 172.21.15.18:0/657598960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f0107740 0x7fa6f0107bc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.651+0000 7fa6ef200640 1 --2- 172.21.15.18:0/657598960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f0108100 0x7fa6f0108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.651+0000 7fa6ef200640 1 --2- 172.21.15.18:0/657598960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6f0070c90 0x7fa6f00717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.651+0000 7fa6ef200640 1 -- 172.21.15.18:0/657598960 >> 172.21.15.18:0/657598960 conn(0x7fa6f006cd10 msgr2=0x7fa6f006f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.659+0000 7fa6ef200640 1 -- 172.21.15.18:0/657598960 shutdown_connections 2024-09-13T16:57:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.665+0000 7fa6ef200640 1 -- 172.21.15.18:0/657598960 wait complete. 2024-09-13T16:57:33.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.668+0000 7fa6ef200640 1 Processor -- start 2024-09-13T16:57:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.694+0000 7fa6ef200640 1 -- start start 2024-09-13T16:57:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.694+0000 7fa6ef200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6f0070c90 0x7fa6f01a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.694+0000 7fa6ef200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f0107740 0x7fa6f01a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.694+0000 7fa6ef200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f0108100 0x7fa6f01abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.694+0000 7fa6ef200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f01ac3a0 con 0x7fa6f0108100 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.694+0000 7fa6ef200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f01ac510 con 0x7fa6f0070c90 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.694+0000 7fa6ef200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f01ac6d0 con 0x7fa6f0107740 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.694+0000 7fa6ede00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6f0070c90 0x7fa6f01a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.695+0000 7fa6ede00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6f0070c90 0x7fa6f01a4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:43608/0 (socket says 172.21.15.18:43608) 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.695+0000 7fa6ede00640 1 -- 172.21.15.18:0/3151312558 learned_addr learned my addr 172.21.15.18:0/3151312558 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.695+0000 7fa6ed400640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f0107740 0x7fa6f01a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.696+0000 7fa6ed400640 1 -- 172.21.15.18:0/3151312558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6f0070c90 msgr2=0x7fa6f01a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.696+0000 7fa6ed400640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6f0070c90 0x7fa6f01a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.696+0000 7fa6ed400640 1 -- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f0108100 msgr2=0x7fa6f01abe60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.696+0000 7fa6ee800640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f0108100 0x7fa6f01abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.696+0000 7fa6ed400640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f0108100 0x7fa6f01abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.696+0000 7fa6ed400640 1 -- 172.21.15.18:0/3151312558 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc009560 con 0x7fa6f0107740 2024-09-13T16:57:33.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.697+0000 7fa6ee800640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f0108100 0x7fa6f01abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:57:33.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.697+0000 7fa6ed400640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f0107740 0x7fa6f01a4e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0098a0 tx=0x7fa6dc005d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.715+0000 7fa6e6a00640 1 -- 172.21.15.18:0/3151312558 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc004b50 con 0x7fa6f0107740 2024-09-13T16:57:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.715+0000 7fa6e6a00640 1 -- 172.21.15.18:0/3151312558 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6dc004cb0 con 0x7fa6f0107740 2024-09-13T16:57:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.715+0000 7fa6e6a00640 1 -- 172.21.15.18:0/3151312558 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc031960 con 0x7fa6f0107740 2024-09-13T16:57:33.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.732+0000 7fa6ef200640 1 -- 172.21.15.18:0/3151312558 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f00726e0 con 0x7fa6f0107740 2024-09-13T16:57:33.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.732+0000 7fa6ef200640 1 -- 172.21.15.18:0/3151312558 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f0072b10 con 0x7fa6f0107740 2024-09-13T16:57:33.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.806+0000 7fa6f81bf740 1 Processor -- start 2024-09-13T16:57:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.825+0000 7fa6f81bf740 1 -- start start 2024-09-13T16:57:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.827+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 0x561bb6425080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.827+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 0x561bb642a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.827+0000 7fa6ee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 0x561bb6425080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.827+0000 7fa6ee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 0x561bb6425080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:50326/0 (socket says 172.21.15.18:50326) 2024-09-13T16:57:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.829+0000 7fa6ede00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 0x561bb642a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.829+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 0x561bb642cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.829+0000 7fa6ede00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 0x561bb642a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52160/0 (socket says 172.21.15.18:52160) 2024-09-13T16:57:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.829+0000 7fa6ee800640 1 -- 172.21.15.18:0/2449692508 learned_addr learned my addr 172.21.15.18:0/2449692508 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.830+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2449692508 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb6330bb0 con 0x561bb64255c0 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.830+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2449692508 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb638ea70 con 0x561bb642a650 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.830+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2449692508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb638c200 con 0x561bb6424c80 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.836+0000 7fa6e6a00640 1 -- 172.21.15.18:0/3151312558 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa6dc031ac0 con 0x7fa6f0107740 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.836+0000 7fa6ed400640 1 --2- 172.21.15.18:0/2449692508 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 0x561bb642cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.838+0000 7fa6ede00640 1 -- 172.21.15.18:0/2449692508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 msgr2=0x561bb6425080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.838+0000 7fa6ede00640 1 --2- 172.21.15.18:0/2449692508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 0x561bb6425080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.838+0000 7fa6ede00640 1 -- 172.21.15.18:0/2449692508 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 msgr2=0x561bb642cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.838+0000 7fa6ede00640 1 --2- 172.21.15.18:0/2449692508 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 0x561bb642cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.838+0000 7fa6ede00640 1 -- 172.21.15.18:0/2449692508 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bb6329940 con 0x561bb64255c0 2024-09-13T16:57:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.839+0000 7fa6ede00640 1 --2- 172.21.15.18:0/2449692508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 0x561bb642a080 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000aca0 tx=0x7fa6e000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67c027f75252f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.845+0000 7fa6e6a00640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6d40a1370 0x7fa6d40a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.875+0000 7fa6e6a00640 1 -- 172.21.15.18:0/3151312558 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa6dc10ff00 con 0x7fa6f0107740 2024-09-13T16:57:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.876+0000 7fa6db400640 1 -- 172.21.15.18:0/2449692508 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0005220 con 0x561bb64255c0 2024-09-13T16:57:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.876+0000 7fa6db400640 1 -- 172.21.15.18:0/2449692508 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6e00047a0 con 0x561bb64255c0 2024-09-13T16:57:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.876+0000 7fa6db400640 1 -- 172.21.15.18:0/2449692508 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0018880 con 0x561bb64255c0 2024-09-13T16:57:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.895+0000 7fa6ee800640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6d40a1370 0x7fa6d40a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.902+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2449692508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 msgr2=0x561bb642a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.902+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/2449692508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 0x561bb642a080 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000aca0 tx=0x7fa6e000f790 comp rx=0 tx=0).stop 2024-09-13T16:57:33.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.913+0000 7fa6ee800640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6d40a1370 0x7fa6d40a3830 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80114a0 tx=0x7fa6e8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.936+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2449692508 shutdown_connections 2024-09-13T16:57:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.936+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/2449692508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 0x561bb642a080 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.936+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/2449692508 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 0x561bb642cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.936+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/2449692508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 0x561bb6425080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.936+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2449692508 >> 172.21.15.18:0/2449692508 conn(0x561bb64202f0 msgr2=0x561bb64206f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.939+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2449692508 shutdown_connections 2024-09-13T16:57:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.944+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2449692508 wait complete. 2024-09-13T16:57:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.944+0000 7fa6f81bf740 1 -- start start 2024-09-13T16:57:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.945+0000 7fa6f81bf740 1 Processor -- start 2024-09-13T16:57:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.957+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 0x561bb643f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.968+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 0x561bb643fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.968+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 0x561bb6446ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.968+0000 7fa6f81bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb6387af0 con 0x561bb64255c0 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.968+0000 7fa6f81bf740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb6345f20 con 0x561bb642a650 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.968+0000 7fa6f81bf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb6345bc0 con 0x561bb6424c80 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.968+0000 7fa6f81bf740 10 client.0 _ll_register_callbacks cb 0x561bb6377a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.973+0000 7fa6ee800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 0x561bb6446ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.973+0000 7fa6ee800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 0x561bb6446ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:43628/0 (socket says 172.21.15.18:43628) 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.973+0000 7fa6ee800640 1 -- 172.21.15.18:0/2737801932 learned_addr learned my addr 172.21.15.18:0/2737801932 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.981+0000 7fa6ede00640 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 0x561bb643f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.983+0000 7fa6ed400640 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 0x561bb643fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.985+0000 7fa6ee800640 1 -- 172.21.15.18:0/2737801932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 msgr2=0x561bb643f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.985+0000 7fa6ee800640 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 0x561bb643f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.985+0000 7fa6ee800640 1 -- 172.21.15.18:0/2737801932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 msgr2=0x561bb643fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.985+0000 7fa6ee800640 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 0x561bb643fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.985+0000 7fa6ee800640 1 -- 172.21.15.18:0/2737801932 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e000a8d0 con 0x561bb642a650 2024-09-13T16:57:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.991+0000 7fa6ee800640 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 0x561bb6446ed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8012930 tx=0x7fa6e8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219683863ad03c7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.991+0000 7fa6cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:57:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.993+0000 7fa6cfe00640 1 -- 172.21.15.18:0/2737801932 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800fd60 con 0x561bb642a650 2024-09-13T16:57:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:33.993+0000 7fa6cfe00640 1 -- 172.21.15.18:0/2737801932 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa6e8018070 con 0x561bb642a650 2024-09-13T16:57:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.005+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2737801932 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bb63b1c90 con 0x561bb642a650 2024-09-13T16:57:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.006+0000 7fa6cfe00640 1 -- 172.21.15.18:0/2737801932 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6e800fec0 con 0x561bb642a650 2024-09-13T16:57:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.052+0000 7fa6f81bf740 10 client.25676 fetch_fsmap learned FSMap version 31 2024-09-13T16:57:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.052+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2737801932 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561bb6386170 con 0x561bb642a650 2024-09-13T16:57:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.053+0000 7fa6cfe00640 1 -- 172.21.15.18:0/2737801932 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561bb63b1c90 con 0x561bb642a650 2024-09-13T16:57:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.053+0000 7fa6cfe00640 1 -- 172.21.15.18:0/2737801932 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 32) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fa6e8025020 con 0x561bb642a650 2024-09-13T16:57:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.053+0000 7fa6f81bf740 10 client.25676 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T16:57:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.053+0000 7fa6f81bf740 10 client.25676 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:57:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.053+0000 7fa6f81bf740 20 client.25676 populate_metadata read hostname 'smithi018' 2024-09-13T16:57:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.053+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561bb644b610 0x561bb644da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.053+0000 7fa6f81bf740 4 client.25676 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:57:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.053+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2737801932 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561bb637a7d0 con 0x561bb644b610 2024-09-13T16:57:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.054+0000 7fa6ede00640 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561bb644b610 0x561bb644da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.063+0000 7fa6ede00640 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561bb644b610 0x561bb644da30 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49306730eccfc96 server_cookie=ae1f7dbef275d602 in_seq=0 out_seq=0 2024-09-13T16:57:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.063+0000 7fa6cfe00640 10 client.25676 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.065+0000 7fa6cfe00640 1 -- 172.21.15.18:0/2737801932 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561bb637a7d0 con 0x561bb644b610 2024-09-13T16:57:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.065+0000 7fa6cfe00640 10 client.25676 handle_command_reply: tid=0 2024-09-13T16:57:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.066+0000 7fa6f81bf740 1 client.25676 shutdown 2024-09-13T16:57:34.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.074+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2737801932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 msgr2=0x561bb6446ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:34.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.074+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 0x561bb6446ed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8012930 tx=0x7fa6e8004a40 comp rx=0 tx=0).stop 2024-09-13T16:57:34.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.074+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2737801932 shutdown_connections 2024-09-13T16:57:34.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.074+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561bb644b610 0x561bb644da30 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.074+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb64255c0 0x561bb643fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.074+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb642a650 0x561bb6446ed0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.074+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/2737801932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb6424c80 0x561bb643f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.074+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2737801932 >> 172.21.15.18:0/2737801932 conn(0x561bb64202f0 msgr2=0x561bb6421b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:34.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.074+0000 7fa6cfe00640 0 client.25676 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:34.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.075+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2737801932 shutdown_connections 2024-09-13T16:57:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.075+0000 7fa6f81bf740 1 -- 172.21.15.18:0/2737801932 wait complete. 2024-09-13T16:57:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.086+0000 7fa6f81bf740 20 client.25676 trim_cache size 0 max 16384 2024-09-13T16:57:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.175+0000 7fa6f81bf740 1 Processor -- start 2024-09-13T16:57:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.175+0000 7fa6f81bf740 1 -- start start 2024-09-13T16:57:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.175+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb6424c80 0x561bb6429b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.175+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb64255c0 0x561bb642a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.176+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb645b8d0 0x561bb645bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.176+0000 7fa6f81bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb60eee60 con 0x561bb6424c80 2024-09-13T16:57:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.176+0000 7fa6ede00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb6424c80 0x561bb6429b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.176+0000 7fa6ede00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb6424c80 0x561bb6429b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52184/0 (socket says 172.21.15.18:52184) 2024-09-13T16:57:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.176+0000 7fa6ede00640 1 -- 172.21.15.18:0/1863544623 learned_addr learned my addr 172.21.15.18:0/1863544623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.177+0000 7fa6ee800640 1 --2- 172.21.15.18:0/1863544623 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb645b8d0 0x561bb645bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.177+0000 7fa6f81bf740 1 -- 172.21.15.18:0/1863544623 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb644b1b0 con 0x561bb645b8d0 2024-09-13T16:57:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.177+0000 7fa6f81bf740 1 -- 172.21.15.18:0/1863544623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb6426020 con 0x561bb64255c0 2024-09-13T16:57:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.178+0000 7fa6ede00640 1 -- 172.21.15.18:0/1863544623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb64255c0 msgr2=0x561bb642a040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:57:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.178+0000 7fa6ede00640 1 --2- 172.21.15.18:0/1863544623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb64255c0 0x561bb642a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.178+0000 7fa6ede00640 1 -- 172.21.15.18:0/1863544623 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb645b8d0 msgr2=0x561bb645bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.178+0000 7fa6ede00640 1 --2- 172.21.15.18:0/1863544623 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb645b8d0 0x561bb645bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.178+0000 7fa6ede00640 1 -- 172.21.15.18:0/1863544623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bb6328180 con 0x561bb6424c80 2024-09-13T16:57:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.179+0000 7fa6ede00640 1 --2- 172.21.15.18:0/1863544623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb6424c80 0x561bb6429b00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000aca0 tx=0x7fa6e000afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83174b40503fd282 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.180+0000 7fa6dbe00640 1 -- 172.21.15.18:0/1863544623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e002a070 con 0x561bb6424c80 2024-09-13T16:57:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.180+0000 7fa6dbe00640 1 -- 172.21.15.18:0/1863544623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6e00189a0 con 0x561bb6424c80 2024-09-13T16:57:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.180+0000 7fa6dbe00640 1 -- 172.21.15.18:0/1863544623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e002f700 con 0x561bb6424c80 2024-09-13T16:57:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.182+0000 7fa6f81bf740 1 -- 172.21.15.18:0/1863544623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb6424c80 msgr2=0x561bb6429b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.182+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/1863544623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb6424c80 0x561bb6429b00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000aca0 tx=0x7fa6e000afa0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.191+0000 7fa6f81bf740 1 -- 172.21.15.18:0/1863544623 shutdown_connections 2024-09-13T16:57:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.191+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/1863544623 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb645b8d0 0x561bb645bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.191+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/1863544623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb64255c0 0x561bb642a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.191+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/1863544623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb6424c80 0x561bb6429b00 secure :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000aca0 tx=0x7fa6e000afa0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.191+0000 7fa6f81bf740 1 -- 172.21.15.18:0/1863544623 >> 172.21.15.18:0/1863544623 conn(0x561bb64202f0 msgr2=0x561bb6452390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.192+0000 7fa6f81bf740 1 -- 172.21.15.18:0/1863544623 shutdown_connections 2024-09-13T16:57:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.192+0000 7fa6f81bf740 1 -- 172.21.15.18:0/1863544623 wait complete. 2024-09-13T16:57:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.192+0000 7fa6f81bf740 1 -- start start 2024-09-13T16:57:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.193+0000 7fa6f81bf740 1 Processor -- start 2024-09-13T16:57:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.195+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb64255c0 0x561bb6459ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.196+0000 7fa6f81bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb645b8d0 0x561bb645a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.197+0000 7fa6ed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb645b8d0 0x561bb645a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.197+0000 7fa6ed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb645b8d0 0x561bb645a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52200/0 (socket says 172.21.15.18:52200) 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.197+0000 7fa6ede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb64255c0 0x561bb6459ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.197+0000 7fa6ed400640 1 -- 172.21.15.18:0/251595047 learned_addr learned my addr 172.21.15.18:0/251595047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.197+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb645a760 0x561bb64a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.199+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb645b700 con 0x561bb645b8d0 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.199+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb64a4af0 con 0x561bb645a760 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.199+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb64a4c30 con 0x561bb64255c0 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.199+0000 7fa6ee800640 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb645a760 0x561bb64a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.199+0000 7fa6ed400640 1 -- 172.21.15.18:0/251595047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb64255c0 msgr2=0x561bb6459ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.199+0000 7fa6ed400640 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb64255c0 0x561bb6459ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.199+0000 7fa6ed400640 1 -- 172.21.15.18:0/251595047 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb645a760 msgr2=0x561bb64a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.199+0000 7fa6ed400640 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb645a760 0x561bb64a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.199+0000 7fa6ed400640 1 -- 172.21.15.18:0/251595047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561bb6329940 con 0x561bb645b8d0 2024-09-13T16:57:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.200+0000 7fa6f81bf740 10 client.0 _ll_register_callbacks cb 0x7fa6e000a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:57:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.200+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bb641bb50 con 0x561bb645b8d0 2024-09-13T16:57:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.200+0000 7fa6ed400640 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb645b8d0 0x561bb645a220 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0d9400 tx=0x7fa6dc004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51f4f4ec0a4cec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.201+0000 7fa6cfe00640 10 client.15624 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:57:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.201+0000 7fa6cfe00640 1 -- 172.21.15.18:0/251595047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0dc680 con 0x561bb645b8d0 2024-09-13T16:57:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.201+0000 7fa6cfe00640 1 -- 172.21.15.18:0/251595047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa6dc0dd690 con 0x561bb645b8d0 2024-09-13T16:57:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.202+0000 7fa6cfe00640 1 -- 172.21.15.18:0/251595047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6dc0dcd60 con 0x561bb645b8d0 2024-09-13T16:57:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.202+0000 7fa6f81bf740 10 client.15624 fetch_fsmap learned FSMap version 32 2024-09-13T16:57:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.202+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=32}) v3 -- 0x561bb634d560 con 0x561bb645b8d0 2024-09-13T16:57:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.217+0000 7fa6cfe00640 1 -- 172.21.15.18:0/251595047 <== mon.0 v2:172.21.15.18:3300/0 4 ==== fsmap(e 32) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fa6dc0e4f80 con 0x561bb645b8d0 2024-09-13T16:57:34.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.221+0000 7fa6f81bf740 10 client.15624 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T16:57:34.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.221+0000 7fa6f81bf740 10 client.15624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:57:34.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.221+0000 7fa6f81bf740 20 client.15624 populate_metadata read hostname 'smithi018' 2024-09-13T16:57:34.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.221+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561bb64a6050 0x561bb64a8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.221+0000 7fa6f81bf740 4 client.15624 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:57:34.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.221+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7fa6e00047a0 con 0x561bb64a6050 2024-09-13T16:57:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.234+0000 7fa6ede00640 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561bb64a6050 0x561bb64a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.243+0000 7fa6ede00640 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561bb64a6050 0x561bb64a8510 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=859e3af997ed0d39 server_cookie=31544ff7674b79f1 in_seq=0 out_seq=0 2024-09-13T16:57:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:34.243+0000 7fa6cfe00640 10 client.15624 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:35.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:35 smithi094 ceph-mon[35259]: pgmap v544: 129 pgs: 129 active+clean; 970 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.3 MiB/s wr, 328 op/s 2024-09-13T16:57:35.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:35 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:57:35.465 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:35 smithi018 ceph-mon[30981]: pgmap v544: 129 pgs: 129 active+clean; 970 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.3 MiB/s wr, 328 op/s 2024-09-13T16:57:35.465 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:35 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:57:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:35 smithi144 ceph-mon[35328]: pgmap v544: 129 pgs: 129 active+clean; 970 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.3 MiB/s wr, 328 op/s 2024-09-13T16:57:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:35 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:57:36.351 INFO:tasks.workunit.client.0.smithi018.stdout: 272 527122 1509 375522 1504 212272 479 2024-09-13T16:57:37.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:37 smithi094 ceph-mon[35259]: pgmap v545: 129 pgs: 129 active+clean; 975 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 314 op/s 2024-09-13T16:57:37.481 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:37 smithi018 ceph-mon[30981]: pgmap v545: 129 pgs: 129 active+clean; 975 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 314 op/s 2024-09-13T16:57:37.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:37 smithi144 ceph-mon[35328]: pgmap v545: 129 pgs: 129 active+clean; 975 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 314 op/s 2024-09-13T16:57:39.233 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:39 smithi018 ceph-mon[30981]: pgmap v546: 129 pgs: 129 active+clean; 979 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 595 op/s 2024-09-13T16:57:39.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:39 smithi094 ceph-mon[35259]: pgmap v546: 129 pgs: 129 active+clean; 979 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 595 op/s 2024-09-13T16:57:39.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:39 smithi144 ceph-mon[35328]: pgmap v546: 129 pgs: 129 active+clean; 979 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 595 op/s 2024-09-13T16:57:40.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:40 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:57:40.466 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:40 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:57:40.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:40 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:57:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.225+0000 7fa6cfe00640 1 -- 172.21.15.18:0/251595047 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7fa6e00047a0 con 0x561bb64a6050 2024-09-13T16:57:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.225+0000 7fa6cfe00640 10 client.15624 handle_command_reply: tid=0 2024-09-13T16:57:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.248+0000 7fa6f81bf740 1 client.15624 shutdown 2024-09-13T16:57:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.254+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb645b8d0 msgr2=0x561bb645a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.254+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb645b8d0 0x561bb645a220 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0d9400 tx=0x7fa6dc004f90 comp rx=0 tx=0).stop 2024-09-13T16:57:41.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.255+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 shutdown_connections 2024-09-13T16:57:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.255+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561bb64a6050 0x561bb64a8510 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.255+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bb645b8d0 0x561bb645a220 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.255+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561bb645a760 0x561bb64a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.255+0000 7fa6f81bf740 1 --2- 172.21.15.18:0/251595047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bb64255c0 0x561bb6459ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.255+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 >> 172.21.15.18:0/251595047 conn(0x561bb64202f0 msgr2=0x561bb64264e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.255+0000 7fa6cfe00640 0 client.15624 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.276+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 shutdown_connections 2024-09-13T16:57:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.281+0000 7fa6f81bf740 1 -- 172.21.15.18:0/251595047 wait complete. 2024-09-13T16:57:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.336+0000 7fa6f81bf740 20 client.15624 trim_cache size 0 max 16384 2024-09-13T16:57:41.346 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:57:41.346 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:57:41.346 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:57:41.346 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:57:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.367+0000 7fa6ef200640 1 -- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6d40a1370 msgr2=0x7fa6d40a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.367+0000 7fa6ef200640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6d40a1370 0x7fa6d40a3830 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80114a0 tx=0x7fa6e8009500 comp rx=0 tx=0).stop 2024-09-13T16:57:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.367+0000 7fa6ef200640 1 -- 172.21.15.18:0/3151312558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f0107740 msgr2=0x7fa6f01a4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.367+0000 7fa6ef200640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f0107740 0x7fa6f01a4e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0098a0 tx=0x7fa6dc005d10 comp rx=0 tx=0).stop 2024-09-13T16:57:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.371+0000 7fa6ef200640 1 -- 172.21.15.18:0/3151312558 shutdown_connections 2024-09-13T16:57:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.372+0000 7fa6ef200640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6d40a1370 0x7fa6d40a3830 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.373+0000 7fa6ef200640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f0108100 0x7fa6f01abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.373+0000 7fa6ef200640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6f0107740 0x7fa6f01a4e40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.373+0000 7fa6ef200640 1 --2- 172.21.15.18:0/3151312558 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6f0070c90 0x7fa6f01a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:41.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.373+0000 7fa6ef200640 1 -- 172.21.15.18:0/3151312558 >> 172.21.15.18:0/3151312558 conn(0x7fa6f006cd10 msgr2=0x7fa6f010dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:41.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.383+0000 7fa6ef200640 1 -- 172.21.15.18:0/3151312558 shutdown_connections 2024-09-13T16:57:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:41.395+0000 7fa6ef200640 1 -- 172.21.15.18:0/3151312558 wait complete. 2024-09-13T16:57:41.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:41 smithi094 ceph-mon[35259]: pgmap v547: 129 pgs: 129 active+clean; 1000 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 936 op/s 2024-09-13T16:57:41.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:41 smithi144 ceph-mon[35328]: pgmap v547: 129 pgs: 129 active+clean; 1000 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 936 op/s 2024-09-13T16:57:41.558 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:41 smithi018 ceph-mon[30981]: pgmap v547: 129 pgs: 129 active+clean; 1000 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 936 op/s 2024-09-13T16:57:43.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:43 smithi094 ceph-mon[35259]: pgmap v548: 129 pgs: 129 active+clean; 1016 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 957 op/s 2024-09-13T16:57:43.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:43 smithi018 ceph-mon[30981]: pgmap v548: 129 pgs: 129 active+clean; 1016 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 957 op/s 2024-09-13T16:57:43.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:43 smithi144 ceph-mon[35328]: pgmap v548: 129 pgs: 129 active+clean; 1016 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 957 op/s 2024-09-13T16:57:45.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:45 smithi094 ceph-mon[35259]: pgmap v549: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 1.22k op/s 2024-09-13T16:57:45.484 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:45 smithi018 ceph-mon[30981]: pgmap v549: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 1.22k op/s 2024-09-13T16:57:45.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:45 smithi144 ceph-mon[35328]: pgmap v549: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 1.22k op/s 2024-09-13T16:57:46.323 INFO:tasks.workunit.client.0.smithi018.stdout: 286 390823 653 282125 608 147875 19 2024-09-13T16:57:47.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:47 smithi094 ceph-mon[35259]: pgmap v550: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.7 MiB/s wr, 1.29k op/s 2024-09-13T16:57:47.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:47 smithi018 ceph-mon[30981]: pgmap v550: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.7 MiB/s wr, 1.29k op/s 2024-09-13T16:57:47.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:47 smithi144 ceph-mon[35328]: pgmap v550: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.7 MiB/s wr, 1.29k op/s 2024-09-13T16:57:49.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:49 smithi094 ceph-mon[35259]: pgmap v551: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2024-09-13T16:57:49.473 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:49 smithi018 ceph-mon[30981]: pgmap v551: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2024-09-13T16:57:49.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:49 smithi144 ceph-mon[35328]: pgmap v551: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2024-09-13T16:57:51.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:51 smithi094 ceph-mon[35259]: pgmap v552: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-09-13T16:57:51.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:51 smithi018 ceph-mon[30981]: pgmap v552: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-09-13T16:57:51.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:51 smithi144 ceph-mon[35328]: pgmap v552: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-09-13T16:57:53.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:53 smithi094 ceph-mon[35259]: pgmap v553: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 653 op/s 2024-09-13T16:57:53.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:53 smithi018 ceph-mon[30981]: pgmap v553: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 653 op/s 2024-09-13T16:57:53.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:53 smithi144 ceph-mon[35328]: pgmap v553: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 653 op/s 2024-09-13T16:57:55.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:55 smithi094 ceph-mon[35259]: pgmap v554: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 637 op/s 2024-09-13T16:57:55.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:55 smithi018 ceph-mon[30981]: pgmap v554: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 637 op/s 2024-09-13T16:57:55.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:55 smithi144 ceph-mon[35328]: pgmap v554: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 637 op/s 2024-09-13T16:57:56.326 INFO:tasks.workunit.client.0.smithi018.stdout: 312 533882 1475 381984 1456 192782 584 2024-09-13T16:57:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.820+0000 7f6ca9000640 1 -- 172.21.15.18:0/3984213095 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c9c0a6430 msgr2=0x7f6c9c0accc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.820+0000 7f6ca9000640 1 --2- 172.21.15.18:0/3984213095 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c9c0a6430 0x7f6c9c0accc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4065740 tx=0x7f6ca408d470 comp rx=0 tx=0).stop 2024-09-13T16:57:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.820+0000 7f6ca9000640 1 -- 172.21.15.18:0/3984213095 shutdown_connections 2024-09-13T16:57:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.820+0000 7f6ca9000640 1 --2- 172.21.15.18:0/3984213095 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c9c0a6430 0x7f6c9c0accc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.820+0000 7f6ca9000640 1 --2- 172.21.15.18:0/3984213095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0a5a70 0x7f6c9c0a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.820+0000 7f6ca9000640 1 --2- 172.21.15.18:0/3984213095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c0a4880 0x7f6c9c0a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.820+0000 7f6ca9000640 1 -- 172.21.15.18:0/3984213095 >> 172.21.15.18:0/3984213095 conn(0x7f6c9c09fb70 msgr2=0x7f6c9c0a1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.821+0000 7f6ca9000640 1 -- 172.21.15.18:0/3984213095 shutdown_connections 2024-09-13T16:57:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.821+0000 7f6ca9000640 1 -- 172.21.15.18:0/3984213095 wait complete. 2024-09-13T16:57:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.826+0000 7f6ca9000640 1 Processor -- start 2024-09-13T16:57:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.827+0000 7f6ca9000640 1 -- start start 2024-09-13T16:57:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.827+0000 7f6ca9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c0a4880 0x7f6c9c0a8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.828+0000 7f6ca9000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0a5a70 0x7f6c9c0a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.828+0000 7f6ca9000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c9c0a6430 0x7f6c9c0a7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.828+0000 7f6ca9000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c140410 con 0x7f6c9c0a4880 2024-09-13T16:57:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.828+0000 7f6ca9000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0a78d0 con 0x7f6c9c0a6430 2024-09-13T16:57:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.828+0000 7f6ca9000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0a7a90 con 0x7f6c9c0a5a70 2024-09-13T16:57:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.828+0000 7f6caa600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c9c0a6430 0x7f6c9c0a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.828+0000 7f6caa600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c9c0a6430 0x7f6c9c0a7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:37754/0 (socket says 172.21.15.18:37754) 2024-09-13T16:57:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.828+0000 7f6caa600640 1 -- 172.21.15.18:0/3785307200 learned_addr learned my addr 172.21.15.18:0/3785307200 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.829+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0a5a70 0x7f6c9c0a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.829+0000 7f6caa600640 1 -- 172.21.15.18:0/3785307200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0a5a70 msgr2=0x7f6c9c0a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.829+0000 7f6caa600640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0a5a70 0x7f6c9c0a6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.829+0000 7f6caa600640 1 -- 172.21.15.18:0/3785307200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c0a4880 msgr2=0x7f6c9c0a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.829+0000 7f6caa600640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c0a4880 0x7f6c9c0a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.829+0000 7f6caa600640 1 -- 172.21.15.18:0/3785307200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca404f140 con 0x7f6c9c0a6430 2024-09-13T16:57:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.830+0000 7f6caa600640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c9c0a6430 0x7f6c9c0a7390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ca404f480 tx=0x7f6ca406af40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:56.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.831+0000 7f6c97e00640 1 -- 172.21.15.18:0/3785307200 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca409a070 con 0x7f6c9c0a6430 2024-09-13T16:57:56.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.831+0000 7f6c97e00640 1 -- 172.21.15.18:0/3785307200 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ca4093c80 con 0x7f6c9c0a6430 2024-09-13T16:57:56.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.832+0000 7f6c97e00640 1 -- 172.21.15.18:0/3785307200 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca406d980 con 0x7f6c9c0a6430 2024-09-13T16:57:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.845+0000 7f6ca9000640 1 -- 172.21.15.18:0/3785307200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c0a7cb0 con 0x7f6c9c0a6430 2024-09-13T16:57:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.845+0000 7f6ca9000640 1 -- 172.21.15.18:0/3785307200 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c14b100 con 0x7f6c9c0a6430 2024-09-13T16:57:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.865+0000 7f6cad49a740 1 Processor -- start 2024-09-13T16:57:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.878+0000 7f6c97e00640 1 -- 172.21.15.18:0/3785307200 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6ca4092030 con 0x7f6c9c0a6430 2024-09-13T16:57:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.880+0000 7f6cad49a740 1 -- start start 2024-09-13T16:57:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.881+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d30c80 0x5648e0d31080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.881+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d315c0 0x5648e0d36080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.881+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d38b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.881+0000 7f6cad49a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0c3cbb0 con 0x5648e0d36650 2024-09-13T16:57:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.881+0000 7f6cad49a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0c9aa70 con 0x5648e0d315c0 2024-09-13T16:57:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.881+0000 7f6cad49a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0c98200 con 0x5648e0d30c80 2024-09-13T16:57:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.884+0000 7f6ca2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d38b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.884+0000 7f6ca3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d315c0 0x5648e0d36080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.884+0000 7f6ca2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d38b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34902/0 (socket says 172.21.15.18:34902) 2024-09-13T16:57:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.884+0000 7f6ca2a00640 1 -- 172.21.15.18:0/2403709005 learned_addr learned my addr 172.21.15.18:0/2403709005 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.888+0000 7f6ca2a00640 1 -- 172.21.15.18:0/2403709005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d30c80 msgr2=0x5648e0d31080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:57:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.888+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/2403709005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d30c80 0x5648e0d31080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.888+0000 7f6ca2a00640 1 -- 172.21.15.18:0/2403709005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d315c0 msgr2=0x5648e0d36080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.888+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/2403709005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d315c0 0x5648e0d36080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.888+0000 7f6ca2a00640 1 -- 172.21.15.18:0/2403709005 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648e0c35940 con 0x5648e0d36650 2024-09-13T16:57:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.888+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/2403709005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d38b10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009b80 tx=0x7f6c90010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f68f04d074de33f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.889+0000 7f6ca3400640 1 --2- 172.21.15.18:0/2403709005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d315c0 0x5648e0d36080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:57:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.889+0000 7f6c97e00640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6c8c0a0fc0 0x7f6c8c0a3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.894+0000 7f6c94c00640 1 -- 172.21.15.18:0/2403709005 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90009e70 con 0x5648e0d36650 2024-09-13T16:57:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.894+0000 7f6c94c00640 1 -- 172.21.15.18:0/2403709005 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c900035f0 con 0x5648e0d36650 2024-09-13T16:57:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.894+0000 7f6c94c00640 1 -- 172.21.15.18:0/2403709005 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900044e0 con 0x5648e0d36650 2024-09-13T16:57:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.894+0000 7f6ca3400640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6c8c0a0fc0 0x7f6c8c0a3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.895+0000 7f6cad49a740 1 -- 172.21.15.18:0/2403709005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 msgr2=0x5648e0d38b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.895+0000 7f6cad49a740 1 --2- 172.21.15.18:0/2403709005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d38b10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009b80 tx=0x7f6c90010740 comp rx=0 tx=0).stop 2024-09-13T16:57:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.897+0000 7f6ca3400640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6c8c0a0fc0 0x7f6c8c0a3480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5648e0d31ff0 tx=0x7f6c98009710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.894+0000 7f6c97e00640 1 -- 172.21.15.18:0/3785307200 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f6ca414da40 con 0x7f6c9c0a6430 2024-09-13T16:57:56.904 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.898+0000 7f6cad49a740 1 -- 172.21.15.18:0/2403709005 shutdown_connections 2024-09-13T16:57:56.904 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.898+0000 7f6cad49a740 1 --2- 172.21.15.18:0/2403709005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d38b10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.904 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.898+0000 7f6cad49a740 1 --2- 172.21.15.18:0/2403709005 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d315c0 0x5648e0d36080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.904 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.898+0000 7f6cad49a740 1 --2- 172.21.15.18:0/2403709005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d30c80 0x5648e0d31080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.904 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.898+0000 7f6cad49a740 1 -- 172.21.15.18:0/2403709005 >> 172.21.15.18:0/2403709005 conn(0x5648e0d2c2f0 msgr2=0x5648e0d2c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.911+0000 7f6cad49a740 1 -- 172.21.15.18:0/2403709005 shutdown_connections 2024-09-13T16:57:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.911+0000 7f6cad49a740 1 -- 172.21.15.18:0/2403709005 wait complete. 2024-09-13T16:57:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.912+0000 7f6cad49a740 1 -- start start 2024-09-13T16:57:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.912+0000 7f6cad49a740 1 Processor -- start 2024-09-13T16:57:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.913+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d4ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.913+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d315c0 0x5648e0d4bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.913+0000 7f6ca3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d4ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.913+0000 7f6ca3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d4ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:37764/0 (socket says 172.21.15.18:37764) 2024-09-13T16:57:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.914+0000 7f6ca3400640 1 -- 172.21.15.18:0/1974206998 learned_addr learned my addr 172.21.15.18:0/1974206998 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.915+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d315c0 0x5648e0d4bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.915+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d52f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.915+0000 7f6caa600640 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d52f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.916+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0c93af0 con 0x5648e0d36650 2024-09-13T16:57:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.916+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0c51f20 con 0x5648e0d30c80 2024-09-13T16:57:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.916+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0c51bc0 con 0x5648e0d315c0 2024-09-13T16:57:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.916+0000 7f6ca2a00640 1 -- 172.21.15.18:0/1974206998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 msgr2=0x5648e0d4ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.916+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d4ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.916+0000 7f6ca2a00640 1 -- 172.21.15.18:0/1974206998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 msgr2=0x5648e0d52f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.916+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d52f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.916+0000 7f6ca2a00640 1 -- 172.21.15.18:0/1974206998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c900097e0 con 0x5648e0d315c0 2024-09-13T16:57:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.917+0000 7f6caa600640 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d52f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:57:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.917+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d315c0 0x5648e0d4bf50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6c90010c40 tx=0x7f6c90003990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec57f02ad15531ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.917+0000 7f6c89600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:57:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.917+0000 7f6cad49a740 10 client.0 _ll_register_callbacks cb 0x5648e0c83a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:57:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.918+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648e0cbdc90 con 0x5648e0d315c0 2024-09-13T16:57:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.918+0000 7f6c89600640 1 -- 172.21.15.18:0/1974206998 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90021070 con 0x5648e0d315c0 2024-09-13T16:57:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.919+0000 7f6c89600640 1 -- 172.21.15.18:0/1974206998 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f6c90016070 con 0x5648e0d315c0 2024-09-13T16:57:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.919+0000 7f6c89600640 1 -- 172.21.15.18:0/1974206998 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c90004210 con 0x5648e0d315c0 2024-09-13T16:57:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.921+0000 7f6cad49a740 10 client.25639 fetch_fsmap learned FSMap version 33 2024-09-13T16:57:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.921+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({fsmap=33}) v3 -- 0x5648e0c92170 con 0x5648e0d315c0 2024-09-13T16:57:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.923+0000 7f6c89600640 1 -- 172.21.15.18:0/1974206998 <== mon.1 v2:172.21.15.144:3300/0 4 ==== fsmap(e 33) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f6c90005030 con 0x5648e0d315c0 2024-09-13T16:57:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.925+0000 7f6cad49a740 10 client.25639 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T16:57:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.925+0000 7f6cad49a740 10 client.25639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:57:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.925+0000 7f6cad49a740 20 client.25639 populate_metadata read hostname 'smithi018' 2024-09-13T16:57:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.925+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5648e0d572e0 0x5648e0d597a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.925+0000 7f6cad49a740 4 client.25639 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:57:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.925+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648e0c867d0 con 0x5648e0d572e0 2024-09-13T16:57:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.926+0000 7f6ca3400640 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5648e0d572e0 0x5648e0d597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.937+0000 7f6ca3400640 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5648e0d572e0 0x5648e0d597a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c621581655bdab3 server_cookie=f61c44bf1b5d6acb in_seq=0 out_seq=0 2024-09-13T16:57:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.942+0000 7f6c89600640 10 client.25639 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.942+0000 7f6c89600640 1 -- 172.21.15.18:0/1974206998 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5648e0c867d0 con 0x5648e0d572e0 2024-09-13T16:57:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.942+0000 7f6c89600640 10 client.25639 handle_command_reply: tid=0 2024-09-13T16:57:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.942+0000 7f6cad49a740 1 client.25639 shutdown 2024-09-13T16:57:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.943+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d315c0 msgr2=0x5648e0d4bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.943+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d315c0 0x5648e0d4bf50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6c90010c40 tx=0x7f6c90003990 comp rx=0 tx=0).stop 2024-09-13T16:57:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.944+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 shutdown_connections 2024-09-13T16:57:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.944+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5648e0d572e0 0x5648e0d597a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.945+0000 7f6c89600640 0 client.25639 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.945+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d52f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.945+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d315c0 0x5648e0d4bf50 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6c90010c40 tx=0x7f6c90003990 comp rx=0 tx=0).stop 2024-09-13T16:57:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.945+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1974206998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d4ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.945+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 >> 172.21.15.18:0/1974206998 conn(0x5648e0d2c2f0 msgr2=0x5648e0d2db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.948+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 shutdown_connections 2024-09-13T16:57:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.948+0000 7f6cad49a740 1 -- 172.21.15.18:0/1974206998 wait complete. 2024-09-13T16:57:56.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:56.949+0000 7f6cad49a740 20 client.25639 trim_cache size 0 max 16384 2024-09-13T16:57:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.032+0000 7f6cad49a740 1 Processor -- start 2024-09-13T16:57:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.032+0000 7f6cad49a740 1 -- start start 2024-09-13T16:57:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.032+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d2bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.032+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d36650 0x5648e0d52f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.032+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d572e0 0x5648e0d4aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.032+0000 7f6cad49a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e09fae60 con 0x5648e0d572e0 2024-09-13T16:57:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.032+0000 7f6cad49a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0d31e10 con 0x5648e0d30c80 2024-09-13T16:57:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.032+0000 7f6cad49a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0d357a0 con 0x5648e0d36650 2024-09-13T16:57:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.033+0000 7f6ca3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d2bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.033+0000 7f6ca3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d2bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:37768/0 (socket says 172.21.15.18:37768) 2024-09-13T16:57:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.033+0000 7f6ca3400640 1 -- 172.21.15.18:0/2678827153 learned_addr learned my addr 172.21.15.18:0/2678827153 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.034+0000 7f6caa600640 1 --2- 172.21.15.18:0/2678827153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d572e0 0x5648e0d4aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.034+0000 7f6ca3400640 1 -- 172.21.15.18:0/2678827153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d36650 msgr2=0x5648e0d52f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:57:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.034+0000 7f6ca3400640 1 --2- 172.21.15.18:0/2678827153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d36650 0x5648e0d52f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.034+0000 7f6ca3400640 1 -- 172.21.15.18:0/2678827153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d572e0 msgr2=0x5648e0d4aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.034+0000 7f6ca3400640 1 --2- 172.21.15.18:0/2678827153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d572e0 0x5648e0d4aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.034+0000 7f6ca3400640 1 -- 172.21.15.18:0/2678827153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648e0c34180 con 0x5648e0d30c80 2024-09-13T16:57:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.035+0000 7f6ca3400640 1 --2- 172.21.15.18:0/2678827153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d2bc70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6c980096e0 tx=0x7f6c98017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a1991e50123fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.035+0000 7f6c95600640 1 -- 172.21.15.18:0/2678827153 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98023040 con 0x5648e0d30c80 2024-09-13T16:57:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.036+0000 7f6c95600640 1 -- 172.21.15.18:0/2678827153 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c98025780 con 0x5648e0d30c80 2024-09-13T16:57:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.036+0000 7f6c95600640 1 -- 172.21.15.18:0/2678827153 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980503c0 con 0x5648e0d30c80 2024-09-13T16:57:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.039+0000 7f6cad49a740 1 -- 172.21.15.18:0/2678827153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 msgr2=0x5648e0d2bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.039+0000 7f6cad49a740 1 --2- 172.21.15.18:0/2678827153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d2bc70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6c980096e0 tx=0x7f6c98017000 comp rx=0 tx=0).stop 2024-09-13T16:57:57.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.045+0000 7f6cad49a740 1 -- 172.21.15.18:0/2678827153 shutdown_connections 2024-09-13T16:57:57.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.045+0000 7f6cad49a740 1 --2- 172.21.15.18:0/2678827153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d572e0 0x5648e0d4aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.045+0000 7f6cad49a740 1 --2- 172.21.15.18:0/2678827153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d36650 0x5648e0d52f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.045+0000 7f6cad49a740 1 --2- 172.21.15.18:0/2678827153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d30c80 0x5648e0d2bc70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.045+0000 7f6cad49a740 1 -- 172.21.15.18:0/2678827153 >> 172.21.15.18:0/2678827153 conn(0x5648e0d2c2f0 msgr2=0x5648e0d324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.045+0000 7f6cad49a740 1 -- 172.21.15.18:0/2678827153 shutdown_connections 2024-09-13T16:57:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.045+0000 7f6cad49a740 1 -- 172.21.15.18:0/2678827153 wait complete. 2024-09-13T16:57:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.049+0000 7f6cad49a740 1 -- start start 2024-09-13T16:57:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.055+0000 7f6cad49a740 1 Processor -- start 2024-09-13T16:57:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.058+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d30c80 0x5648e0d4f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.058+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d4f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.060+0000 7f6ca3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d30c80 0x5648e0d4f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.060+0000 7f6ca3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d30c80 0x5648e0d4f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:39074/0 (socket says 172.21.15.18:39074) 2024-09-13T16:57:57.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.061+0000 7f6cad49a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d572e0 0x5648e0d526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.065+0000 7f6ca3400640 1 -- 172.21.15.18:0/1579925265 learned_addr learned my addr 172.21.15.18:0/1579925265 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:57:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.061+0000 7f6ca2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d4f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:57.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.065+0000 7f6caa600640 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d572e0 0x5648e0d526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:57.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.066+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0d52c10 con 0x5648e0d36650 2024-09-13T16:57:57.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.066+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0d52d80 con 0x5648e0d572e0 2024-09-13T16:57:57.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.066+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e0d52f40 con 0x5648e0d30c80 2024-09-13T16:57:57.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.066+0000 7f6cad49a740 10 client.0 _ll_register_callbacks cb 0x7f6c900095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:57:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.067+0000 7f6ca2a00640 1 -- 172.21.15.18:0/1579925265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d30c80 msgr2=0x5648e0d4f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.068+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d30c80 0x5648e0d4f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.068+0000 7f6ca2a00640 1 -- 172.21.15.18:0/1579925265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d572e0 msgr2=0x5648e0d526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:57:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.068+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d572e0 0x5648e0d526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.068+0000 7f6ca2a00640 1 -- 172.21.15.18:0/1579925265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c98017070 con 0x5648e0d36650 2024-09-13T16:57:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.071+0000 7f6ca2a00640 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d4f6b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6c90005000 tx=0x7f6c90005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8681c4dd4ab87a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.071+0000 7f6caa600640 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d572e0 0x5648e0d526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:57:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.071+0000 7f6c89600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:57:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.072+0000 7f6c89600640 1 -- 172.21.15.18:0/1579925265 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90010cf0 con 0x5648e0d36650 2024-09-13T16:57:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.072+0000 7f6c89600640 1 -- 172.21.15.18:0/1579925265 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f6c90000e40 con 0x5648e0d36650 2024-09-13T16:57:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.072+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c900035f0 con 0x5648e0d36650 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.073+0000 7f6c89600640 1 -- 172.21.15.18:0/1579925265 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c90010cf0 con 0x5648e0d36650 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.073+0000 7f6cad49a740 10 client.15639 fetch_fsmap learned FSMap version 33 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.073+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5648e0c59560 con 0x5648e0d36650 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.077+0000 7f6c89600640 1 -- 172.21.15.18:0/1579925265 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c900035f0 con 0x5648e0d36650 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.077+0000 7f6c89600640 1 -- 172.21.15.18:0/1579925265 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 33) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f6c90004660 con 0x5648e0d36650 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.077+0000 7f6cad49a740 10 client.15639 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.077+0000 7f6cad49a740 10 client.15639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.077+0000 7f6cad49a740 20 client.15639 populate_metadata read hostname 'smithi018' 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.077+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5648e0d3e340 0x5648e0d40730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.077+0000 7f6cad49a740 4 client.15639 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.077+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5648e0987300 con 0x5648e0d3e340 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.079+0000 7f6ca3400640 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5648e0d3e340 0x5648e0d40730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.083+0000 7f6ca3400640 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5648e0d3e340 0x5648e0d40730 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2d066ed94ecb1e2 server_cookie=e3e7f7a994cd92c in_seq=0 out_seq=0 2024-09-13T16:57:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:57:57.083+0000 7f6c89600640 10 client.15639 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:57:57.165 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:57 smithi018 ceph-mon[30981]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.1 MiB/s wr, 377 op/s 2024-09-13T16:57:57.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:57 smithi094 ceph-mon[35259]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.1 MiB/s wr, 377 op/s 2024-09-13T16:57:57.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:57 smithi144 ceph-mon[35328]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.1 MiB/s wr, 377 op/s 2024-09-13T16:57:59.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:57:59.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:57:59.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:57:59.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:57:59.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.486 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.486 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:57:59 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:57:59.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:57:59.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:57:59.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:57:59.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:57:59 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:57:59.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:57:59.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:57:59.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:57:59.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:59.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:57:59 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:58:00.475 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:00 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:58:00.475 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:00 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:58:00.475 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:00 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:58:00.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:00 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:58:00.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:00 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:58:00.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:00 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:58:00.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:00 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:58:00.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:00 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:58:00.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:00 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:58:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.492+0000 7f6c89600640 1 -- 172.21.15.18:0/1579925265 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5648e0987300 con 0x5648e0d3e340 2024-09-13T16:58:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.492+0000 7f6c89600640 10 client.15639 handle_command_reply: tid=0 2024-09-13T16:58:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.493+0000 7f6cad49a740 1 client.15639 shutdown 2024-09-13T16:58:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.517+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 msgr2=0x5648e0d4f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.517+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d4f6b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6c90005000 tx=0x7f6c90005f90 comp rx=0 tx=0).stop 2024-09-13T16:58:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.526+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 shutdown_connections 2024-09-13T16:58:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.526+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5648e0d3e340 0x5648e0d40730 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.526+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648e0d36650 0x5648e0d4f6b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.526+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5648e0d572e0 0x5648e0d526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.526+0000 7f6cad49a740 1 --2- 172.21.15.18:0/1579925265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648e0d30c80 0x5648e0d4f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.526+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 >> 172.21.15.18:0/1579925265 conn(0x5648e0d2c2f0 msgr2=0x5648e0d4aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.529+0000 7f6c89600640 0 client.15639 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.531+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 shutdown_connections 2024-09-13T16:58:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.531+0000 7f6cad49a740 1 -- 172.21.15.18:0/1579925265 wait complete. 2024-09-13T16:58:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.555+0000 7f6cad49a740 20 client.15639 trim_cache size 0 max 16384 2024-09-13T16:58:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:58:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:58:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:58:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:58:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.580+0000 7f6ca9000640 1 -- 172.21.15.18:0/3785307200 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6c8c0a0fc0 msgr2=0x7f6c8c0a3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.580+0000 7f6ca9000640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6c8c0a0fc0 0x7f6c8c0a3480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5648e0d31ff0 tx=0x7f6c98009710 comp rx=0 tx=0).stop 2024-09-13T16:58:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.580+0000 7f6ca9000640 1 -- 172.21.15.18:0/3785307200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c9c0a6430 msgr2=0x7f6c9c0a7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.580+0000 7f6ca9000640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c9c0a6430 0x7f6c9c0a7390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ca404f480 tx=0x7f6ca406af40 comp rx=0 tx=0).stop 2024-09-13T16:58:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.580+0000 7f6ca9000640 1 -- 172.21.15.18:0/3785307200 shutdown_connections 2024-09-13T16:58:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.580+0000 7f6ca9000640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6c9c0a6430 0x7f6c9c0a7390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.580+0000 7f6ca9000640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0a5a70 0x7f6c9c0a6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.580+0000 7f6ca9000640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6c8c0a0fc0 0x7f6c8c0a3480 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.580+0000 7f6ca9000640 1 --2- 172.21.15.18:0/3785307200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c0a4880 0x7f6c9c0a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.580+0000 7f6ca9000640 1 -- 172.21.15.18:0/3785307200 >> 172.21.15.18:0/3785307200 conn(0x7f6c9c09fb70 msgr2=0x7f6c9c0ab0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.589+0000 7f6ca9000640 1 -- 172.21.15.18:0/3785307200 shutdown_connections 2024-09-13T16:58:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:02.592+0000 7f6ca9000640 1 -- 172.21.15.18:0/3785307200 wait complete. 2024-09-13T16:58:03.692 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:03 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-09-13T16:58:03.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:03 smithi018 ceph-mon[30981]: Unable to set osd_memory_target on smithi018 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-13T16:58:03.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:03 smithi018 ceph-mon[30981]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.0 MiB/s wr, 395 op/s 2024-09-13T16:58:03.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:03 smithi018 ceph-mon[30981]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 475 op/s 2024-09-13T16:58:03.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:03 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-09-13T16:58:03.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:03 smithi094 ceph-mon[35259]: Unable to set osd_memory_target on smithi018 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-13T16:58:03.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:03 smithi094 ceph-mon[35259]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.0 MiB/s wr, 395 op/s 2024-09-13T16:58:03.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:03 smithi094 ceph-mon[35259]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 475 op/s 2024-09-13T16:58:04.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:03 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-09-13T16:58:04.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:03 smithi144 ceph-mon[35328]: Unable to set osd_memory_target on smithi018 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-13T16:58:04.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:03 smithi144 ceph-mon[35328]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.0 MiB/s wr, 395 op/s 2024-09-13T16:58:04.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:03 smithi144 ceph-mon[35328]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 475 op/s 2024-09-13T16:58:04.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:04 smithi094 ceph-mon[35259]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 540 op/s 2024-09-13T16:58:04.981 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:04 smithi018 ceph-mon[30981]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 540 op/s 2024-09-13T16:58:05.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:04 smithi144 ceph-mon[35328]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 540 op/s 2024-09-13T16:58:06.335 INFO:tasks.workunit.client.0.smithi018.stdout: 325 439631 803 315073 619 147670 929 2024-09-13T16:58:07.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:07 smithi094 ceph-mon[35259]: pgmap v560: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 805 op/s 2024-09-13T16:58:07.433 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:07 smithi018 ceph-mon[30981]: pgmap v560: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 805 op/s 2024-09-13T16:58:07.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:07 smithi144 ceph-mon[35328]: pgmap v560: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 805 op/s 2024-09-13T16:58:09.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:09 smithi018 ceph-mon[30981]: pgmap v561: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 870 op/s 2024-09-13T16:58:09.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:09 smithi094 ceph-mon[35259]: pgmap v561: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 870 op/s 2024-09-13T16:58:09.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:09 smithi144 ceph-mon[35328]: pgmap v561: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 870 op/s 2024-09-13T16:58:11.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:11 smithi094 ceph-mon[35259]: pgmap v562: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 1.03k op/s 2024-09-13T16:58:11.464 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:11 smithi018 ceph-mon[30981]: pgmap v562: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 1.03k op/s 2024-09-13T16:58:11.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:11 smithi144 ceph-mon[35328]: pgmap v562: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 1.03k op/s 2024-09-13T16:58:13.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:13 smithi094 ceph-mon[35259]: pgmap v563: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 13 MiB/s wr, 948 op/s 2024-09-13T16:58:13.470 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:13 smithi018 ceph-mon[30981]: pgmap v563: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 13 MiB/s wr, 948 op/s 2024-09-13T16:58:13.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:13 smithi144 ceph-mon[35328]: pgmap v563: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 13 MiB/s wr, 948 op/s 2024-09-13T16:58:15.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:15 smithi094 ceph-mon[35259]: pgmap v564: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 783 op/s 2024-09-13T16:58:15.467 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:15 smithi018 ceph-mon[30981]: pgmap v564: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 783 op/s 2024-09-13T16:58:15.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:15 smithi144 ceph-mon[35328]: pgmap v564: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 783 op/s 2024-09-13T16:58:16.338 INFO:tasks.workunit.client.0.smithi018.stdout: 332 445554 399 318381 329 156567 227 2024-09-13T16:58:17.412 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:17 smithi094 ceph-mon[35259]: pgmap v565: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 832 op/s 2024-09-13T16:58:17.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:17 smithi018 ceph-mon[30981]: pgmap v565: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 832 op/s 2024-09-13T16:58:17.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:17 smithi144 ceph-mon[35328]: pgmap v565: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 832 op/s 2024-09-13T16:58:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.216+0000 7fec9f200640 1 -- 172.21.15.18:0/2241580049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca0071840 msgr2=0x7feca0071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.217+0000 7fec9f200640 1 --2- 172.21.15.18:0/2241580049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca0071840 0x7feca0071c40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec8800dc90 tx=0x7fec88029fa0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.255+0000 7fec9f200640 1 -- 172.21.15.18:0/2241580049 shutdown_connections 2024-09-13T16:58:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.255+0000 7fec9f200640 1 --2- 172.21.15.18:0/2241580049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca0107740 0x7feca0107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.255+0000 7fec9f200640 1 --2- 172.21.15.18:0/2241580049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feca0108100 0x7feca010e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.255+0000 7fec9f200640 1 --2- 172.21.15.18:0/2241580049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca0071840 0x7feca0071c40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.255+0000 7fec9f200640 1 -- 172.21.15.18:0/2241580049 >> 172.21.15.18:0/2241580049 conn(0x7feca006cf10 msgr2=0x7feca006f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.259+0000 7fec9f200640 1 -- 172.21.15.18:0/2241580049 shutdown_connections 2024-09-13T16:58:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.261+0000 7fec9f200640 1 -- 172.21.15.18:0/2241580049 wait complete. 2024-09-13T16:58:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.267+0000 7fec9f200640 1 Processor -- start 2024-09-13T16:58:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.279+0000 7fec9f200640 1 -- start start 2024-09-13T16:58:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.285+0000 7fec9f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca0071840 0x7feca019bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.289+0000 7fec9de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca0071840 0x7feca019bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.289+0000 7fec9de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca0071840 0x7feca019bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48696/0 (socket says 172.21.15.18:48696) 2024-09-13T16:58:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.290+0000 7fec9de00640 1 -- 172.21.15.18:0/1471506467 learned_addr learned my addr 172.21.15.18:0/1471506467 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.290+0000 7fec9f200640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feca0107740 0x7feca019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.292+0000 7fec9f200640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca0108100 0x7feca01a3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.292+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca01a3ac0 con 0x7feca0071840 2024-09-13T16:58:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.292+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca01a3c30 con 0x7feca0107740 2024-09-13T16:58:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.292+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca01a3df0 con 0x7feca0108100 2024-09-13T16:58:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.293+0000 7fec9de00640 1 -- 172.21.15.18:0/1471506467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca0108100 msgr2=0x7feca01a3580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:58:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.293+0000 7fec9de00640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca0108100 0x7feca01a3580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.293+0000 7fec9de00640 1 -- 172.21.15.18:0/1471506467 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feca0107740 msgr2=0x7feca019c510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:58:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.293+0000 7fec9de00640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feca0107740 0x7feca019c510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.293+0000 7fec9de00640 1 -- 172.21.15.18:0/1471506467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8800d970 con 0x7feca0071840 2024-09-13T16:58:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.293+0000 7fec9de00640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca0071840 0x7feca019bfd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fec88005ab0 tx=0x7fec8800d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.294+0000 7fec96a00640 1 -- 172.21.15.18:0/1471506467 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8802bea0 con 0x7feca0071840 2024-09-13T16:58:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.294+0000 7fec96a00640 1 -- 172.21.15.18:0/1471506467 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec88004e20 con 0x7feca0071840 2024-09-13T16:58:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.295+0000 7fec96a00640 1 -- 172.21.15.18:0/1471506467 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8802bea0 con 0x7feca0071840 2024-09-13T16:58:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.295+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca01a4070 con 0x7feca0071840 2024-09-13T16:58:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.296+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca01a44a0 con 0x7feca0071840 2024-09-13T16:58:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.308+0000 7feca7fca740 1 Processor -- start 2024-09-13T16:58:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.312+0000 7fec96a00640 1 -- 172.21.15.18:0/1471506467 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fec8800b5d0 con 0x7feca0071840 2024-09-13T16:58:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.315+0000 7feca7fca740 1 -- start start 2024-09-13T16:58:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.315+0000 7feca7fca740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c06e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.315+0000 7feca7fca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 0x56262c073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.315+0000 7feca7fca740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c073650 0x56262c075b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.315+0000 7feca7fca740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262bf79bb0 con 0x56262c06e5c0 2024-09-13T16:58:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.315+0000 7feca7fca740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262bfd7a70 con 0x56262c073650 2024-09-13T16:58:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.315+0000 7feca7fca740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262bfd5200 con 0x56262c06dc80 2024-09-13T16:58:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.316+0000 7fec9e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c06e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.316+0000 7fec9e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c06e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:51236/0 (socket says 172.21.15.18:51236) 2024-09-13T16:58:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.316+0000 7fec9e800640 1 -- 172.21.15.18:0/1687181217 learned_addr learned my addr 172.21.15.18:0/1687181217 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.316+0000 7fec9e800640 1 -- 172.21.15.18:0/1687181217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c073650 msgr2=0x56262c075b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.316+0000 7fec9e800640 1 --2- 172.21.15.18:0/1687181217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c073650 0x56262c075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.316+0000 7fec9e800640 1 -- 172.21.15.18:0/1687181217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 msgr2=0x56262c073080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:58:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.316+0000 7fec9e800640 1 --2- 172.21.15.18:0/1687181217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 0x56262c073080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.316+0000 7fec9e800640 1 -- 172.21.15.18:0/1687181217 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56262bf72940 con 0x56262c06dc80 2024-09-13T16:58:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.317+0000 7fec9e800640 1 --2- 172.21.15.18:0/1687181217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c06e080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec900151d0 tx=0x7fec900155d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c4c1b041fd48213 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.317+0000 7fec8f400640 1 -- 172.21.15.18:0/1687181217 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9001f070 con 0x56262c06dc80 2024-09-13T16:58:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.317+0000 7fec8f400640 1 -- 172.21.15.18:0/1687181217 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec90017040 con 0x56262c06dc80 2024-09-13T16:58:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.317+0000 7fec8f400640 1 -- 172.21.15.18:0/1687181217 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90004ea0 con 0x56262c06dc80 2024-09-13T16:58:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.321+0000 7feca7fca740 1 -- 172.21.15.18:0/1687181217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 msgr2=0x56262c06e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.321+0000 7feca7fca740 1 --2- 172.21.15.18:0/1687181217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c06e080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec900151d0 tx=0x7fec900155d0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.323+0000 7fec96a00640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec840a12c0 0x7fec840a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.323+0000 7fec96a00640 1 -- 172.21.15.18:0/1471506467 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fec880ec1a0 con 0x7feca0071840 2024-09-13T16:58:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.324+0000 7fec9e800640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec840a12c0 0x7fec840a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.327+0000 7fec9e800640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec840a12c0 0x7fec840a3780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fec900047e0 tx=0x7fec9001a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.329+0000 7feca7fca740 1 -- 172.21.15.18:0/1687181217 shutdown_connections 2024-09-13T16:58:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.329+0000 7feca7fca740 1 --2- 172.21.15.18:0/1687181217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 0x56262c073080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.329+0000 7feca7fca740 1 --2- 172.21.15.18:0/1687181217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c073650 0x56262c075b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.329+0000 7feca7fca740 1 --2- 172.21.15.18:0/1687181217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c06e080 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.329+0000 7feca7fca740 1 -- 172.21.15.18:0/1687181217 >> 172.21.15.18:0/1687181217 conn(0x56262c0692f0 msgr2=0x56262c0696f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.329+0000 7feca7fca740 1 -- 172.21.15.18:0/1687181217 shutdown_connections 2024-09-13T16:58:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.329+0000 7feca7fca740 1 -- 172.21.15.18:0/1687181217 wait complete. 2024-09-13T16:58:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.331+0000 7feca7fca740 1 -- start start 2024-09-13T16:58:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.331+0000 7feca7fca740 1 Processor -- start 2024-09-13T16:58:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.333+0000 7feca7fca740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c06dc80 0x56262c077920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.334+0000 7feca7fca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 0x56262c077e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.334+0000 7fec9de00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c06dc80 0x56262c077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.334+0000 7fec9de00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c06dc80 0x56262c077920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:59494/0 (socket says 172.21.15.18:59494) 2024-09-13T16:58:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.334+0000 7fec9d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 0x56262c077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.335+0000 7fec9d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 0x56262c077e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48704/0 (socket says 172.21.15.18:48704) 2024-09-13T16:58:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.335+0000 7fec9de00640 1 -- 172.21.15.18:0/3256959715 learned_addr learned my addr 172.21.15.18:0/3256959715 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.335+0000 7feca7fca740 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 0x56262c07eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.335+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262bfd0af0 con 0x56262c06e5c0 2024-09-13T16:58:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.335+0000 7fec9e800640 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 0x56262c07eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.337+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262bf8ef20 con 0x56262c06dc80 2024-09-13T16:58:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.337+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262bf8ebc0 con 0x56262c073650 2024-09-13T16:58:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.337+0000 7feca7fca740 10 client.0 _ll_register_callbacks cb 0x56262bfc0a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:58:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.338+0000 7fec9d400640 1 -- 172.21.15.18:0/3256959715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 msgr2=0x56262c07eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.338+0000 7fec9d400640 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 0x56262c07eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.338+0000 7fec9d400640 1 -- 172.21.15.18:0/3256959715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c06dc80 msgr2=0x56262c077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.338+0000 7fec9d400640 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c06dc80 0x56262c077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.338+0000 7fec9d400640 1 -- 172.21.15.18:0/3256959715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9000fd20 con 0x56262c06e5c0 2024-09-13T16:58:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.338+0000 7fec9e800640 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 0x56262c07eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:58:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.339+0000 7fec9d400640 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 0x56262c077e60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feca019d4e0 tx=0x7fec9800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ae27d140ba1f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.340+0000 7fec83e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:58:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.340+0000 7fec83e00640 1 -- 172.21.15.18:0/3256959715 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800c910 con 0x56262c06e5c0 2024-09-13T16:58:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.340+0000 7fec83e00640 1 -- 172.21.15.18:0/3256959715 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fec9800ca70 con 0x56262c06e5c0 2024-09-13T16:58:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.340+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56262bffac90 con 0x56262c06e5c0 2024-09-13T16:58:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.341+0000 7fec83e00640 1 -- 172.21.15.18:0/3256959715 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec9800cc30 con 0x56262c06e5c0 2024-09-13T16:58:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.344+0000 7feca7fca740 10 client.15645 fetch_fsmap learned FSMap version 33 2024-09-13T16:58:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.344+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56262bfcf170 con 0x56262c06e5c0 2024-09-13T16:58:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.344+0000 7fec83e00640 1 -- 172.21.15.18:0/3256959715 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56262bffac90 con 0x56262c06e5c0 2024-09-13T16:58:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.346+0000 7fec83e00640 1 -- 172.21.15.18:0/3256959715 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 33) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fec9801c070 con 0x56262c06e5c0 2024-09-13T16:58:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.346+0000 7feca7fca740 10 client.15645 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T16:58:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.346+0000 7feca7fca740 10 client.15645 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:58:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.346+0000 7feca7fca740 20 client.15645 populate_metadata read hostname 'smithi018' 2024-09-13T16:58:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.346+0000 7feca7fca740 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56262c083690 0x56262c085ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.346+0000 7feca7fca740 4 client.15645 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:58:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.346+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56262bfc37d0 con 0x56262c083690 2024-09-13T16:58:19.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.378+0000 7fec9de00640 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56262c083690 0x56262c085ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.405+0000 7fec9de00640 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56262c083690 0x56262c085ab0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5fef79034659b35 server_cookie=5c510372a4303d89 in_seq=0 out_seq=0 2024-09-13T16:58:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.405+0000 7fec83e00640 10 client.15645 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.407+0000 7fec83e00640 1 -- 172.21.15.18:0/3256959715 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56262bfc37d0 con 0x56262c083690 2024-09-13T16:58:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.407+0000 7fec83e00640 10 client.15645 handle_command_reply: tid=0 2024-09-13T16:58:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.407+0000 7feca7fca740 1 client.15645 shutdown 2024-09-13T16:58:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.408+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 msgr2=0x56262c077e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.408+0000 7feca7fca740 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 0x56262c077e60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feca019d4e0 tx=0x7fec9800bea0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.408+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 shutdown_connections 2024-09-13T16:58:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.408+0000 7feca7fca740 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56262c083690 0x56262c085ab0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.408+0000 7feca7fca740 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06e5c0 0x56262c077e60 secure :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feca019d4e0 tx=0x7fec9800bea0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.408+0000 7feca7fca740 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 0x56262c07eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.408+0000 7feca7fca740 1 --2- 172.21.15.18:0/3256959715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c06dc80 0x56262c077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.408+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 >> 172.21.15.18:0/3256959715 conn(0x56262c0692f0 msgr2=0x56262c06ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:19.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:19 smithi094 ceph-mon[35259]: pgmap v566: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 559 op/s 2024-09-13T16:58:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.409+0000 7fec83e00640 0 client.15645 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.410+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 shutdown_connections 2024-09-13T16:58:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.410+0000 7feca7fca740 1 -- 172.21.15.18:0/3256959715 wait complete. 2024-09-13T16:58:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.411+0000 7feca7fca740 20 client.15645 trim_cache size 0 max 16384 2024-09-13T16:58:19.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:19 smithi018 ceph-mon[30981]: pgmap v566: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 559 op/s 2024-09-13T16:58:19.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:19 smithi144 ceph-mon[35328]: pgmap v566: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 559 op/s 2024-09-13T16:58:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.545+0000 7feca7fca740 1 Processor -- start 2024-09-13T16:58:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.550+0000 7feca7fca740 1 -- start start 2024-09-13T16:58:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.556+0000 7feca7fca740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c072b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.556+0000 7feca7fca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c073650 0x56262c073060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.557+0000 7feca7fca740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c07edc0 0x56262c0696d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.557+0000 7feca7fca740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262bd37e60 con 0x56262c073650 2024-09-13T16:58:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.557+0000 7feca7fca740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262c06eaa0 con 0x56262c07edc0 2024-09-13T16:58:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.557+0000 7feca7fca740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262c081b70 con 0x56262c06dc80 2024-09-13T16:58:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.559+0000 7fec9de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.559+0000 7fec9de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c072b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:51248/0 (socket says 172.21.15.18:51248) 2024-09-13T16:58:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.559+0000 7fec9de00640 1 -- 172.21.15.18:0/2733242834 learned_addr learned my addr 172.21.15.18:0/2733242834 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.564+0000 7fec9de00640 1 -- 172.21.15.18:0/2733242834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c07edc0 msgr2=0x56262c0696d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:58:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.564+0000 7fec9de00640 1 --2- 172.21.15.18:0/2733242834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c07edc0 0x56262c0696d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.564+0000 7fec9de00640 1 -- 172.21.15.18:0/2733242834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c073650 msgr2=0x56262c073060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:58:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.564+0000 7fec9de00640 1 --2- 172.21.15.18:0/2733242834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c073650 0x56262c073060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.565+0000 7fec9de00640 1 -- 172.21.15.18:0/2733242834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56262bf71180 con 0x56262c06dc80 2024-09-13T16:58:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.570+0000 7fec9de00640 1 --2- 172.21.15.18:0/2733242834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c072b20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec880b5d30 tx=0x7fec88029fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2deaee967e374c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.579+0000 7fec8fe00640 1 -- 172.21.15.18:0/2733242834 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8802bea0 con 0x56262c06dc80 2024-09-13T16:58:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.579+0000 7fec8fe00640 1 -- 172.21.15.18:0/2733242834 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec88004e20 con 0x56262c06dc80 2024-09-13T16:58:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.579+0000 7fec8fe00640 1 -- 172.21.15.18:0/2733242834 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec880b7660 con 0x56262c06dc80 2024-09-13T16:58:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.584+0000 7feca7fca740 1 -- 172.21.15.18:0/2733242834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 msgr2=0x56262c072b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.584+0000 7feca7fca740 1 --2- 172.21.15.18:0/2733242834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c072b20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec880b5d30 tx=0x7fec88029fa0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.584+0000 7feca7fca740 1 -- 172.21.15.18:0/2733242834 shutdown_connections 2024-09-13T16:58:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.584+0000 7feca7fca740 1 --2- 172.21.15.18:0/2733242834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c073650 0x56262c073060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.584+0000 7feca7fca740 1 --2- 172.21.15.18:0/2733242834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c07edc0 0x56262c0696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.584+0000 7feca7fca740 1 --2- 172.21.15.18:0/2733242834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c06dc80 0x56262c072b20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.584+0000 7feca7fca740 1 -- 172.21.15.18:0/2733242834 >> 172.21.15.18:0/2733242834 conn(0x56262c0692f0 msgr2=0x56262c08a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.584+0000 7feca7fca740 1 -- 172.21.15.18:0/2733242834 shutdown_connections 2024-09-13T16:58:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.585+0000 7feca7fca740 1 -- 172.21.15.18:0/2733242834 wait complete. 2024-09-13T16:58:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.587+0000 7feca7fca740 1 -- start start 2024-09-13T16:58:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.587+0000 7feca7fca740 1 Processor -- start 2024-09-13T16:58:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.590+0000 7feca7fca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06dc80 0x56262c07a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.590+0000 7fec9de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06dc80 0x56262c07a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.590+0000 7fec9de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06dc80 0x56262c07a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48710/0 (socket says 172.21.15.18:48710) 2024-09-13T16:58:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.590+0000 7fec9de00640 1 -- 172.21.15.18:0/1954590613 learned_addr learned my addr 172.21.15.18:0/1954590613 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.591+0000 7feca7fca740 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 0x56262c07aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.592+0000 7feca7fca740 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c07edc0 0x56262c07ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.592+0000 7fec9d400640 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 0x56262c07aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.593+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262c07e310 con 0x56262c06dc80 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.593+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262c07e480 con 0x56262c07edc0 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.593+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262c07e640 con 0x56262c073650 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.594+0000 7feca7fca740 10 client.0 _ll_register_callbacks cb 0x7fec9000f9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.594+0000 7fec9e800640 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c07edc0 0x56262c07ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.594+0000 7fec9e800640 1 -- 172.21.15.18:0/1954590613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 msgr2=0x56262c07aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.594+0000 7fec9e800640 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 0x56262c07aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.594+0000 7fec9e800640 1 -- 172.21.15.18:0/1954590613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06dc80 msgr2=0x56262c07a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.594+0000 7fec9e800640 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06dc80 0x56262c07a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.594+0000 7fec9e800640 1 -- 172.21.15.18:0/1954590613 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca01a44a0 con 0x56262c07edc0 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.595+0000 7fec9de00640 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06dc80 0x56262c07a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:58:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.595+0000 7fec9e800640 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c07edc0 0x56262c07ddd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fec90015ad0 tx=0x7fec9000fa80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d53d4bb804023b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.596+0000 7fec83e00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:58:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.596+0000 7fec83e00640 1 -- 172.21.15.18:0/1954590613 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9001f040 con 0x56262c07edc0 2024-09-13T16:58:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.597+0000 7fec83e00640 1 -- 172.21.15.18:0/1954590613 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fec9002b070 con 0x56262c07edc0 2024-09-13T16:58:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.597+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec90017040 con 0x56262c07edc0 2024-09-13T16:58:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.599+0000 7fec83e00640 1 -- 172.21.15.18:0/1954590613 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec9001abc0 con 0x56262c07edc0 2024-09-13T16:58:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.599+0000 7feca7fca740 10 client.25709 fetch_fsmap learned FSMap version 33 2024-09-13T16:58:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.599+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56262bf96560 con 0x56262c07edc0 2024-09-13T16:58:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.600+0000 7fec83e00640 1 -- 172.21.15.18:0/1954590613 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec90049020 con 0x56262c07edc0 2024-09-13T16:58:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.601+0000 7fec83e00640 1 -- 172.21.15.18:0/1954590613 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 33) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fec9001a070 con 0x56262c07edc0 2024-09-13T16:58:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.601+0000 7feca7fca740 10 client.25709 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T16:58:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.601+0000 7feca7fca740 10 client.25709 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:58:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.601+0000 7feca7fca740 20 client.25709 populate_metadata read hostname 'smithi018' 2024-09-13T16:58:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.601+0000 7feca7fca740 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56262c0dadf0 0x56262c0dd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.601+0000 7feca7fca740 4 client.25709 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:58:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.601+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56262bcc4300 con 0x56262c0dadf0 2024-09-13T16:58:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.601+0000 7fec9de00640 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56262c0dadf0 0x56262c0dd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.602+0000 7fec9de00640 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56262c0dadf0 0x56262c0dd210 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b1992c2eb7f9969 server_cookie=d62c540e97d972c in_seq=0 out_seq=0 2024-09-13T16:58:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:19.602+0000 7fec83e00640 10 client.25709 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:21.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:21 smithi094 ceph-mon[35259]: pgmap v567: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 500 op/s 2024-09-13T16:58:21.491 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:21 smithi018 ceph-mon[30981]: pgmap v567: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 500 op/s 2024-09-13T16:58:21.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:21 smithi144 ceph-mon[35328]: pgmap v567: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 500 op/s 2024-09-13T16:58:22.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.476+0000 7fec83e00640 1 -- 172.21.15.18:0/1954590613 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56262bcc4300 con 0x56262c0dadf0 2024-09-13T16:58:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.476+0000 7fec83e00640 10 client.25709 handle_command_reply: tid=0 2024-09-13T16:58:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.496+0000 7feca7fca740 1 client.25709 shutdown 2024-09-13T16:58:22.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.515+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c07edc0 msgr2=0x56262c07ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:22.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.515+0000 7feca7fca740 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c07edc0 0x56262c07ddd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fec90015ad0 tx=0x7fec9000fa80 comp rx=0 tx=0).stop 2024-09-13T16:58:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.557+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 shutdown_connections 2024-09-13T16:58:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.557+0000 7feca7fca740 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56262c0dadf0 0x56262c0dd210 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.557+0000 7feca7fca740 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56262c07edc0 0x56262c07ddd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.557+0000 7feca7fca740 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56262c073650 0x56262c07aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.557+0000 7feca7fca740 1 --2- 172.21.15.18:0/1954590613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56262c06dc80 0x56262c07a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.557+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 >> 172.21.15.18:0/1954590613 conn(0x56262c0692f0 msgr2=0x56262c06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.557+0000 7fec83e00640 0 client.25709 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.563+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 shutdown_connections 2024-09-13T16:58:22.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.567+0000 7feca7fca740 1 -- 172.21.15.18:0/1954590613 wait complete. 2024-09-13T16:58:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:58:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:58:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:58:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:58:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.586+0000 7feca7fca740 20 client.25709 trim_cache size 0 max 16384 2024-09-13T16:58:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.590+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec840a12c0 msgr2=0x7fec840a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.590+0000 7fec9f200640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec840a12c0 0x7fec840a3780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fec900047e0 tx=0x7fec9001a560 comp rx=0 tx=0).stop 2024-09-13T16:58:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.590+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca0071840 msgr2=0x7feca019bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.590+0000 7fec9f200640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca0071840 0x7feca019bfd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fec88005ab0 tx=0x7fec8800d880 comp rx=0 tx=0).stop 2024-09-13T16:58:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.614+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 shutdown_connections 2024-09-13T16:58:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.614+0000 7fec9f200640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca0108100 0x7feca01a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.614+0000 7fec9f200640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feca0107740 0x7feca019c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.614+0000 7fec9f200640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fec840a12c0 0x7fec840a3780 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.614+0000 7fec9f200640 1 --2- 172.21.15.18:0/1471506467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca0071840 0x7feca019bfd0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.614+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 >> 172.21.15.18:0/1471506467 conn(0x7feca006cf10 msgr2=0x7feca010aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:22.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.648+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 shutdown_connections 2024-09-13T16:58:22.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:22.649+0000 7fec9f200640 1 -- 172.21.15.18:0/1471506467 wait complete. 2024-09-13T16:58:23.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:23 smithi018 ceph-mon[30981]: pgmap v568: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 465 op/s 2024-09-13T16:58:23.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:23 smithi144 ceph-mon[35328]: pgmap v568: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 465 op/s 2024-09-13T16:58:23.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:23 smithi094 ceph-mon[35259]: pgmap v568: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 465 op/s 2024-09-13T16:58:25.206 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:25 smithi018 ceph-mon[30981]: pgmap v569: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 440 op/s 2024-09-13T16:58:25.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:25 smithi144 ceph-mon[35328]: pgmap v569: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 440 op/s 2024-09-13T16:58:25.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:25 smithi094 ceph-mon[35259]: pgmap v569: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 440 op/s 2024-09-13T16:58:26.339 INFO:tasks.workunit.client.0.smithi018.stdout: 342 481838 750 343665 594 169699 1257 2024-09-13T16:58:27.463 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:27 smithi018 ceph-mon[30981]: pgmap v570: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 615 op/s 2024-09-13T16:58:27.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:27 smithi144 ceph-mon[35328]: pgmap v570: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 615 op/s 2024-09-13T16:58:27.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:27 smithi094 ceph-mon[35259]: pgmap v570: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 615 op/s 2024-09-13T16:58:29.462 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:29 smithi018 ceph-mon[30981]: pgmap v571: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 550 op/s 2024-09-13T16:58:29.463 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:29 smithi094 ceph-mon[35259]: pgmap v571: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 550 op/s 2024-09-13T16:58:29.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:29 smithi144 ceph-mon[35328]: pgmap v571: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 550 op/s 2024-09-13T16:58:31.467 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:31 smithi018 ceph-mon[30981]: pgmap v572: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 565 op/s 2024-09-13T16:58:31.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:31 smithi144 ceph-mon[35328]: pgmap v572: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 565 op/s 2024-09-13T16:58:31.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:31 smithi094 ceph-mon[35259]: pgmap v572: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 565 op/s 2024-09-13T16:58:33.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:33 smithi018 ceph-mon[30981]: pgmap v573: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 612 op/s 2024-09-13T16:58:33.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:33 smithi144 ceph-mon[35328]: pgmap v573: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 612 op/s 2024-09-13T16:58:33.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:33 smithi094 ceph-mon[35259]: pgmap v573: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 612 op/s 2024-09-13T16:58:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:35 smithi144 ceph-mon[35328]: pgmap v574: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 504 op/s 2024-09-13T16:58:35.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:35 smithi018 ceph-mon[30981]: pgmap v574: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 504 op/s 2024-09-13T16:58:35.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:35 smithi094 ceph-mon[35259]: pgmap v574: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 504 op/s 2024-09-13T16:58:36.353 INFO:tasks.workunit.client.0.smithi018.stdout: 351 466136 713 328390 458 165806 1436 2024-09-13T16:58:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.624+0000 7f5418000640 1 -- 172.21.15.18:0/1653898094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54101038e0 msgr2=0x7f5410103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.624+0000 7f5418000640 1 --2- 172.21.15.18:0/1653898094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54101038e0 0x7f5410103d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5408009ca0 tx=0x7f540802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.624+0000 7f5418000640 1 -- 172.21.15.18:0/1653898094 shutdown_connections 2024-09-13T16:58:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.624+0000 7f5418000640 1 --2- 172.21.15.18:0/1653898094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54101038e0 0x7f5410103d90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.624+0000 7f5418000640 1 --2- 172.21.15.18:0/1653898094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5410100f30 0x7f54101033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.624+0000 7f5418000640 1 --2- 172.21.15.18:0/1653898094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54100fe5e0 0x7f54101009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.624+0000 7f5418000640 1 -- 172.21.15.18:0/1653898094 >> 172.21.15.18:0/1653898094 conn(0x7f54100fa3d0 msgr2=0x7f54100fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.624+0000 7f5418000640 1 -- 172.21.15.18:0/1653898094 shutdown_connections 2024-09-13T16:58:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.625+0000 7f5418000640 1 -- 172.21.15.18:0/1653898094 wait complete. 2024-09-13T16:58:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.627+0000 7f5418000640 1 Processor -- start 2024-09-13T16:58:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.628+0000 7f5418000640 1 -- start start 2024-09-13T16:58:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.629+0000 7f5418000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54100fe5e0 0x7f5410109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.629+0000 7f5418000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5410100f30 0x7f541010a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.629+0000 7f5415600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54100fe5e0 0x7f5410109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5415600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54100fe5e0 0x7f5410109ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:45706/0 (socket says 172.21.15.18:45706) 2024-09-13T16:58:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5418000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54101038e0 0x7f54101ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5418000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541010d060 con 0x7f54101038e0 2024-09-13T16:58:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5418000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541010d1d0 con 0x7f54100fe5e0 2024-09-13T16:58:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5418000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54101acb30 con 0x7f5410100f30 2024-09-13T16:58:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5414c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5410100f30 0x7f541010a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5414c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5410100f30 0x7f541010a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:47572/0 (socket says 172.21.15.18:47572) 2024-09-13T16:58:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5414c00640 1 -- 172.21.15.18:0/2239591045 learned_addr learned my addr 172.21.15.18:0/2239591045 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5416000640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54101038e0 0x7f54101ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5414c00640 1 -- 172.21.15.18:0/2239591045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54100fe5e0 msgr2=0x7f5410109ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5414c00640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54100fe5e0 0x7f5410109ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5414c00640 1 -- 172.21.15.18:0/2239591045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54101038e0 msgr2=0x7f54101ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5414c00640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54101038e0 0x7f54101ac5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.631+0000 7f5414c00640 1 -- 172.21.15.18:0/2239591045 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408009900 con 0x7f5410100f30 2024-09-13T16:58:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.634+0000 7f5414c00640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5410100f30 0x7f541010a010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f540400b4a0 tx=0x7f540400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.634+0000 7f540e000640 1 -- 172.21.15.18:0/2239591045 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404010610 con 0x7f5410100f30 2024-09-13T16:58:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.634+0000 7f540e000640 1 -- 172.21.15.18:0/2239591045 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5404010c30 con 0x7f5410100f30 2024-09-13T16:58:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.634+0000 7f540e000640 1 -- 172.21.15.18:0/2239591045 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404017dd0 con 0x7f5410100f30 2024-09-13T16:58:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.634+0000 7f5418000640 1 -- 172.21.15.18:0/2239591045 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54101acd90 con 0x7f5410100f30 2024-09-13T16:58:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.635+0000 7f5418000640 1 -- 172.21.15.18:0/2239591045 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54101ad270 con 0x7f5410100f30 2024-09-13T16:58:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.640+0000 7f541ae6d740 1 Processor -- start 2024-09-13T16:58:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.641+0000 7f541ae6d740 1 -- start start 2024-09-13T16:58:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.641+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 0x5589a42efe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.641+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f03b0 0x5589a42f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.641+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a42f7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.641+0000 7f541ae6d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a41fbbb0 con 0x5589a42efa70 2024-09-13T16:58:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.641+0000 7f541ae6d740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a4259a70 con 0x5589a42f5440 2024-09-13T16:58:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.641+0000 7f541ae6d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a4257200 con 0x5589a42f03b0 2024-09-13T16:58:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.641+0000 7f5415600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f03b0 0x5589a42f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.642+0000 7f5415600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f03b0 0x5589a42f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:47586/0 (socket says 172.21.15.18:47586) 2024-09-13T16:58:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.642+0000 7f5415600640 1 -- 172.21.15.18:0/1225347871 learned_addr learned my addr 172.21.15.18:0/1225347871 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.642+0000 7f540e000640 1 -- 172.21.15.18:0/2239591045 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f54040173f0 con 0x7f5410100f30 2024-09-13T16:58:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.642+0000 7f5414c00640 1 --2- 172.21.15.18:0/1225347871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a42f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.643+0000 7f5415600640 1 -- 172.21.15.18:0/1225347871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 msgr2=0x5589a42f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.644+0000 7f5415600640 1 --2- 172.21.15.18:0/1225347871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a42f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.644+0000 7f5415600640 1 -- 172.21.15.18:0/1225347871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 msgr2=0x5589a42efe70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:58:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.644+0000 7f5415600640 1 --2- 172.21.15.18:0/1225347871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 0x5589a42efe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.644+0000 7f5415600640 1 -- 172.21.15.18:0/1225347871 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589a41f4940 con 0x5589a42f03b0 2024-09-13T16:58:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.644+0000 7f5414c00640 1 --2- 172.21.15.18:0/1225347871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a42f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:58:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.644+0000 7f540e000640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f53f80a1090 0x7f53f80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.645+0000 7f5415600640 1 --2- 172.21.15.18:0/1225347871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f03b0 0x5589a42f4e70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b820 tx=0x7f53fc00bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=658e2b751b571f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.647+0000 7f5402a00640 1 -- 172.21.15.18:0/1225347871 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00d950 con 0x5589a42f03b0 2024-09-13T16:58:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.647+0000 7f5402a00640 1 -- 172.21.15.18:0/1225347871 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53fc00b460 con 0x5589a42f03b0 2024-09-13T16:58:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.647+0000 7f5402a00640 1 -- 172.21.15.18:0/1225347871 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0123e0 con 0x5589a42f03b0 2024-09-13T16:58:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.647+0000 7f5416000640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f53f80a1090 0x7f53f80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f541ae6d740 1 -- 172.21.15.18:0/1225347871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f03b0 msgr2=0x5589a42f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:36.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1225347871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f03b0 0x5589a42f4e70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b820 tx=0x7f53fc00bce0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f5416000640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f53f80a1090 0x7f53f80a3550 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5408031c40 tx=0x7f5408009890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f540e000640 1 -- 172.21.15.18:0/2239591045 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f54040cc7a0 con 0x7f5410100f30 2024-09-13T16:58:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f541ae6d740 1 -- 172.21.15.18:0/1225347871 shutdown_connections 2024-09-13T16:58:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1225347871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a42f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1225347871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f03b0 0x5589a42f4e70 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b820 tx=0x7f53fc00bce0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1225347871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 0x5589a42efe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f541ae6d740 1 -- 172.21.15.18:0/1225347871 >> 172.21.15.18:0/1225347871 conn(0x5589a42eb0e0 msgr2=0x5589a42eb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f541ae6d740 1 -- 172.21.15.18:0/1225347871 shutdown_connections 2024-09-13T16:58:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.649+0000 7f541ae6d740 1 -- 172.21.15.18:0/1225347871 wait complete. 2024-09-13T16:58:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.650+0000 7f541ae6d740 1 -- start start 2024-09-13T16:58:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.650+0000 7f541ae6d740 1 Processor -- start 2024-09-13T16:58:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.651+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 0x5589a42f99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.651+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a42f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.651+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42fef40 0x5589a4301330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.651+0000 7f541ae6d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a4252af0 con 0x5589a42efa70 2024-09-13T16:58:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.651+0000 7f541ae6d740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a4210f20 con 0x5589a42fef40 2024-09-13T16:58:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.651+0000 7f541ae6d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a4210bc0 con 0x5589a42f5440 2024-09-13T16:58:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.651+0000 7f541ae6d740 10 client.0 _ll_register_callbacks cb 0x5589a4242a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:58:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.651+0000 7f5414c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a42f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.651+0000 7f5414c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a42f9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:47588/0 (socket says 172.21.15.18:47588) 2024-09-13T16:58:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.652+0000 7f5414c00640 1 -- 172.21.15.18:0/1290931976 learned_addr learned my addr 172.21.15.18:0/1290931976 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.653+0000 7f5416000640 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42fef40 0x5589a4301330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.653+0000 7f5415600640 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 0x5589a42f99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.654+0000 7f5414c00640 1 -- 172.21.15.18:0/1290931976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42fef40 msgr2=0x5589a4301330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.654+0000 7f5414c00640 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42fef40 0x5589a4301330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.654+0000 7f5414c00640 1 -- 172.21.15.18:0/1290931976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 msgr2=0x5589a42f99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.654+0000 7f5414c00640 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 0x5589a42f99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.654+0000 7f5414c00640 1 -- 172.21.15.18:0/1290931976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc00e040 con 0x5589a42f5440 2024-09-13T16:58:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.654+0000 7f5414c00640 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a42f9f10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f54040997c0 tx=0x7f54040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f9ca9094dc91b53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.654+0000 7f53f7400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:58:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.656+0000 7f53f7400640 1 -- 172.21.15.18:0/1290931976 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404099830 con 0x5589a42f5440 2024-09-13T16:58:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.656+0000 7f53f7400640 1 -- 172.21.15.18:0/1290931976 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f540409d660 con 0x5589a42f5440 2024-09-13T16:58:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.656+0000 7f541ae6d740 1 -- 172.21.15.18:0/1290931976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589a42457d0 con 0x5589a42f5440 2024-09-13T16:58:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f53f7400640 1 -- 172.21.15.18:0/1290931976 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54040a1cb0 con 0x5589a42f5440 2024-09-13T16:58:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f541ae6d740 10 client.25663 fetch_fsmap learned FSMap version 33 2024-09-13T16:58:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f541ae6d740 1 -- 172.21.15.18:0/1290931976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5589a4251170 con 0x5589a42f5440 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f53f7400640 1 -- 172.21.15.18:0/1290931976 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5589a42457d0 con 0x5589a42f5440 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f53f7400640 1 -- 172.21.15.18:0/1290931976 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 33) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f5404021070 con 0x5589a42f5440 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f541ae6d740 10 client.25663 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f541ae6d740 10 client.25663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f541ae6d740 20 client.25663 populate_metadata read hostname 'smithi018' 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5589a4305940 0x5589a4307d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f541ae6d740 4 client.25663 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.657+0000 7f541ae6d740 1 -- 172.21.15.18:0/1290931976 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589a3f46300 con 0x5589a4305940 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.658+0000 7f5415600640 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5589a4305940 0x5589a4307d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.658+0000 7f53f7400640 10 client.25663 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.658+0000 7f5415600640 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5589a4305940 0x5589a4307d60 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=886b3ee850333e89 server_cookie=d5d5298763e1c37f in_seq=0 out_seq=0 2024-09-13T16:58:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.660+0000 7f53f7400640 1 -- 172.21.15.18:0/1290931976 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5589a3f46300 con 0x5589a4305940 2024-09-13T16:58:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.660+0000 7f53f7400640 10 client.25663 handle_command_reply: tid=0 2024-09-13T16:58:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.660+0000 7f541ae6d740 1 client.25663 shutdown 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.661+0000 7f541ae6d740 1 -- 172.21.15.18:0/1290931976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 msgr2=0x5589a42f9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.661+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a42f9f10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f54040997c0 tx=0x7f54040046c0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.661+0000 7f541ae6d740 1 -- 172.21.15.18:0/1290931976 shutdown_connections 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.661+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5589a4305940 0x5589a4307d60 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.661+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42fef40 0x5589a4301330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.661+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a42f9f10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.661+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1290931976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 0x5589a42f99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.661+0000 7f541ae6d740 1 -- 172.21.15.18:0/1290931976 >> 172.21.15.18:0/1290931976 conn(0x5589a42eb0e0 msgr2=0x5589a42ec8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.661+0000 7f53f7400640 0 client.25663 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.662+0000 7f541ae6d740 1 -- 172.21.15.18:0/1290931976 shutdown_connections 2024-09-13T16:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.662+0000 7f541ae6d740 1 -- 172.21.15.18:0/1290931976 wait complete. 2024-09-13T16:58:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.662+0000 7f541ae6d740 20 client.25663 trim_cache size 0 max 16384 2024-09-13T16:58:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.706+0000 7f541ae6d740 1 Processor -- start 2024-09-13T16:58:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.706+0000 7f541ae6d740 1 -- start start 2024-09-13T16:58:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.706+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42efa70 0x5589a430c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.706+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a4315c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.706+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42fef40 0x5589a4316160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.706+0000 7f541ae6d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a3fb9e60 con 0x5589a42fef40 2024-09-13T16:58:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.706+0000 7f541ae6d740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a42f9510 con 0x5589a42efa70 2024-09-13T16:58:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.706+0000 7f541ae6d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a42fa870 con 0x5589a42f5440 2024-09-13T16:58:36.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.707+0000 7f5414c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a4315c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.707+0000 7f5414c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a4315c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:47592/0 (socket says 172.21.15.18:47592) 2024-09-13T16:58:36.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.707+0000 7f5416000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42fef40 0x5589a4316160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.707+0000 7f5414c00640 1 -- 172.21.15.18:0/1020093962 learned_addr learned my addr 172.21.15.18:0/1020093962 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:36.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.707+0000 7f5415600640 1 --2- 172.21.15.18:0/1020093962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42efa70 0x5589a430c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.708+0000 7f5415600640 1 -- 172.21.15.18:0/1020093962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 msgr2=0x5589a4315c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:36.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.709+0000 7f5415600640 1 --2- 172.21.15.18:0/1020093962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a4315c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.709+0000 7f5415600640 1 -- 172.21.15.18:0/1020093962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42fef40 msgr2=0x5589a4316160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:36.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.709+0000 7f5415600640 1 --2- 172.21.15.18:0/1020093962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42fef40 0x5589a4316160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.709+0000 7f5415600640 1 -- 172.21.15.18:0/1020093962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589a41f3180 con 0x5589a42efa70 2024-09-13T16:58:36.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.709+0000 7f5414c00640 1 --2- 172.21.15.18:0/1020093962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a4315c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:58:36.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.710+0000 7f5415600640 1 --2- 172.21.15.18:0/1020093962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42efa70 0x5589a430c6e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5589a42f0950 tx=0x7f53fc0047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c176f037ca7a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:36.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.711+0000 7f5416000640 1 --2- 172.21.15.18:0/1020093962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42fef40 0x5589a4316160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:58:36.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.711+0000 7f5403400640 1 -- 172.21.15.18:0/1020093962 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0147b0 con 0x5589a42efa70 2024-09-13T16:58:36.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.711+0000 7f5403400640 1 -- 172.21.15.18:0/1020093962 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53fc014570 con 0x5589a42efa70 2024-09-13T16:58:36.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.711+0000 7f5403400640 1 -- 172.21.15.18:0/1020093962 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0275b0 con 0x5589a42efa70 2024-09-13T16:58:36.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.712+0000 7f541ae6d740 1 -- 172.21.15.18:0/1020093962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42efa70 msgr2=0x5589a430c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.712+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1020093962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42efa70 0x5589a430c6e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5589a42f0950 tx=0x7f53fc0047d0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.712+0000 7f541ae6d740 1 -- 172.21.15.18:0/1020093962 shutdown_connections 2024-09-13T16:58:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.712+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1020093962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42fef40 0x5589a4316160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.712+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1020093962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42f5440 0x5589a4315c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.712+0000 7f541ae6d740 1 --2- 172.21.15.18:0/1020093962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42efa70 0x5589a430c6e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.712+0000 7f541ae6d740 1 -- 172.21.15.18:0/1020093962 >> 172.21.15.18:0/1020093962 conn(0x5589a42eb0e0 msgr2=0x5589a42e6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.712+0000 7f541ae6d740 1 -- 172.21.15.18:0/1020093962 shutdown_connections 2024-09-13T16:58:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.713+0000 7f541ae6d740 1 -- 172.21.15.18:0/1020093962 wait complete. 2024-09-13T16:58:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.713+0000 7f541ae6d740 1 -- start start 2024-09-13T16:58:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.714+0000 7f541ae6d740 1 Processor -- start 2024-09-13T16:58:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.715+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 0x5589a43154b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.715+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a43159f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.715+0000 7f541ae6d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42fef40 0x5589a435abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.716+0000 7f5414c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a43159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.716+0000 7f541ae6d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a435b100 con 0x5589a42efa70 2024-09-13T16:58:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.716+0000 7f541ae6d740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a435b240 con 0x5589a42f5440 2024-09-13T16:58:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.716+0000 7f541ae6d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a435b400 con 0x5589a42fef40 2024-09-13T16:58:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.716+0000 7f541ae6d740 10 client.0 _ll_register_callbacks cb 0x7f53fc00b240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:58:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.716+0000 7f5414c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a43159f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:45750/0 (socket says 172.21.15.18:45750) 2024-09-13T16:58:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.716+0000 7f5414c00640 1 -- 172.21.15.18:0/55340843 learned_addr learned my addr 172.21.15.18:0/55340843 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.717+0000 7f5414c00640 1 -- 172.21.15.18:0/55340843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42fef40 msgr2=0x5589a435abc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:58:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.717+0000 7f5414c00640 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42fef40 0x5589a435abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.717+0000 7f5414c00640 1 -- 172.21.15.18:0/55340843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 msgr2=0x5589a43154b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:36.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.717+0000 7f5414c00640 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 0x5589a43154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:36.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.717+0000 7f5414c00640 1 -- 172.21.15.18:0/55340843 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589a4251170 con 0x5589a42f5440 2024-09-13T16:58:36.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.718+0000 7f5414c00640 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a43159f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5404099770 tx=0x7f5404099f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65ddb425e546f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.718+0000 7f53f7400640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:58:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.719+0000 7f541ae6d740 1 -- 172.21.15.18:0/55340843 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589a427cc90 con 0x5589a42f5440 2024-09-13T16:58:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.719+0000 7f53f7400640 1 -- 172.21.15.18:0/55340843 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404099370 con 0x5589a42f5440 2024-09-13T16:58:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.719+0000 7f53f7400640 1 -- 172.21.15.18:0/55340843 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f540409d660 con 0x5589a42f5440 2024-09-13T16:58:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.719+0000 7f53f7400640 1 -- 172.21.15.18:0/55340843 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5404099830 con 0x5589a42f5440 2024-09-13T16:58:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.720+0000 7f541ae6d740 10 client.25721 fetch_fsmap learned FSMap version 33 2024-09-13T16:58:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.720+0000 7f541ae6d740 1 -- 172.21.15.18:0/55340843 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({fsmap=33}) v3 -- 0x7f5410104880 con 0x5589a42f5440 2024-09-13T16:58:36.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.722+0000 7f53f7400640 1 -- 172.21.15.18:0/55340843 <== mon.2 v2:172.21.15.94:3300/0 4 ==== fsmap(e 33) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f5404021070 con 0x5589a42f5440 2024-09-13T16:58:36.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.722+0000 7f541ae6d740 10 client.25721 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T16:58:36.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.722+0000 7f541ae6d740 10 client.25721 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:58:36.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.722+0000 7f541ae6d740 20 client.25721 populate_metadata read hostname 'smithi018' 2024-09-13T16:58:36.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.723+0000 7f541ae6d740 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5589a435c8c0 0x5589a435ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:36.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.723+0000 7f541ae6d740 4 client.25721 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:58:36.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.723+0000 7f541ae6d740 1 -- 172.21.15.18:0/55340843 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5589a3f57600 con 0x5589a435c8c0 2024-09-13T16:58:36.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.723+0000 7f5415600640 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5589a435c8c0 0x5589a435ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:36.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.724+0000 7f5415600640 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5589a435c8c0 0x5589a435ece0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97d4705d18ea792a server_cookie=eec3550ef9010a62 in_seq=0 out_seq=0 2024-09-13T16:58:36.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:36.724+0000 7f53f7400640 10 client.25721 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:37.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:37 smithi018 ceph-mon[30981]: pgmap v575: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 503 op/s 2024-09-13T16:58:37.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:37 smithi144 ceph-mon[35328]: pgmap v575: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 503 op/s 2024-09-13T16:58:37.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:37 smithi094 ceph-mon[35259]: pgmap v575: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 503 op/s 2024-09-13T16:58:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.282+0000 7f53f7400640 1 -- 172.21.15.18:0/55340843 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5589a3f57600 con 0x5589a435c8c0 2024-09-13T16:58:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.282+0000 7f53f7400640 10 client.25721 handle_command_reply: tid=0 2024-09-13T16:58:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.282+0000 7f541ae6d740 1 client.25721 shutdown 2024-09-13T16:58:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.282+0000 7f541ae6d740 1 -- 172.21.15.18:0/55340843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 msgr2=0x5589a43159f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.282+0000 7f541ae6d740 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a43159f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5404099770 tx=0x7f5404099f30 comp rx=0 tx=0).stop 2024-09-13T16:58:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.283+0000 7f541ae6d740 1 -- 172.21.15.18:0/55340843 shutdown_connections 2024-09-13T16:58:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.283+0000 7f541ae6d740 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5589a435c8c0 0x5589a435ece0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.283+0000 7f541ae6d740 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5589a42fef40 0x5589a435abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.283+0000 7f541ae6d740 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5589a42f5440 0x5589a43159f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.283+0000 7f541ae6d740 1 --2- 172.21.15.18:0/55340843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589a42efa70 0x5589a43154b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.283+0000 7f541ae6d740 1 -- 172.21.15.18:0/55340843 >> 172.21.15.18:0/55340843 conn(0x5589a42eb0e0 msgr2=0x5589a42f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.283+0000 7f53f7400640 0 client.25721 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.283+0000 7f541ae6d740 1 -- 172.21.15.18:0/55340843 shutdown_connections 2024-09-13T16:58:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.283+0000 7f541ae6d740 1 -- 172.21.15.18:0/55340843 wait complete. 2024-09-13T16:58:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.284+0000 7f541ae6d740 20 client.25721 trim_cache size 0 max 16384 2024-09-13T16:58:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:58:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:58:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:58:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:58:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 -- 172.21.15.18:0/2239591045 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f53f80a1090 msgr2=0x7f53f80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f53f80a1090 0x7f53f80a3550 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5408031c40 tx=0x7f5408009890 comp rx=0 tx=0).stop 2024-09-13T16:58:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 -- 172.21.15.18:0/2239591045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5410100f30 msgr2=0x7f541010a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5410100f30 0x7f541010a010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f540400b4a0 tx=0x7f540400b960 comp rx=0 tx=0).stop 2024-09-13T16:58:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 -- 172.21.15.18:0/2239591045 shutdown_connections 2024-09-13T16:58:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f53f80a1090 0x7f53f80a3550 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54101038e0 0x7f54101ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5410100f30 0x7f541010a010 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 --2- 172.21.15.18:0/2239591045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54100fe5e0 0x7f5410109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 -- 172.21.15.18:0/2239591045 >> 172.21.15.18:0/2239591045 conn(0x7f54100fa3d0 msgr2=0x7f54100fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 -- 172.21.15.18:0/2239591045 shutdown_connections 2024-09-13T16:58:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:39.285+0000 7f5418000640 1 -- 172.21.15.18:0/2239591045 wait complete. 2024-09-13T16:58:39.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:39 smithi144 ceph-mon[35328]: pgmap v576: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 384 op/s 2024-09-13T16:58:39.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:39 smithi094 ceph-mon[35259]: pgmap v576: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 384 op/s 2024-09-13T16:58:39.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:39 smithi018 ceph-mon[30981]: pgmap v576: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 384 op/s 2024-09-13T16:58:40.224 INFO:tasks.workunit.client.0.smithi018.stdout: 2024-09-13T16:58:40.224 INFO:tasks.workunit.client.0.smithi018.stdout:Final score for writes: 351 2024-09-13T16:58:40.224 INFO:tasks.workunit.client.0.smithi018.stdout:Final score for reads : 273239 2024-09-13T16:58:40.224 INFO:tasks.workunit.client.0.smithi018.stdout: 2024-09-13T16:58:40.226 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T16:58:40.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T16:58:41.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:41 smithi144 ceph-mon[35328]: pgmap v577: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.0 MiB/s wr, 652 op/s 2024-09-13T16:58:41.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:41 smithi094 ceph-mon[35259]: pgmap v577: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.0 MiB/s wr, 652 op/s 2024-09-13T16:58:41.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:41 smithi018 ceph-mon[30981]: pgmap v577: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.0 MiB/s wr, 652 op/s 2024-09-13T16:58:43.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:43 smithi144 ceph-mon[35328]: pgmap v578: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.2 MiB/s wr, 901 op/s 2024-09-13T16:58:43.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:43 smithi094 ceph-mon[35259]: pgmap v578: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.2 MiB/s wr, 901 op/s 2024-09-13T16:58:43.670 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:43 smithi018 ceph-mon[30981]: pgmap v578: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.2 MiB/s wr, 901 op/s 2024-09-13T16:58:45.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:45 smithi144 ceph-mon[35328]: pgmap v579: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 886 op/s 2024-09-13T16:58:45.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:45 smithi094 ceph-mon[35259]: pgmap v579: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 886 op/s 2024-09-13T16:58:45.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:45 smithi018 ceph-mon[30981]: pgmap v579: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 886 op/s 2024-09-13T16:58:47.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:47 smithi144 ceph-mon[35328]: pgmap v580: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.2 MiB/s wr, 991 op/s 2024-09-13T16:58:47.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:47 smithi094 ceph-mon[35259]: pgmap v580: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.2 MiB/s wr, 991 op/s 2024-09-13T16:58:47.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:47 smithi018 ceph-mon[30981]: pgmap v580: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.2 MiB/s wr, 991 op/s 2024-09-13T16:58:49.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:49 smithi144 ceph-mon[35328]: pgmap v581: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 1.02k op/s 2024-09-13T16:58:49.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:49 smithi094 ceph-mon[35259]: pgmap v581: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 1.02k op/s 2024-09-13T16:58:49.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:49 smithi018 ceph-mon[30981]: pgmap v581: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 1.02k op/s 2024-09-13T16:58:51.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:51 smithi144 ceph-mon[35328]: pgmap v582: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 1.08k op/s 2024-09-13T16:58:51.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:51 smithi094 ceph-mon[35259]: pgmap v582: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 1.08k op/s 2024-09-13T16:58:51.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:51 smithi018 ceph-mon[30981]: pgmap v582: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 1.08k op/s 2024-09-13T16:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.415+0000 7f4784a00640 1 -- 172.21.15.18:0/3093166347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780103070 msgr2=0x7f47801034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.415+0000 7f4784a00640 1 --2- 172.21.15.18:0/3093166347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780103070 0x7f47801034f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f476c009900 tx=0x7f476c02a3e0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.416+0000 7f4784a00640 1 -- 172.21.15.18:0/3093166347 shutdown_connections 2024-09-13T16:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.416+0000 7f4784a00640 1 --2- 172.21.15.18:0/3093166347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4780103a30 0x7f478010a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.416+0000 7f4784a00640 1 --2- 172.21.15.18:0/3093166347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780103070 0x7f47801034f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.416+0000 7f4784a00640 1 --2- 172.21.15.18:0/3093166347 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780101f20 0x7f4780102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.416+0000 7f4784a00640 1 -- 172.21.15.18:0/3093166347 >> 172.21.15.18:0/3093166347 conn(0x7f47800fd680 msgr2=0x7f47800ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.416+0000 7f4784a00640 1 -- 172.21.15.18:0/3093166347 shutdown_connections 2024-09-13T16:58:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.416+0000 7f4784a00640 1 -- 172.21.15.18:0/3093166347 wait complete. 2024-09-13T16:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f4784a00640 1 Processor -- start 2024-09-13T16:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f4784a00640 1 -- start start 2024-09-13T16:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f4784a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4780101f20 0x7f4780197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f4784a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780103070 0x7f47801984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f4784a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780103a30 0x7f478019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f4784a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478019fa70 con 0x7f4780103070 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f4784a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478019fbe0 con 0x7f4780103a30 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f4784a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478019fda0 con 0x7f4780101f20 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f477d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780103070 0x7f47801984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f477de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4780101f20 0x7f4780197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f477de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4780101f20 0x7f4780197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:52036/0 (socket says 172.21.15.18:52036) 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.417+0000 7f477de00640 1 -- 172.21.15.18:0/2063630825 learned_addr learned my addr 172.21.15.18:0/2063630825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f477e800640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780103a30 0x7f478019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f477de00640 1 -- 172.21.15.18:0/2063630825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780103a30 msgr2=0x7f478019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f477de00640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780103a30 0x7f478019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f477de00640 1 -- 172.21.15.18:0/2063630825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780103070 msgr2=0x7f47801984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f477de00640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780103070 0x7f47801984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f477de00640 1 -- 172.21.15.18:0/2063630825 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770009490 con 0x7f4780101f20 2024-09-13T16:58:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f477e800640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780103a30 0x7f478019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:58:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f477d400640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780103070 0x7f47801984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:58:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f477de00640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4780101f20 0x7f4780197f80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f477000ea60 tx=0x7f477000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f4776a00640 1 -- 172.21.15.18:0/2063630825 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000cde0 con 0x7f4780101f20 2024-09-13T16:58:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f4776a00640 1 -- 172.21.15.18:0/2063630825 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47700035f0 con 0x7f4780101f20 2024-09-13T16:58:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f4776a00640 1 -- 172.21.15.18:0/2063630825 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47700044e0 con 0x7f4780101f20 2024-09-13T16:58:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.418+0000 7f4784a00640 1 -- 172.21.15.18:0/2063630825 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476c009560 con 0x7f4780101f20 2024-09-13T16:58:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.419+0000 7f4784a00640 1 -- 172.21.15.18:0/2063630825 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47801a0380 con 0x7f4780101f20 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.421+0000 7f478788a740 1 Processor -- start 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.421+0000 7f478788a740 1 -- start start 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f478788a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 0x55ff9c849e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f478788a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c84ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f478788a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c851900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f478788a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c755bb0 con 0x55ff9c84a3b0 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f478788a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c7b3a70 con 0x55ff9c849a70 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f478788a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c7b1200 con 0x55ff9c84f440 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f477e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 0x55ff9c849e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f477e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 0x55ff9c849e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:35018/0 (socket says 172.21.15.18:35018) 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f477e800640 1 -- 172.21.15.18:0/1203493475 learned_addr learned my addr 172.21.15.18:0/1203493475 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f477d400640 1 --2- 172.21.15.18:0/1203493475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c851900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f4776a00640 1 -- 172.21.15.18:0/2063630825 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4770003a60 con 0x7f4780101f20 2024-09-13T16:58:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f477e800640 1 -- 172.21.15.18:0/1203493475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 msgr2=0x55ff9c851900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f477e800640 1 --2- 172.21.15.18:0/1203493475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c851900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f477e800640 1 -- 172.21.15.18:0/1203493475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 msgr2=0x55ff9c84ee70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:58:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f477e800640 1 --2- 172.21.15.18:0/1203493475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c84ee70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.422+0000 7f477e800640 1 -- 172.21.15.18:0/1203493475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff9c74e940 con 0x55ff9c849a70 2024-09-13T16:58:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.423+0000 7f477e800640 1 --2- 172.21.15.18:0/1203493475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 0x55ff9c849e70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4778009fd0 tx=0x7f47780108e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bc96674f7a7d7c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.423+0000 7f476b400640 1 -- 172.21.15.18:0/1203493475 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778011760 con 0x55ff9c849a70 2024-09-13T16:58:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.423+0000 7f476b400640 1 -- 172.21.15.18:0/1203493475 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4778015070 con 0x55ff9c849a70 2024-09-13T16:58:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.423+0000 7f476b400640 1 -- 172.21.15.18:0/1203493475 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477801bd30 con 0x55ff9c849a70 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f478788a740 1 -- 172.21.15.18:0/1203493475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 msgr2=0x55ff9c849e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f478788a740 1 --2- 172.21.15.18:0/1203493475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 0x55ff9c849e70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4778009fd0 tx=0x7f47780108e0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f478788a740 1 -- 172.21.15.18:0/1203493475 shutdown_connections 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f478788a740 1 --2- 172.21.15.18:0/1203493475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c84ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f478788a740 1 --2- 172.21.15.18:0/1203493475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c851900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f478788a740 1 --2- 172.21.15.18:0/1203493475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 0x55ff9c849e70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f478788a740 1 -- 172.21.15.18:0/1203493475 >> 172.21.15.18:0/1203493475 conn(0x55ff9c8450e0 msgr2=0x55ff9c8454e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f478788a740 1 -- 172.21.15.18:0/1203493475 shutdown_connections 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f478788a740 1 -- 172.21.15.18:0/1203493475 wait complete. 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f4776a00640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1020 0x7f47640a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f478788a740 1 -- start start 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f4776a00640 1 -- 172.21.15.18:0/2063630825 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f4770014070 con 0x7f4780101f20 2024-09-13T16:58:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.424+0000 7f477e800640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1020 0x7f47640a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f478788a740 1 Processor -- start 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f478788a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c849a70 0x55ff9c853710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f478788a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c84a3b0 0x55ff9c853c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f478788a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c85acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f478788a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c7acaf0 con 0x55ff9c849a70 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f478788a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c76af20 con 0x55ff9c84a3b0 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f478788a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c76abc0 con 0x55ff9c84f440 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f478788a740 10 client.0 _ll_register_callbacks cb 0x55ff9c79ca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f477e800640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1020 0x7f47640a34e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f477801b940 tx=0x7f4778010f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f477e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c85acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.425+0000 7f477de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c849a70 0x55ff9c853710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.426+0000 7f477e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c85acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:52042/0 (socket says 172.21.15.18:52042) 2024-09-13T16:58:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.426+0000 7f477e800640 1 -- 172.21.15.18:0/3136572142 learned_addr learned my addr 172.21.15.18:0/3136572142 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.426+0000 7f477d400640 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c84a3b0 0x55ff9c853c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.426+0000 7f477e800640 1 -- 172.21.15.18:0/3136572142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c84a3b0 msgr2=0x55ff9c853c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.426+0000 7f477e800640 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c84a3b0 0x55ff9c853c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.426+0000 7f477e800640 1 -- 172.21.15.18:0/3136572142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c849a70 msgr2=0x55ff9c853710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.426+0000 7f477e800640 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c849a70 0x55ff9c853710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.426+0000 7f477e800640 1 -- 172.21.15.18:0/3136572142 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4778009cb0 con 0x55ff9c84f440 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.426+0000 7f477e800640 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c85acb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f477801a000 tx=0x7f4778009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1dda2333414325 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.426+0000 7f475fe00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f475fe00640 1 -- 172.21.15.18:0/3136572142 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477801cf10 con 0x55ff9c84f440 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f478788a740 1 -- 172.21.15.18:0/3136572142 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff9c7d6c90 con 0x55ff9c84f440 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f475fe00640 1 -- 172.21.15.18:0/3136572142 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f4778017070 con 0x55ff9c84f440 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f475fe00640 1 -- 172.21.15.18:0/3136572142 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4778005180 con 0x55ff9c84f440 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f478788a740 10 client.25678 fetch_fsmap learned FSMap version 33 2024-09-13T16:58:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f478788a740 1 -- 172.21.15.18:0/3136572142 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55ff9c7ab170 con 0x55ff9c84f440 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f475fe00640 1 -- 172.21.15.18:0/3136572142 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ff9c7d6c90 con 0x55ff9c84f440 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f475fe00640 1 -- 172.21.15.18:0/3136572142 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 33) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f4778026910 con 0x55ff9c84f440 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f478788a740 10 client.25678 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f478788a740 10 client.25678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f478788a740 20 client.25678 populate_metadata read hostname 'smithi018' 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f478788a740 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ff9c85f320 0x55ff9c861740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f478788a740 4 client.25678 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.427+0000 7f478788a740 1 -- 172.21.15.18:0/3136572142 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff9c79f7d0 con 0x55ff9c85f320 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.428+0000 7f477de00640 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ff9c85f320 0x55ff9c861740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.428+0000 7f475fe00640 10 client.25678 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:52.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.428+0000 7f477de00640 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ff9c85f320 0x55ff9c861740 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c82a81fd1cd167f1 server_cookie=56cd81dd40dd422a in_seq=0 out_seq=0 2024-09-13T16:58:52.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f475fe00640 1 -- 172.21.15.18:0/3136572142 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ff9c79f7d0 con 0x55ff9c85f320 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f475fe00640 10 client.25678 handle_command_reply: tid=0 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 client.25678 shutdown 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 -- 172.21.15.18:0/3136572142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 msgr2=0x55ff9c85acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c85acb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f477801a000 tx=0x7f4778009500 comp rx=0 tx=0).stop 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 -- 172.21.15.18:0/3136572142 shutdown_connections 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ff9c85f320 0x55ff9c861740 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c85acb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c84a3b0 0x55ff9c853c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 --2- 172.21.15.18:0/3136572142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c849a70 0x55ff9c853710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 -- 172.21.15.18:0/3136572142 >> 172.21.15.18:0/3136572142 conn(0x55ff9c8450e0 msgr2=0x55ff9c8468f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f475fe00640 0 client.25678 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 -- 172.21.15.18:0/3136572142 shutdown_connections 2024-09-13T16:58:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 1 -- 172.21.15.18:0/3136572142 wait complete. 2024-09-13T16:58:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.429+0000 7f478788a740 20 client.25678 trim_cache size 0 max 16384 2024-09-13T16:58:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.442+0000 7f478788a740 1 Processor -- start 2024-09-13T16:58:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.442+0000 7f478788a740 1 -- start start 2024-09-13T16:58:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f478788a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 0x55ff9c84b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f478788a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c84b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f478788a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c85ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f478788a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c513e60 con 0x55ff9c84a3b0 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f478788a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c851d80 con 0x55ff9c849a70 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f478788a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c84ae10 con 0x55ff9c84f440 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f477d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c84b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f477d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c84b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57240/0 (socket says 172.21.15.18:57240) 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f477d400640 1 -- 172.21.15.18:0/1405824958 learned_addr learned my addr 172.21.15.18:0/1405824958 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f477de00640 1 --2- 172.21.15.18:0/1405824958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 0x55ff9c84b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f477e800640 1 --2- 172.21.15.18:0/1405824958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c85ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f477d400640 1 -- 172.21.15.18:0/1405824958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 msgr2=0x55ff9c85ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f477d400640 1 --2- 172.21.15.18:0/1405824958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c85ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f477d400640 1 -- 172.21.15.18:0/1405824958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 msgr2=0x55ff9c84b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f477d400640 1 --2- 172.21.15.18:0/1405824958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 0x55ff9c84b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.443+0000 7f477d400640 1 -- 172.21.15.18:0/1405824958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff9c74d180 con 0x55ff9c84a3b0 2024-09-13T16:58:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.444+0000 7f477d400640 1 --2- 172.21.15.18:0/1405824958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c84b810 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f476c02a9d0 tx=0x7f476c0314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a719bc127c6d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.444+0000 7f476be00640 1 -- 172.21.15.18:0/1405824958 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0053b0 con 0x55ff9c84a3b0 2024-09-13T16:58:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.444+0000 7f476be00640 1 -- 172.21.15.18:0/1405824958 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f476c043040 con 0x55ff9c84a3b0 2024-09-13T16:58:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.444+0000 7f476be00640 1 -- 172.21.15.18:0/1405824958 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c003b10 con 0x55ff9c84a3b0 2024-09-13T16:58:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.445+0000 7f478788a740 1 -- 172.21.15.18:0/1405824958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 msgr2=0x55ff9c84b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.445+0000 7f478788a740 1 --2- 172.21.15.18:0/1405824958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c84b810 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f476c02a9d0 tx=0x7f476c0314a0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.445+0000 7f478788a740 1 -- 172.21.15.18:0/1405824958 shutdown_connections 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.445+0000 7f478788a740 1 --2- 172.21.15.18:0/1405824958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c84b810 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.445+0000 7f478788a740 1 --2- 172.21.15.18:0/1405824958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c84f440 0x55ff9c85ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.445+0000 7f478788a740 1 --2- 172.21.15.18:0/1405824958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c849a70 0x55ff9c84b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.445+0000 7f478788a740 1 -- 172.21.15.18:0/1405824958 >> 172.21.15.18:0/1405824958 conn(0x55ff9c8450e0 msgr2=0x55ff9c84e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.445+0000 7f478788a740 1 -- 172.21.15.18:0/1405824958 shutdown_connections 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.445+0000 7f478788a740 1 -- 172.21.15.18:0/1405824958 wait complete. 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.445+0000 7f478788a740 1 -- start start 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f478788a740 1 Processor -- start 2024-09-13T16:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f478788a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c849a70 0x55ff9c85aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f478788a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c8575e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f478788a740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c84f440 0x55ff9c857b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f478788a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c8580e0 con 0x55ff9c84a3b0 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f478788a740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c858250 con 0x55ff9c84f440 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f478788a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9c8b5850 con 0x55ff9c849a70 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f478788a740 10 client.0 _ll_register_callbacks cb 0x7f4778009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f477d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c8575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f477de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c849a70 0x55ff9c85aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f477de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c849a70 0x55ff9c85aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:52062/0 (socket says 172.21.15.18:52062) 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f477de00640 1 -- 172.21.15.18:0/2928810554 learned_addr learned my addr 172.21.15.18:0/2928810554 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.446+0000 7f477e800640 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c84f440 0x55ff9c857b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f477de00640 1 -- 172.21.15.18:0/2928810554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c84f440 msgr2=0x55ff9c857b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f477de00640 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c84f440 0x55ff9c857b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f477de00640 1 -- 172.21.15.18:0/2928810554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 msgr2=0x55ff9c8575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f477de00640 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c8575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f477de00640 1 -- 172.21.15.18:0/2928810554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478010ac80 con 0x55ff9c849a70 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f477de00640 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c849a70 0x55ff9c85aaf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f47700ca8a0 tx=0x7f477009aa50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=715dfce05d93b6ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f475fe00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f475fe00640 1 -- 172.21.15.18:0/2928810554 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47700b0040 con 0x55ff9c849a70 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f475fe00640 1 -- 172.21.15.18:0/2928810554 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f4770098590 con 0x55ff9c849a70 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f478788a740 1 -- 172.21.15.18:0/2928810554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4778015070 con 0x55ff9c849a70 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f475fe00640 1 -- 172.21.15.18:0/2928810554 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4770003760 con 0x55ff9c849a70 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f478788a740 10 client.25684 fetch_fsmap learned FSMap version 33 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f478788a740 1 -- 172.21.15.18:0/2928810554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55ff9c772560 con 0x55ff9c849a70 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.447+0000 7f475fe00640 1 -- 172.21.15.18:0/2928810554 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4778015070 con 0x55ff9c849a70 2024-09-13T16:58:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.448+0000 7f475fe00640 1 -- 172.21.15.18:0/2928810554 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 33) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f47700a2300 con 0x55ff9c849a70 2024-09-13T16:58:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.448+0000 7f478788a740 10 client.25684 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T16:58:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.448+0000 7f478788a740 10 client.25684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:58:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.448+0000 7f478788a740 20 client.25684 populate_metadata read hostname 'smithi018' 2024-09-13T16:58:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.448+0000 7f478788a740 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ff9c8b7250 0x55ff9c8b9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.448+0000 7f478788a740 4 client.25684 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:58:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.448+0000 7f478788a740 1 -- 172.21.15.18:0/2928810554 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ff9c4a0300 con 0x55ff9c8b7250 2024-09-13T16:58:52.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.461+0000 7f477d400640 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ff9c8b7250 0x55ff9c8b9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:52.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.497+0000 7f477d400640 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ff9c8b7250 0x55ff9c8b9670 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5429be86b09184f4 server_cookie=8fd070de3c04993b in_seq=0 out_seq=0 2024-09-13T16:58:52.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.497+0000 7f475fe00640 10 client.25684 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f475fe00640 1 -- 172.21.15.18:0/2928810554 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ff9c4a0300 con 0x55ff9c8b7250 2024-09-13T16:58:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f475fe00640 10 client.25684 handle_command_reply: tid=0 2024-09-13T16:58:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f478788a740 1 client.25684 shutdown 2024-09-13T16:58:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f478788a740 1 -- 172.21.15.18:0/2928810554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c849a70 msgr2=0x55ff9c85aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f478788a740 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c849a70 0x55ff9c85aaf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f47700ca8a0 tx=0x7f477009aa50 comp rx=0 tx=0).stop 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f478788a740 1 -- 172.21.15.18:0/2928810554 shutdown_connections 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f478788a740 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ff9c8b7250 0x55ff9c8b9670 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f478788a740 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff9c84a3b0 0x55ff9c8575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f478788a740 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ff9c84f440 0x55ff9c857b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f475fe00640 0 client.25684 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f478788a740 1 --2- 172.21.15.18:0/2928810554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff9c849a70 0x55ff9c85aaf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f478788a740 1 -- 172.21.15.18:0/2928810554 >> 172.21.15.18:0/2928810554 conn(0x55ff9c8450e0 msgr2=0x55ff9c84e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.970+0000 7f478788a740 1 -- 172.21.15.18:0/2928810554 shutdown_connections 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f478788a740 1 -- 172.21.15.18:0/2928810554 wait complete. 2024-09-13T16:58:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f478788a740 20 client.25684 trim_cache size 0 max 16384 2024-09-13T16:58:52.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:58:52.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:58:52.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:58:52.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:58:52.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f4784a00640 1 -- 172.21.15.18:0/2063630825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1020 msgr2=0x7f47640a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:52.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f4784a00640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1020 0x7f47640a34e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f477801b940 tx=0x7f4778010f90 comp rx=0 tx=0).stop 2024-09-13T16:58:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f4784a00640 1 -- 172.21.15.18:0/2063630825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4780101f20 msgr2=0x7f4780197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f4784a00640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4780101f20 0x7f4780197f80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f477000ea60 tx=0x7f477000ef20 comp rx=0 tx=0).stop 2024-09-13T16:58:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f4784a00640 1 -- 172.21.15.18:0/2063630825 shutdown_connections 2024-09-13T16:58:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f4784a00640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f47640a1020 0x7f47640a34e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f4784a00640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4780103070 0x7f47801984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f4784a00640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4780103a30 0x7f478019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f4784a00640 1 --2- 172.21.15.18:0/2063630825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4780101f20 0x7f4780197f80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.971+0000 7f4784a00640 1 -- 172.21.15.18:0/2063630825 >> 172.21.15.18:0/2063630825 conn(0x7f47800fd680 msgr2=0x7f4780106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.972+0000 7f4784a00640 1 -- 172.21.15.18:0/2063630825 shutdown_connections 2024-09-13T16:58:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:58:52.972+0000 7f4784a00640 1 -- 172.21.15.18:0/2063630825 wait complete. 2024-09-13T16:58:53.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:53 smithi144 ceph-mon[35328]: pgmap v583: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 901 op/s 2024-09-13T16:58:53.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:53 smithi094 ceph-mon[35259]: pgmap v583: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 901 op/s 2024-09-13T16:58:53.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:53 smithi018 ceph-mon[30981]: pgmap v583: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 901 op/s 2024-09-13T16:58:55.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:55 smithi144 ceph-mon[35328]: pgmap v584: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 662 op/s 2024-09-13T16:58:55.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:55 smithi094 ceph-mon[35259]: pgmap v584: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 662 op/s 2024-09-13T16:58:55.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:55 smithi018 ceph-mon[30981]: pgmap v584: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 662 op/s 2024-09-13T16:58:57.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:57 smithi018 ceph-mon[30981]: pgmap v585: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 747 op/s 2024-09-13T16:58:57.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:57 smithi094 ceph-mon[35259]: pgmap v585: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 747 op/s 2024-09-13T16:58:57.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:57 smithi144 ceph-mon[35328]: pgmap v585: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 747 op/s 2024-09-13T16:58:59.573 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:58:59 smithi144 ceph-mon[35328]: pgmap v586: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 694 op/s 2024-09-13T16:58:59.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:58:59 smithi094 ceph-mon[35259]: pgmap v586: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 694 op/s 2024-09-13T16:58:59.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:58:59 smithi018 ceph-mon[30981]: pgmap v586: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 694 op/s 2024-09-13T16:59:01.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:01 smithi094 ceph-mon[35259]: pgmap v587: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 765 op/s 2024-09-13T16:59:01.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:01 smithi018 ceph-mon[30981]: pgmap v587: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 765 op/s 2024-09-13T16:59:01.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:01 smithi144 ceph-mon[35328]: pgmap v587: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 765 op/s 2024-09-13T16:59:02.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:02 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:59:02.679 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:02 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:59:02.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:02 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:59:03.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: pgmap v588: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 790 op/s 2024-09-13T16:59:03.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-13T16:59:03.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: Adjusting osd_memory_target on smithi094 to 176.0M 2024-09-13T16:59:03.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: Unable to set osd_memory_target on smithi144 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-13T16:59:03.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: Unable to set osd_memory_target on smithi094 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-13T16:59:03.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:03.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:59:03.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:03 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:59:03.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: pgmap v588: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 790 op/s 2024-09-13T16:59:03.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-13T16:59:03.713 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: Adjusting osd_memory_target on smithi094 to 176.0M 2024-09-13T16:59:03.713 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: Unable to set osd_memory_target on smithi144 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-13T16:59:03.713 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: Unable to set osd_memory_target on smithi094 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-13T16:59:03.713 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:03.713 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:59:03.713 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:03 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:59:03.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: pgmap v588: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 790 op/s 2024-09-13T16:59:03.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:03.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-13T16:59:03.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: Adjusting osd_memory_target on smithi094 to 176.0M 2024-09-13T16:59:03.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: Unable to set osd_memory_target on smithi144 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-13T16:59:03.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: Unable to set osd_memory_target on smithi094 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-13T16:59:03.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:03.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:59:03.774 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:03 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:59:05.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:05 smithi018 ceph-mon[30981]: pgmap v589: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 687 op/s 2024-09-13T16:59:05.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:05 smithi094 ceph-mon[35259]: pgmap v589: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 687 op/s 2024-09-13T16:59:05.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:05 smithi144 ceph-mon[35328]: pgmap v589: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 687 op/s 2024-09-13T16:59:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.095+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1567274498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc1005e0 msgr2=0x7fa6cc1029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.095+0000 7fa6d2c00640 1 --2- 172.21.15.18:0/1567274498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc1005e0 0x7fa6cc1029d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009900 tx=0x7fa6c002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.095+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1567274498 shutdown_connections 2024-09-13T16:59:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.095+0000 7fa6d2c00640 1 --2- 172.21.15.18:0/1567274498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6cc102f10 0x7fa6cc105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.095+0000 7fa6d2c00640 1 --2- 172.21.15.18:0/1567274498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6cc105920 0x7fa6cc107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.095+0000 7fa6d2c00640 1 --2- 172.21.15.18:0/1567274498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc1005e0 0x7fa6cc1029d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.095+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1567274498 >> 172.21.15.18:0/1567274498 conn(0x7fa6cc0fa1c0 msgr2=0x7fa6cc0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.095+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1567274498 shutdown_connections 2024-09-13T16:59:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.095+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1567274498 wait complete. 2024-09-13T16:59:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.096+0000 7fa6d2c00640 1 Processor -- start 2024-09-13T16:59:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.096+0000 7fa6d2c00640 1 -- start start 2024-09-13T16:59:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.096+0000 7fa6d2c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6cc1005e0 0x7fa6cc195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc102f10 0x7fa6cc196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6cc105920 0x7fa6cc19d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc19d730 con 0x7fa6cc1005e0 2024-09-13T16:59:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc19d8a0 con 0x7fa6cc105920 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc19da60 con 0x7fa6cc102f10 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6cc105920 0x7fa6cc19d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6cc1005e0 0x7fa6cc195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6cc105920 0x7fa6cc19d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:50506/0 (socket says 172.21.15.18:50506) 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2200640 1 -- 172.21.15.18:0/1637527138 learned_addr learned my addr 172.21.15.18:0/1637527138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc102f10 0x7fa6cc196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2200640 1 -- 172.21.15.18:0/1637527138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc102f10 msgr2=0x7fa6cc196190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2200640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc102f10 0x7fa6cc196190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2200640 1 -- 172.21.15.18:0/1637527138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6cc1005e0 msgr2=0x7fa6cc195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2200640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6cc1005e0 0x7fa6cc195c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.097+0000 7fa6d2200640 1 -- 172.21.15.18:0/1637527138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c4009840 con 0x7fa6cc105920 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.098+0000 7fa6d2200640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6cc105920 0x7fa6cc19d1c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400efd0 tx=0x7fa6c400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.098+0000 7fa6ca000640 1 -- 172.21.15.18:0/1637527138 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4009b40 con 0x7fa6cc105920 2024-09-13T16:59:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.098+0000 7fa6ca000640 1 -- 172.21.15.18:0/1637527138 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6c4003b70 con 0x7fa6cc105920 2024-09-13T16:59:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.098+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1637527138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c0009560 con 0x7fa6cc105920 2024-09-13T16:59:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.098+0000 7fa6ca000640 1 -- 172.21.15.18:0/1637527138 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4010850 con 0x7fa6cc105920 2024-09-13T16:59:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.098+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1637527138 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc19e040 con 0x7fa6cc105920 2024-09-13T16:59:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.102+0000 7fa6d71f7740 1 Processor -- start 2024-09-13T16:59:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.102+0000 7fa6ca000640 1 -- 172.21.15.18:0/1637527138 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa6c4004020 con 0x7fa6cc105920 2024-09-13T16:59:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.102+0000 7fa6d71f7740 1 -- start start 2024-09-13T16:59:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244158490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 0x55624415d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x55624415ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624405fbb0 con 0x556244158090 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562440bda70 con 0x55624415da60 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562440bb200 con 0x5562441589d0 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 0x55624415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56182/0 (socket says 172.21.15.18:56182) 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d0e00640 1 -- 172.21.15.18:0/3658181694 learned_addr learned my addr 172.21.15.18:0/3658181694 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 0x55624415d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:33762/0 (socket says 172.21.15.18:33762) 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/3658181694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x55624415ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d1800640 1 -- 172.21.15.18:0/3658181694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 msgr2=0x55624415ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d1800640 1 --2- 172.21.15.18:0/3658181694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x55624415ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d1800640 1 -- 172.21.15.18:0/3658181694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 msgr2=0x556244158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d1800640 1 --2- 172.21.15.18:0/3658181694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d1800640 1 -- 172.21.15.18:0/3658181694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556244058940 con 0x5562441589d0 2024-09-13T16:59:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.103+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/3658181694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x55624415ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:59:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.104+0000 7fa6d1800640 1 --2- 172.21.15.18:0/3658181694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 0x55624415d490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa6c002a910 tx=0x7fa6c0004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f40b6567603312e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.104+0000 7fa6ca000640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6b40a1130 0x7fa6b40a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.104+0000 7fa6ca000640 1 -- 172.21.15.18:0/1637527138 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa6c4014070 con 0x7fa6cc105920 2024-09-13T16:59:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.104+0000 7fa6bea00640 1 -- 172.21.15.18:0/3658181694 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0004430 con 0x5562441589d0 2024-09-13T16:59:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.104+0000 7fa6bea00640 1 -- 172.21.15.18:0/3658181694 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6c0040070 con 0x5562441589d0 2024-09-13T16:59:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.104+0000 7fa6bea00640 1 -- 172.21.15.18:0/3658181694 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0031a60 con 0x5562441589d0 2024-09-13T16:59:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.104+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6b40a1130 0x7fa6b40a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.105+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6b40a1130 0x7fa6b40a35f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009fd0 tx=0x7fa6b80097a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.105+0000 7fa6d71f7740 1 -- 172.21.15.18:0/3658181694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 msgr2=0x55624415d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.105+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/3658181694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 0x55624415d490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa6c002a910 tx=0x7fa6c0004040 comp rx=0 tx=0).stop 2024-09-13T16:59:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.105+0000 7fa6d71f7740 1 -- 172.21.15.18:0/3658181694 shutdown_connections 2024-09-13T16:59:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.105+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/3658181694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x55624415ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.105+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/3658181694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 0x55624415d490 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.105+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/3658181694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.105+0000 7fa6d71f7740 1 -- 172.21.15.18:0/3658181694 >> 172.21.15.18:0/3658181694 conn(0x55624414f2f0 msgr2=0x55624414f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.105+0000 7fa6d71f7740 1 -- 172.21.15.18:0/3658181694 shutdown_connections 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.105+0000 7fa6d71f7740 1 -- 172.21.15.18:0/3658181694 wait complete. 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.106+0000 7fa6d71f7740 1 -- start start 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.106+0000 7fa6d71f7740 1 Processor -- start 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.106+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.106+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 0x556244162210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.106+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.106+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562440b6af0 con 0x556244158090 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.106+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x556244074f20 con 0x55624415da60 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.106+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556244074bc0 con 0x5562441589d0 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.106+0000 7fa6d71f7740 10 client.0 _ll_register_callbacks cb 0x5562440a6a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:59:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244161cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56198/0 (socket says 172.21.15.18:56198) 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d1800640 1 -- 172.21.15.18:0/1069446591 learned_addr learned my addr 172.21.15.18:0/1069446591 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d2200640 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 0x556244162210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d1800640 1 -- 172.21.15.18:0/1069446591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 msgr2=0x556244162210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d1800640 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 0x556244162210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d1800640 1 -- 172.21.15.18:0/1069446591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 msgr2=0x556244169250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d1800640 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d1800640 1 -- 172.21.15.18:0/1069446591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc108990 con 0x556244158090 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d2200640 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6d1800640 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244161cd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0006010 tx=0x7fa6c00042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df439efaa3e9db0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.107+0000 7fa6b3400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6b3400640 1 -- 172.21.15.18:0/1069446591 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00319e0 con 0x556244158090 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6d71f7740 1 -- 172.21.15.18:0/1069446591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562440e0c90 con 0x556244158090 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6b3400640 1 -- 172.21.15.18:0/1069446591 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa6c0031b40 con 0x556244158090 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6b3400640 1 -- 172.21.15.18:0/1069446591 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6c00044d0 con 0x556244158090 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6d71f7740 10 client.15684 fetch_fsmap learned FSMap version 33 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6d71f7740 1 -- 172.21.15.18:0/1069446591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5562440b5170 con 0x556244158090 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6b3400640 1 -- 172.21.15.18:0/1069446591 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5562440e0c90 con 0x556244158090 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6b3400640 1 -- 172.21.15.18:0/1069446591 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 33) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa6c003c5e0 con 0x556244158090 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6d71f7740 10 client.15684 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6d71f7740 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6d71f7740 20 client.15684 populate_metadata read hostname 'smithi018' 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.108+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55624416d810 0x55624416fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.109+0000 7fa6d71f7740 4 client.15684 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:59:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.109+0000 7fa6d71f7740 1 -- 172.21.15.18:0/1069446591 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562440a97d0 con 0x55624416d810 2024-09-13T16:59:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.109+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55624416d810 0x55624416fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.109+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55624416d810 0x55624416fc30 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a5a48c9b15bc88 server_cookie=a16463ff86335918 in_seq=0 out_seq=0 2024-09-13T16:59:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.109+0000 7fa6b3400640 10 client.15684 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.110+0000 7fa6b3400640 1 -- 172.21.15.18:0/1069446591 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5562440a97d0 con 0x55624416d810 2024-09-13T16:59:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6b3400640 10 client.15684 handle_command_reply: tid=0 2024-09-13T16:59:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 client.15684 shutdown 2024-09-13T16:59:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 -- 172.21.15.18:0/1069446591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 msgr2=0x556244161cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244161cd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0006010 tx=0x7fa6c00042e0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 -- 172.21.15.18:0/1069446591 shutdown_connections 2024-09-13T16:59:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55624416d810 0x55624416fc30 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5562441589d0 0x556244162210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/1069446591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556244158090 0x556244161cd0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6b3400640 0 client.15684 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 -- 172.21.15.18:0/1069446591 >> 172.21.15.18:0/1069446591 conn(0x55624414f2f0 msgr2=0x556244150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 -- 172.21.15.18:0/1069446591 shutdown_connections 2024-09-13T16:59:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 1 -- 172.21.15.18:0/1069446591 wait complete. 2024-09-13T16:59:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.111+0000 7fa6d71f7740 20 client.15684 trim_cache size 0 max 16384 2024-09-13T16:59:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.125+0000 7fa6d71f7740 1 Processor -- start 2024-09-13T16:59:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.125+0000 7fa6d71f7740 1 -- start start 2024-09-13T16:59:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x5562441598f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x556243e1de60 con 0x5562441589d0 2024-09-13T16:59:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x556244158eb0 con 0x55624415da60 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562441696b0 con 0x556244158090 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:50522/0 (socket says 172.21.15.18:50522) 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56202/0 (socket says 172.21.15.18:56202) 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d1800640 1 --2- 172.21.15.18:0/873771802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x5562441598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d2200640 1 -- 172.21.15.18:0/873771802 learned_addr learned my addr 172.21.15.18:0/873771802 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d0e00640 1 -- 172.21.15.18:0/873771802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 msgr2=0x5562441598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/873771802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x5562441598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d0e00640 1 -- 172.21.15.18:0/873771802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 msgr2=0x556244169170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/873771802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.126+0000 7fa6d0e00640 1 -- 172.21.15.18:0/873771802 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556244057180 con 0x5562441589d0 2024-09-13T16:59:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.127+0000 7fa6d1800640 1 --2- 172.21.15.18:0/873771802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x5562441598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:59:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.127+0000 7fa6d2200640 1 --2- 172.21.15.18:0/873771802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:59:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.127+0000 7fa6d0e00640 1 --2- 172.21.15.18:0/873771802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244159e30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x5562441704d0 tx=0x7fa6b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426ad427dd72d4a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.127+0000 7fa6bf400640 1 -- 172.21.15.18:0/873771802 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8028070 con 0x5562441589d0 2024-09-13T16:59:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.127+0000 7fa6bf400640 1 -- 172.21.15.18:0/873771802 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6b802a850 con 0x5562441589d0 2024-09-13T16:59:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.127+0000 7fa6bf400640 1 -- 172.21.15.18:0/873771802 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8022410 con 0x5562441589d0 2024-09-13T16:59:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.128+0000 7fa6d71f7740 1 -- 172.21.15.18:0/873771802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 msgr2=0x556244159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.128+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/873771802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244159e30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x5562441704d0 tx=0x7fa6b80046c0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.128+0000 7fa6d71f7740 1 -- 172.21.15.18:0/873771802 shutdown_connections 2024-09-13T16:59:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.128+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/873771802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244159e30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.128+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/873771802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244169170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.128+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/873771802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x5562441598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.128+0000 7fa6d71f7740 1 -- 172.21.15.18:0/873771802 >> 172.21.15.18:0/873771802 conn(0x55624414f2f0 msgr2=0x55624415cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.128+0000 7fa6d71f7740 1 -- 172.21.15.18:0/873771802 shutdown_connections 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.128+0000 7fa6d71f7740 1 -- 172.21.15.18:0/873771802 wait complete. 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.128+0000 7fa6d71f7740 1 -- start start 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d71f7740 1 Processor -- start 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x556244167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d71f7740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x556244168aa0 con 0x5562441589d0 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x556244168c10 con 0x55624415da60 2024-09-13T16:59:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d71f7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556244168dd0 con 0x556244158090 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d71f7740 10 client.0 _ll_register_callbacks cb 0x7fa6c40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x556244167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244168560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:50532/0 (socket says 172.21.15.18:50532) 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244167550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56206/0 (socket says 172.21.15.18:56206) 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x556244167010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:33788/0 (socket says 172.21.15.18:33788) 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.129+0000 7fa6d2200640 1 -- 172.21.15.18:0/2570791699 learned_addr learned my addr 172.21.15.18:0/2570791699 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6d2200640 1 -- 172.21.15.18:0/2570791699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 msgr2=0x556244167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6d2200640 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x556244167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6d2200640 1 -- 172.21.15.18:0/2570791699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 msgr2=0x556244167550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6d2200640 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244167550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6d2200640 1 -- 172.21.15.18:0/2570791699 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562440b5170 con 0x55624415da60 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6d1800640 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x556244167010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6d2200640 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244168560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4096840 tx=0x7fa6c4009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9ee534193825786 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6b3400640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6b3400640 1 -- 172.21.15.18:0/2570791699 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40a25c0 con 0x55624415da60 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6d71f7740 1 -- 172.21.15.18:0/2570791699 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6c0040070 con 0x55624415da60 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6b3400640 1 -- 172.21.15.18:0/2570791699 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fa6c409a3d0 con 0x55624415da60 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6b3400640 1 -- 172.21.15.18:0/2570791699 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6c409e200 con 0x55624415da60 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6d71f7740 10 client.25757 fetch_fsmap learned FSMap version 33 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.130+0000 7fa6d71f7740 1 -- 172.21.15.18:0/2570791699 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7fa6cc19e040 con 0x55624415da60 2024-09-13T16:59:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.131+0000 7fa6b3400640 1 -- 172.21.15.18:0/2570791699 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6c0040070 con 0x55624415da60 2024-09-13T16:59:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.131+0000 7fa6b3400640 1 -- 172.21.15.18:0/2570791699 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 33) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa6c40b1070 con 0x55624415da60 2024-09-13T16:59:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.131+0000 7fa6d71f7740 10 client.25757 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T16:59:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.131+0000 7fa6d71f7740 10 client.25757 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:59:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.131+0000 7fa6d71f7740 20 client.25757 populate_metadata read hostname 'smithi018' 2024-09-13T16:59:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.131+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562441c4e10 0x5562441c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.131+0000 7fa6d71f7740 4 client.25757 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:59:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.131+0000 7fa6d71f7740 1 -- 172.21.15.18:0/2570791699 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556243daa300 con 0x5562441c4e10 2024-09-13T16:59:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.131+0000 7fa6d1800640 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562441c4e10 0x5562441c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.132+0000 7fa6d1800640 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562441c4e10 0x5562441c7230 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b62db4a20ca7e4e3 server_cookie=49be83704e55a09d in_seq=0 out_seq=0 2024-09-13T16:59:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.132+0000 7fa6b3400640 10 client.25757 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.551+0000 7fa6b3400640 1 -- 172.21.15.18:0/2570791699 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556243daa300 con 0x5562441c4e10 2024-09-13T16:59:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.551+0000 7fa6b3400640 10 client.25757 handle_command_reply: tid=0 2024-09-13T16:59:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.551+0000 7fa6d71f7740 1 client.25757 shutdown 2024-09-13T16:59:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6d71f7740 1 -- 172.21.15.18:0/2570791699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 msgr2=0x556244168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244168560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4096840 tx=0x7fa6c4009f90 comp rx=0 tx=0).stop 2024-09-13T16:59:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6d71f7740 1 -- 172.21.15.18:0/2570791699 shutdown_connections 2024-09-13T16:59:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5562441c4e10 0x5562441c7230 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562441589d0 0x556244167550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55624415da60 0x556244168560 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6d71f7740 1 --2- 172.21.15.18:0/2570791699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556244158090 0x556244167010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6d71f7740 1 -- 172.21.15.18:0/2570791699 >> 172.21.15.18:0/2570791699 conn(0x55624414f2f0 msgr2=0x556244161a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6b3400640 0 client.25757 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6d71f7740 1 -- 172.21.15.18:0/2570791699 shutdown_connections 2024-09-13T16:59:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.552+0000 7fa6d71f7740 1 -- 172.21.15.18:0/2570791699 wait complete. 2024-09-13T16:59:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.553+0000 7fa6d71f7740 20 client.25757 trim_cache size 0 max 16384 2024-09-13T16:59:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:59:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:59:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:59:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:59:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.553+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1637527138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6b40a1130 msgr2=0x7fa6b40a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.553+0000 7fa6d2c00640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6b40a1130 0x7fa6b40a35f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009fd0 tx=0x7fa6b80097a0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.553+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1637527138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6cc105920 msgr2=0x7fa6cc19d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.553+0000 7fa6d2c00640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6cc105920 0x7fa6cc19d1c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400efd0 tx=0x7fa6c400c6a0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.554+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1637527138 shutdown_connections 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.554+0000 7fa6d2c00640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6cc105920 0x7fa6cc19d1c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.554+0000 7fa6d2c00640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc102f10 0x7fa6cc196190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.554+0000 7fa6d2c00640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fa6b40a1130 0x7fa6b40a35f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.554+0000 7fa6d2c00640 1 --2- 172.21.15.18:0/1637527138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6cc1005e0 0x7fa6cc195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.554+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1637527138 >> 172.21.15.18:0/1637527138 conn(0x7fa6cc0fa1c0 msgr2=0x7fa6cc100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.554+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1637527138 shutdown_connections 2024-09-13T16:59:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:06.554+0000 7fa6d2c00640 1 -- 172.21.15.18:0/1637527138 wait complete. 2024-09-13T16:59:07.297 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:59:07 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i[65987]: ignoring --setuser ceph since I am not root 2024-09-13T16:59:07.297 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:59:07 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i[65987]: ignoring --setgroup ceph since I am not root 2024-09-13T16:59:07.297 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:59:07 smithi144 ceph-mds[65991]: -- 172.21.15.144:0/2728153868 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e992b22d00 con 0x55e992af6800 2024-09-13T16:59:07.297 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 16:59:07 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i[65987]: starting mds.i at 2024-09-13T16:59:07.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:07 smithi094 ceph-mon[35259]: pgmap v590: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 783 op/s 2024-09-13T16:59:07.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:07 smithi094 ceph-mon[35259]: daemon mds.i restarted 2024-09-13T16:59:07.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:07 smithi094 ceph-mon[35259]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T16:59:07.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:07 smithi018 ceph-mon[30981]: pgmap v590: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 783 op/s 2024-09-13T16:59:07.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:07 smithi018 ceph-mon[30981]: daemon mds.i restarted 2024-09-13T16:59:07.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:07 smithi018 ceph-mon[30981]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T16:59:07.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:07 smithi144 ceph-mon[35328]: pgmap v590: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 783 op/s 2024-09-13T16:59:07.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:07 smithi144 ceph-mon[35328]: daemon mds.i restarted 2024-09-13T16:59:07.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:07 smithi144 ceph-mon[35328]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T16:59:08.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:08 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.144:6838/870471473,v1:172.21.15.144:6839/870471473] up:boot 2024-09-13T16:59:08.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:08 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-09-13T16:59:08.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:08 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:59:08.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:08 smithi094 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:59:08.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:08 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.144:6838/870471473,v1:172.21.15.144:6839/870471473] up:boot 2024-09-13T16:59:08.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:08 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-09-13T16:59:08.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:08 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:59:08.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:08 smithi018 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:59:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:08 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.144:6838/870471473,v1:172.21.15.144:6839/870471473] up:boot 2024-09-13T16:59:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:08 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-09-13T16:59:08.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:08 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:59:08.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:08 smithi144 ceph-mon[35328]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:59:09.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:09 smithi094 ceph-mon[35259]: pgmap v592: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 769 op/s 2024-09-13T16:59:09.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:09 smithi018 ceph-mon[30981]: pgmap v592: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 769 op/s 2024-09-13T16:59:09.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:09 smithi144 ceph-mon[35328]: pgmap v592: 129 pgs: 129 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 769 op/s 2024-09-13T16:59:11.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:11 smithi094 ceph-mon[35259]: pgmap v593: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 793 op/s 2024-09-13T16:59:11.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:11 smithi018 ceph-mon[30981]: pgmap v593: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 793 op/s 2024-09-13T16:59:11.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:11 smithi144 ceph-mon[35328]: pgmap v593: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 793 op/s 2024-09-13T16:59:13.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:13 smithi094 ceph-mon[35259]: pgmap v594: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 792 op/s 2024-09-13T16:59:13.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:13 smithi018 ceph-mon[30981]: pgmap v594: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 792 op/s 2024-09-13T16:59:13.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:13 smithi144 ceph-mon[35328]: pgmap v594: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 792 op/s 2024-09-13T16:59:15.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:15 smithi094 ceph-mon[35259]: pgmap v595: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 803 op/s 2024-09-13T16:59:15.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:15 smithi018 ceph-mon[30981]: pgmap v595: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 803 op/s 2024-09-13T16:59:15.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:15 smithi144 ceph-mon[35328]: pgmap v595: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 803 op/s 2024-09-13T16:59:17.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:17 smithi094 ceph-mon[35259]: pgmap v596: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 834 op/s 2024-09-13T16:59:17.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:17 smithi018 ceph-mon[30981]: pgmap v596: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 834 op/s 2024-09-13T16:59:17.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:17 smithi144 ceph-mon[35328]: pgmap v596: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 834 op/s 2024-09-13T16:59:19.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:19 smithi094 ceph-mon[35259]: pgmap v597: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 783 op/s 2024-09-13T16:59:19.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:19 smithi018 ceph-mon[30981]: pgmap v597: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 783 op/s 2024-09-13T16:59:19.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.719+0000 7f7249000640 1 -- 172.21.15.18:0/910891082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244106680 msgr2=0x7f7244106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:19.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.719+0000 7f7249000640 1 --2- 172.21.15.18:0/910891082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244106680 0x7f7244106a80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f723401a870 tx=0x7f723403b370 comp rx=0 tx=0).stop 2024-09-13T16:59:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.719+0000 7f7249000640 1 -- 172.21.15.18:0/910891082 shutdown_connections 2024-09-13T16:59:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.719+0000 7f7249000640 1 --2- 172.21.15.18:0/910891082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7244107ed0 0x7f724410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.719+0000 7f7249000640 1 --2- 172.21.15.18:0/910891082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7244107530 0x7f7244107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.719+0000 7f7249000640 1 --2- 172.21.15.18:0/910891082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244106680 0x7f7244106a80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.719+0000 7f7249000640 1 -- 172.21.15.18:0/910891082 >> 172.21.15.18:0/910891082 conn(0x7f7244075730 msgr2=0x7f7244077b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.721+0000 7f7249000640 1 -- 172.21.15.18:0/910891082 shutdown_connections 2024-09-13T16:59:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.721+0000 7f7249000640 1 -- 172.21.15.18:0/910891082 wait complete. 2024-09-13T16:59:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.722+0000 7f7249000640 1 Processor -- start 2024-09-13T16:59:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.723+0000 7f7249000640 1 -- start start 2024-09-13T16:59:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.723+0000 7f7249000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7244106680 0x7f7244194200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.723+0000 7f7249000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7244107530 0x7f7244194740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.723+0000 7f7249000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244107ed0 0x7f724419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.723+0000 7f7249000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724419b5f0 con 0x7f7244107530 2024-09-13T16:59:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.723+0000 7f7249000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724419b760 con 0x7f7244106680 2024-09-13T16:59:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.723+0000 7f7249000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724419b920 con 0x7f7244107ed0 2024-09-13T16:59:19.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.724+0000 7f7241e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7244106680 0x7f7244194200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.724+0000 7f7241e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7244106680 0x7f7244194200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:53508/0 (socket says 172.21.15.18:53508) 2024-09-13T16:59:19.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.724+0000 7f7241e00640 1 -- 172.21.15.18:0/1453171087 learned_addr learned my addr 172.21.15.18:0/1453171087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:19.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.724+0000 7f7242800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244107ed0 0x7f724419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.725+0000 7f7241e00640 1 -- 172.21.15.18:0/1453171087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244107ed0 msgr2=0x7f724419b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:19.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.725+0000 7f7241e00640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244107ed0 0x7f724419b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.725+0000 7f7241e00640 1 -- 172.21.15.18:0/1453171087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7244107530 msgr2=0x7f7244194740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:59:19.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.725+0000 7f7241e00640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7244107530 0x7f7244194740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.725+0000 7f7241e00640 1 -- 172.21.15.18:0/1453171087 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230009560 con 0x7f7244106680 2024-09-13T16:59:19.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.726+0000 7f7241e00640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7244106680 0x7f7244194200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7234005e00 tx=0x7f7234041a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:19.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.727+0000 7f723aa00640 1 -- 172.21.15.18:0/1453171087 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234043650 con 0x7f7244106680 2024-09-13T16:59:19.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.727+0000 7f723aa00640 1 -- 172.21.15.18:0/1453171087 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7234004510 con 0x7f7244106680 2024-09-13T16:59:19.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.727+0000 7f723aa00640 1 -- 172.21.15.18:0/1453171087 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234004920 con 0x7f7244106680 2024-09-13T16:59:19.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.727+0000 7f7249000640 1 -- 172.21.15.18:0/1453171087 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723401a4a0 con 0x7f7244106680 2024-09-13T16:59:19.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.727+0000 7f7249000640 1 -- 172.21.15.18:0/1453171087 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724419be70 con 0x7f7244106680 2024-09-13T16:59:19.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.732+0000 7f724be8f740 1 Processor -- start 2024-09-13T16:59:19.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.733+0000 7f724be8f740 1 -- start start 2024-09-13T16:59:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.733+0000 7f724be8f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42ba7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.733+0000 7f724be8f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.733+0000 7f724be8f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42baf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.733+0000 7f724be8f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42ab3bb0 con 0x561d42ba83b0 2024-09-13T16:59:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.733+0000 7f724be8f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42b11a70 con 0x561d42ba7a70 2024-09-13T16:59:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.733+0000 7f724be8f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42b0f200 con 0x561d42bad440 2024-09-13T16:59:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.734+0000 7f7242800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42ba7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.734+0000 7f7241400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42baf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.734+0000 7f7242800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42ba7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:53510/0 (socket says 172.21.15.18:53510) 2024-09-13T16:59:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.734+0000 7f7242800640 1 -- 172.21.15.18:0/615362553 learned_addr learned my addr 172.21.15.18:0/615362553 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.734+0000 7f7241400640 1 -- 172.21.15.18:0/615362553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 msgr2=0x561d42ba7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.734+0000 7f7241400640 1 --2- 172.21.15.18:0/615362553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42ba7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.734+0000 7f7241400640 1 -- 172.21.15.18:0/615362553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 msgr2=0x561d42bace70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:59:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.734+0000 7f7241400640 1 --2- 172.21.15.18:0/615362553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bace70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.734+0000 7f7241400640 1 -- 172.21.15.18:0/615362553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d42aac940 con 0x561d42bad440 2024-09-13T16:59:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.735+0000 7f7241400640 1 --2- 172.21.15.18:0/615362553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42baf900 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f724410e8b0 tx=0x7f723000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fca5a3bfcac94ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.735+0000 7f722f400640 1 -- 172.21.15.18:0/615362553 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230009e70 con 0x561d42bad440 2024-09-13T16:59:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.735+0000 7f722f400640 1 -- 172.21.15.18:0/615362553 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72300044f0 con 0x561d42bad440 2024-09-13T16:59:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.735+0000 7f722f400640 1 -- 172.21.15.18:0/615362553 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230010690 con 0x561d42bad440 2024-09-13T16:59:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.736+0000 7f723aa00640 1 -- 172.21.15.18:0/1453171087 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f723404a070 con 0x7f7244106680 2024-09-13T16:59:19.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.736+0000 7f724be8f740 1 -- 172.21.15.18:0/615362553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 msgr2=0x561d42baf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:19.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.736+0000 7f724be8f740 1 --2- 172.21.15.18:0/615362553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42baf900 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f724410e8b0 tx=0x7f723000e720 comp rx=0 tx=0).stop 2024-09-13T16:59:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.738+0000 7f724be8f740 1 -- 172.21.15.18:0/615362553 shutdown_connections 2024-09-13T16:59:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.738+0000 7f724be8f740 1 --2- 172.21.15.18:0/615362553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.738+0000 7f724be8f740 1 --2- 172.21.15.18:0/615362553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42baf900 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.738+0000 7f724be8f740 1 --2- 172.21.15.18:0/615362553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42ba7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.738+0000 7f724be8f740 1 -- 172.21.15.18:0/615362553 >> 172.21.15.18:0/615362553 conn(0x561d42ba30e0 msgr2=0x561d42ba34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.739+0000 7f723aa00640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f72280a1110 0x7f72280a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.739+0000 7f723aa00640 1 -- 172.21.15.18:0/1453171087 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f72340fdd80 con 0x7f7244106680 2024-09-13T16:59:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.740+0000 7f724be8f740 1 -- 172.21.15.18:0/615362553 shutdown_connections 2024-09-13T16:59:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.740+0000 7f7241400640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f72280a1110 0x7f72280a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.740+0000 7f724be8f740 1 -- 172.21.15.18:0/615362553 wait complete. 2024-09-13T16:59:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.741+0000 7f724be8f740 1 -- start start 2024-09-13T16:59:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.741+0000 7f724be8f740 1 Processor -- start 2024-09-13T16:59:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.742+0000 7f724be8f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42ba7a70 0x561d42bb1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.742+0000 7f7241400640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f72280a1110 0x7f72280a35d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7230005a60 tx=0x7f7230005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.742+0000 7f724be8f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba83b0 0x561d42bb1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.742+0000 7f724be8f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42bad440 0x561d42bb8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.742+0000 7f7241e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42ba7a70 0x561d42bb1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.743+0000 7f7241e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42ba7a70 0x561d42bb1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:42684/0 (socket says 172.21.15.18:42684) 2024-09-13T16:59:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.743+0000 7f7241400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba83b0 0x561d42bb1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.743+0000 7f7241400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba83b0 0x561d42bb1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:53512/0 (socket says 172.21.15.18:53512) 2024-09-13T16:59:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.743+0000 7f724be8f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42b0aaf0 con 0x561d42bad440 2024-09-13T16:59:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.743+0000 7f724be8f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42ac8f20 con 0x561d42ba83b0 2024-09-13T16:59:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.743+0000 7f724be8f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42ac8bc0 con 0x561d42ba7a70 2024-09-13T16:59:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.743+0000 7f724be8f740 10 client.0 _ll_register_callbacks cb 0x561d42afaa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:59:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.743+0000 7f7241e00640 1 -- 172.21.15.18:0/2235610346 learned_addr learned my addr 172.21.15.18:0/2235610346 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.743+0000 7f7242800640 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42bad440 0x561d42bb8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.744+0000 7f7241400640 1 -- 172.21.15.18:0/2235610346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42ba7a70 msgr2=0x561d42bb1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:19.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.744+0000 7f7241400640 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42ba7a70 0x561d42bb1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.744+0000 7f7241400640 1 -- 172.21.15.18:0/2235610346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42bad440 msgr2=0x561d42bb8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:19.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.744+0000 7f7241400640 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42bad440 0x561d42bb8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.744+0000 7f7241400640 1 -- 172.21.15.18:0/2235610346 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7230009890 con 0x561d42ba83b0 2024-09-13T16:59:19.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.745+0000 7f7241400640 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba83b0 0x561d42bb1c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x561d42ba3f60 tx=0x7f723000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f661d572c8855b1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:19.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.745+0000 7f7223e00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:59:19.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.745+0000 7f7223e00640 1 -- 172.21.15.18:0/2235610346 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72300048c0 con 0x561d42ba83b0 2024-09-13T16:59:19.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.745+0000 7f7223e00640 1 -- 172.21.15.18:0/2235610346 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f723002b040 con 0x561d42ba83b0 2024-09-13T16:59:19.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.746+0000 7f724be8f740 1 -- 172.21.15.18:0/2235610346 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d42b34c90 con 0x561d42ba83b0 2024-09-13T16:59:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.747+0000 7f7223e00640 1 -- 172.21.15.18:0/2235610346 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7230004a20 con 0x561d42ba83b0 2024-09-13T16:59:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.747+0000 7f724be8f740 10 client.25775 fetch_fsmap learned FSMap version 35 2024-09-13T16:59:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.747+0000 7f724be8f740 1 -- 172.21.15.18:0/2235610346 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x561d42b09170 con 0x561d42ba83b0 2024-09-13T16:59:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.748+0000 7f7223e00640 1 -- 172.21.15.18:0/2235610346 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561d42b34c90 con 0x561d42ba83b0 2024-09-13T16:59:19.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.748+0000 7f7223e00640 1 -- 172.21.15.18:0/2235610346 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f7230037070 con 0x561d42ba83b0 2024-09-13T16:59:19.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.748+0000 7f724be8f740 10 client.25775 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T16:59:19.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.748+0000 7f724be8f740 10 client.25775 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:59:19.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.748+0000 7f724be8f740 20 client.25775 populate_metadata read hostname 'smithi018' 2024-09-13T16:59:19.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.748+0000 7f724be8f740 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561d42bbd330 0x561d42bbf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.748+0000 7f724be8f740 4 client.25775 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:59:19.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.748+0000 7f724be8f740 1 -- 172.21.15.18:0/2235610346 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d42afd7d0 con 0x561d42bbd330 2024-09-13T16:59:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.751+0000 7f7241e00640 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561d42bbd330 0x561d42bbf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.752+0000 7f7241e00640 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561d42bbd330 0x561d42bbf750 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee3fce6005108e45 server_cookie=b104b827959c34af in_seq=0 out_seq=0 2024-09-13T16:59:19.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.752+0000 7f7223e00640 10 client.25775 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.754+0000 7f7223e00640 1 -- 172.21.15.18:0/2235610346 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561d42afd7d0 con 0x561d42bbd330 2024-09-13T16:59:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.754+0000 7f7223e00640 10 client.25775 handle_command_reply: tid=0 2024-09-13T16:59:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.754+0000 7f724be8f740 1 client.25775 shutdown 2024-09-13T16:59:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.755+0000 7f724be8f740 1 -- 172.21.15.18:0/2235610346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba83b0 msgr2=0x561d42bb1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.755+0000 7f724be8f740 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba83b0 0x561d42bb1c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x561d42ba3f60 tx=0x7f723000e720 comp rx=0 tx=0).stop 2024-09-13T16:59:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.755+0000 7f724be8f740 1 -- 172.21.15.18:0/2235610346 shutdown_connections 2024-09-13T16:59:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.755+0000 7f724be8f740 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561d42bbd330 0x561d42bbf750 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.755+0000 7f724be8f740 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42bad440 0x561d42bb8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.755+0000 7f724be8f740 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba83b0 0x561d42bb1c60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.755+0000 7f724be8f740 1 --2- 172.21.15.18:0/2235610346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42ba7a70 0x561d42bb1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.755+0000 7f7223e00640 0 client.25775 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.755+0000 7f724be8f740 1 -- 172.21.15.18:0/2235610346 >> 172.21.15.18:0/2235610346 conn(0x561d42ba30e0 msgr2=0x561d42ba48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.756+0000 7f724be8f740 1 -- 172.21.15.18:0/2235610346 shutdown_connections 2024-09-13T16:59:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.758+0000 7f724be8f740 1 -- 172.21.15.18:0/2235610346 wait complete. 2024-09-13T16:59:19.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.760+0000 7f724be8f740 20 client.25775 trim_cache size 0 max 16384 2024-09-13T16:59:19.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:19 smithi144 ceph-mon[35328]: pgmap v597: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 783 op/s 2024-09-13T16:59:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.791+0000 7f724be8f740 1 Processor -- start 2024-09-13T16:59:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.791+0000 7f724be8f740 1 -- start start 2024-09-13T16:59:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.792+0000 7f724be8f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42bb14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.792+0000 7f724be8f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bb8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.792+0000 7f724be8f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42bb1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.792+0000 7f724be8f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42871e60 con 0x561d42ba83b0 2024-09-13T16:59:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.792+0000 7f724be8f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42bb2930 con 0x561d42ba7a70 2024-09-13T16:59:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.792+0000 7f724be8f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42bb9e70 con 0x561d42bad440 2024-09-13T16:59:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.793+0000 7f7241400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bb8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.793+0000 7f7241e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42bb14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.793+0000 7f7241400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bb8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57886/0 (socket says 172.21.15.18:57886) 2024-09-13T16:59:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.793+0000 7f7241400640 1 -- 172.21.15.18:0/2942443589 learned_addr learned my addr 172.21.15.18:0/2942443589 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.793+0000 7f7242800640 1 --2- 172.21.15.18:0/2942443589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42bb1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.793+0000 7f7242800640 1 -- 172.21.15.18:0/2942443589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 msgr2=0x561d42bb14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.793+0000 7f7242800640 1 --2- 172.21.15.18:0/2942443589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42bb14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.794+0000 7f7242800640 1 -- 172.21.15.18:0/2942443589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 msgr2=0x561d42bb8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.794+0000 7f7242800640 1 --2- 172.21.15.18:0/2942443589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bb8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.794+0000 7f7242800640 1 -- 172.21.15.18:0/2942443589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d42aab180 con 0x561d42bad440 2024-09-13T16:59:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.794+0000 7f7242800640 1 --2- 172.21.15.18:0/2942443589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42bb1a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f723c005f10 tx=0x7f723c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=141916ac25dae7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.795+0000 7f722fe00640 1 -- 172.21.15.18:0/2942443589 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c017070 con 0x561d42bad440 2024-09-13T16:59:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.795+0000 7f722fe00640 1 -- 172.21.15.18:0/2942443589 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f723c0109b0 con 0x561d42bad440 2024-09-13T16:59:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.795+0000 7f722fe00640 1 -- 172.21.15.18:0/2942443589 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c01ba40 con 0x561d42bad440 2024-09-13T16:59:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.796+0000 7f724be8f740 1 -- 172.21.15.18:0/2942443589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 msgr2=0x561d42bb1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.796+0000 7f724be8f740 1 --2- 172.21.15.18:0/2942443589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42bb1a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f723c005f10 tx=0x7f723c009f90 comp rx=0 tx=0).stop 2024-09-13T16:59:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.798+0000 7f724be8f740 1 -- 172.21.15.18:0/2942443589 shutdown_connections 2024-09-13T16:59:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.798+0000 7f724be8f740 1 --2- 172.21.15.18:0/2942443589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bb8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.798+0000 7f724be8f740 1 --2- 172.21.15.18:0/2942443589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42bb1a30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.798+0000 7f724be8f740 1 --2- 172.21.15.18:0/2942443589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42bb14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.798+0000 7f724be8f740 1 -- 172.21.15.18:0/2942443589 >> 172.21.15.18:0/2942443589 conn(0x561d42ba30e0 msgr2=0x561d42ba92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.799+0000 7f724be8f740 1 -- 172.21.15.18:0/2942443589 shutdown_connections 2024-09-13T16:59:19.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.800+0000 7f724be8f740 1 -- 172.21.15.18:0/2942443589 wait complete. 2024-09-13T16:59:19.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.800+0000 7f724be8f740 1 -- start start 2024-09-13T16:59:19.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.801+0000 7f724be8f740 1 Processor -- start 2024-09-13T16:59:19.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.802+0000 7f724be8f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42bb5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.802+0000 7f724be8f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bb6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.802+0000 7f724be8f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42c137e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.802+0000 7f724be8f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42c13d20 con 0x561d42ba83b0 2024-09-13T16:59:19.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.802+0000 7f724be8f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42c13e60 con 0x561d42ba7a70 2024-09-13T16:59:19.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.802+0000 7f724be8f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d42c13ff0 con 0x561d42bad440 2024-09-13T16:59:19.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.802+0000 7f724be8f740 10 client.0 _ll_register_callbacks cb 0x7f7230009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:59:19.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.802+0000 7f7241e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42bb5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.802+0000 7f7241e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42bb5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:53518/0 (socket says 172.21.15.18:53518) 2024-09-13T16:59:19.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.802+0000 7f7241e00640 1 -- 172.21.15.18:0/3690784634 learned_addr learned my addr 172.21.15.18:0/3690784634 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:19.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.803+0000 7f7241400640 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bb6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.803+0000 7f7242800640 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42c137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.803+0000 7f7241e00640 1 -- 172.21.15.18:0/3690784634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 msgr2=0x561d42c137e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.803+0000 7f7241e00640 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42c137e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.803+0000 7f7241e00640 1 -- 172.21.15.18:0/3690784634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 msgr2=0x561d42bb6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.803+0000 7f7241e00640 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bb6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.803+0000 7f7241e00640 1 -- 172.21.15.18:0/3690784634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723c009e00 con 0x561d42ba7a70 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.804+0000 7f7242800640 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42c137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.804+0000 7f7241400640 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bb6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.804+0000 7f7241e00640 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42bb5ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f72340c7350 tx=0x7f72340fb3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd19099d792b2f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.804+0000 7f7223e00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.804+0000 7f7223e00640 1 -- 172.21.15.18:0/3690784634 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72340d32d0 con 0x561d42ba7a70 2024-09-13T16:59:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.804+0000 7f7223e00640 1 -- 172.21.15.18:0/3690784634 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f72340c7560 con 0x561d42ba7a70 2024-09-13T16:59:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.805+0000 7f724be8f740 1 -- 172.21.15.18:0/3690784634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72300044f0 con 0x561d42ba7a70 2024-09-13T16:59:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.806+0000 7f7223e00640 1 -- 172.21.15.18:0/3690784634 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72340c7720 con 0x561d42ba7a70 2024-09-13T16:59:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.806+0000 7f724be8f740 10 client.25781 fetch_fsmap learned FSMap version 35 2024-09-13T16:59:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.806+0000 7f724be8f740 1 -- 172.21.15.18:0/3690784634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x561d42ad0560 con 0x561d42ba7a70 2024-09-13T16:59:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.806+0000 7f7223e00640 1 -- 172.21.15.18:0/3690784634 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72300044f0 con 0x561d42ba7a70 2024-09-13T16:59:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.806+0000 7f7223e00640 1 -- 172.21.15.18:0/3690784634 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f72340ded20 con 0x561d42ba7a70 2024-09-13T16:59:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.807+0000 7f724be8f740 10 client.25781 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T16:59:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.807+0000 7f724be8f740 10 client.25781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:59:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.807+0000 7f724be8f740 20 client.25781 populate_metadata read hostname 'smithi018' 2024-09-13T16:59:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.807+0000 7f724be8f740 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561d42c158f0 0x561d42c17d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.807+0000 7f724be8f740 4 client.25781 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:59:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.807+0000 7f724be8f740 1 -- 172.21.15.18:0/3690784634 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561d427fe300 con 0x561d42c158f0 2024-09-13T16:59:19.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.807+0000 7f7241400640 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561d42c158f0 0x561d42c17d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.808+0000 7f7241400640 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561d42c158f0 0x561d42c17d10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee9bb6c0a78b1c08 server_cookie=b0af620051db5812 in_seq=0 out_seq=0 2024-09-13T16:59:19.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:19.808+0000 7f7223e00640 10 client.25781 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:21.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:21 smithi094 ceph-mon[35259]: pgmap v598: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 862 op/s 2024-09-13T16:59:21.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:21 smithi018 ceph-mon[30981]: pgmap v598: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 862 op/s 2024-09-13T16:59:21.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:21 smithi144 ceph-mon[35328]: pgmap v598: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 862 op/s 2024-09-13T16:59:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.356+0000 7f7223e00640 1 -- 172.21.15.18:0/3690784634 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561d427fe300 con 0x561d42c158f0 2024-09-13T16:59:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.356+0000 7f7223e00640 10 client.25781 handle_command_reply: tid=0 2024-09-13T16:59:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.356+0000 7f724be8f740 1 client.25781 shutdown 2024-09-13T16:59:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.356+0000 7f724be8f740 1 -- 172.21.15.18:0/3690784634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 msgr2=0x561d42bb5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.356+0000 7f724be8f740 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42bb5ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f72340c7350 tx=0x7f72340fb3d0 comp rx=0 tx=0).stop 2024-09-13T16:59:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.357+0000 7f724be8f740 1 -- 172.21.15.18:0/3690784634 shutdown_connections 2024-09-13T16:59:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.357+0000 7f724be8f740 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x561d42c158f0 0x561d42c17d10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.357+0000 7f724be8f740 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d42ba83b0 0x561d42bb6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.357+0000 7f724be8f740 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d42bad440 0x561d42c137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.357+0000 7f724be8f740 1 --2- 172.21.15.18:0/3690784634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561d42ba7a70 0x561d42bb5ce0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.357+0000 7f724be8f740 1 -- 172.21.15.18:0/3690784634 >> 172.21.15.18:0/3690784634 conn(0x561d42ba30e0 msgr2=0x561d42bb14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.357+0000 7f7223e00640 0 client.25781 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.357+0000 7f724be8f740 1 -- 172.21.15.18:0/3690784634 shutdown_connections 2024-09-13T16:59:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.358+0000 7f724be8f740 1 -- 172.21.15.18:0/3690784634 wait complete. 2024-09-13T16:59:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.358+0000 7f724be8f740 20 client.25781 trim_cache size 0 max 16384 2024-09-13T16:59:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:59:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:59:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:59:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:59:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.359+0000 7f7249000640 1 -- 172.21.15.18:0/1453171087 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f72280a1110 msgr2=0x7f72280a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.359+0000 7f7249000640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f72280a1110 0x7f72280a35d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7230005a60 tx=0x7f7230005fd0 comp rx=0 tx=0).stop 2024-09-13T16:59:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.359+0000 7f7249000640 1 -- 172.21.15.18:0/1453171087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7244106680 msgr2=0x7f7244194200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.359+0000 7f7249000640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7244106680 0x7f7244194200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7234005e00 tx=0x7f7234041a10 comp rx=0 tx=0).stop 2024-09-13T16:59:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.359+0000 7f7249000640 1 -- 172.21.15.18:0/1453171087 shutdown_connections 2024-09-13T16:59:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.359+0000 7f7249000640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f72280a1110 0x7f72280a35d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.359+0000 7f7249000640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7244107530 0x7f7244194740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.359+0000 7f7249000640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244107ed0 0x7f724419b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.359+0000 7f7249000640 1 --2- 172.21.15.18:0/1453171087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7244106680 0x7f7244194200 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.359+0000 7f7249000640 1 -- 172.21.15.18:0/1453171087 >> 172.21.15.18:0/1453171087 conn(0x7f7244075730 msgr2=0x7f724406f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.360+0000 7f7249000640 1 -- 172.21.15.18:0/1453171087 shutdown_connections 2024-09-13T16:59:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:22.360+0000 7f7249000640 1 -- 172.21.15.18:0/1453171087 wait complete. 2024-09-13T16:59:23.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:23 smithi094 ceph-mon[35259]: pgmap v599: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 821 op/s 2024-09-13T16:59:23.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:23 smithi018 ceph-mon[30981]: pgmap v599: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 821 op/s 2024-09-13T16:59:23.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:23 smithi144 ceph-mon[35328]: pgmap v599: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 821 op/s 2024-09-13T16:59:25.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:25 smithi018 ceph-mon[30981]: pgmap v600: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 697 op/s 2024-09-13T16:59:25.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:25 smithi094 ceph-mon[35259]: pgmap v600: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 697 op/s 2024-09-13T16:59:25.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:25 smithi144 ceph-mon[35328]: pgmap v600: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 697 op/s 2024-09-13T16:59:27.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:27 smithi094 ceph-mon[35259]: pgmap v601: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 754 op/s 2024-09-13T16:59:27.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:27 smithi018 ceph-mon[30981]: pgmap v601: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 754 op/s 2024-09-13T16:59:27.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:27 smithi144 ceph-mon[35328]: pgmap v601: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 754 op/s 2024-09-13T16:59:29.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:29 smithi094 ceph-mon[35259]: pgmap v602: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 619 op/s 2024-09-13T16:59:29.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:29 smithi018 ceph-mon[30981]: pgmap v602: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 619 op/s 2024-09-13T16:59:29.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:29 smithi144 ceph-mon[35328]: pgmap v602: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 619 op/s 2024-09-13T16:59:31.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:31 smithi094 ceph-mon[35259]: pgmap v603: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 594 op/s 2024-09-13T16:59:31.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:31 smithi018 ceph-mon[30981]: pgmap v603: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 594 op/s 2024-09-13T16:59:31.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:31 smithi144 ceph-mon[35328]: pgmap v603: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 594 op/s 2024-09-13T16:59:33.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:33 smithi094 ceph-mon[35259]: pgmap v604: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 529 op/s 2024-09-13T16:59:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:33 smithi018 ceph-mon[30981]: pgmap v604: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 529 op/s 2024-09-13T16:59:33.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:33 smithi144 ceph-mon[35328]: pgmap v604: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 529 op/s 2024-09-13T16:59:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.482+0000 7f0bc3400640 1 -- 172.21.15.18:0/462249864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bbc100ed0 msgr2=0x7f0bbc103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.482+0000 7f0bc3400640 1 --2- 172.21.15.18:0/462249864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bbc100ed0 0x7f0bbc103340 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009900 tx=0x7f0ba802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.482+0000 7f0bc3400640 1 -- 172.21.15.18:0/462249864 shutdown_connections 2024-09-13T16:59:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.482+0000 7f0bc3400640 1 --2- 172.21.15.18:0/462249864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bbc100ed0 0x7f0bbc103340 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.482+0000 7f0bc3400640 1 --2- 172.21.15.18:0/462249864 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bbc103880 0x7f0bbc103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.482+0000 7f0bc3400640 1 --2- 172.21.15.18:0/462249864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bbc0fe580 0x7f0bbc100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.482+0000 7f0bc3400640 1 -- 172.21.15.18:0/462249864 >> 172.21.15.18:0/462249864 conn(0x7f0bbc0fa370 msgr2=0x7f0bbc0fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.482+0000 7f0bc3400640 1 -- 172.21.15.18:0/462249864 shutdown_connections 2024-09-13T16:59:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.482+0000 7f0bc3400640 1 -- 172.21.15.18:0/462249864 wait complete. 2024-09-13T16:59:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.483+0000 7f0bc3400640 1 Processor -- start 2024-09-13T16:59:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.483+0000 7f0bc3400640 1 -- start start 2024-09-13T16:59:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.483+0000 7f0bc3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bbc0fe580 0x7f0bbc19c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc3400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bbc100ed0 0x7f0bbc19c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bbc103880 0x7f0bbc1a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc3400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc1a3e30 con 0x7f0bbc0fe580 2024-09-13T16:59:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc3400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc1a3fa0 con 0x7f0bbc100ed0 2024-09-13T16:59:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc3400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc1a4160 con 0x7f0bbc103880 2024-09-13T16:59:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bbc0fe580 0x7f0bbc19c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bbc0fe580 0x7f0bbc19c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33798/0 (socket says 172.21.15.18:33798) 2024-09-13T16:59:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc0a00640 1 -- 172.21.15.18:0/1335482280 learned_addr learned my addr 172.21.15.18:0/1335482280 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bbc100ed0 0x7f0bbc19c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc1400640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bbc103880 0x7f0bbc1a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc0a00640 1 -- 172.21.15.18:0/1335482280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bbc103880 msgr2=0x7f0bbc1a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc0a00640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bbc103880 0x7f0bbc1a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc0a00640 1 -- 172.21.15.18:0/1335482280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bbc100ed0 msgr2=0x7f0bbc19c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc0a00640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bbc100ed0 0x7f0bbc19c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bc0a00640 1 -- 172.21.15.18:0/1335482280 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb4009840 con 0x7f0bbc0fe580 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.484+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bbc100ed0 0x7f0bbc19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.485+0000 7f0bc0a00640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bbc0fe580 0x7f0bbc19c340 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000d950 tx=0x7f0bb000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.485+0000 7f0bb9600640 1 -- 172.21.15.18:0/1335482280 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0009c30 con 0x7f0bbc0fe580 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.485+0000 7f0bb9600640 1 -- 172.21.15.18:0/1335482280 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bb000de80 con 0x7f0bbc0fe580 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.485+0000 7f0bc3400640 1 -- 172.21.15.18:0/1335482280 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba8009560 con 0x7f0bbc0fe580 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.485+0000 7f0bc3400640 1 -- 172.21.15.18:0/1335482280 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc1a4790 con 0x7f0bbc0fe580 2024-09-13T16:59:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.485+0000 7f0bb9600640 1 -- 172.21.15.18:0/1335482280 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb000f6b0 con 0x7f0bbc0fe580 2024-09-13T16:59:35.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.488+0000 7f0bc6212740 1 Processor -- start 2024-09-13T16:59:35.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc6212740 1 -- start start 2024-09-13T16:59:35.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fabee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 0x557a9fac3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fac4440 0x557a9fac6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc6212740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9f9cabb0 con 0x557a9fabea70 2024-09-13T16:59:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc6212740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9fa28a70 con 0x557a9fabf3b0 2024-09-13T16:59:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc6212740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9fa26200 con 0x557a9fac4440 2024-09-13T16:59:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bb9600640 1 -- 172.21.15.18:0/1335482280 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0bb00109b0 con 0x7f0bbc0fe580 2024-09-13T16:59:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fabee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bbbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fac4440 0x557a9fac6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 0x557a9fac3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fabee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33812/0 (socket says 172.21.15.18:33812) 2024-09-13T16:59:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.489+0000 7f0bc1400640 1 -- 172.21.15.18:0/597364481 learned_addr learned my addr 172.21.15.18:0/597364481 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.490+0000 7f0bc1400640 1 -- 172.21.15.18:0/597364481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fac4440 msgr2=0x557a9fac6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.490+0000 7f0bc1400640 1 --2- 172.21.15.18:0/597364481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fac4440 0x557a9fac6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.490+0000 7f0bc1400640 1 -- 172.21.15.18:0/597364481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 msgr2=0x557a9fac3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.490+0000 7f0bc1400640 1 --2- 172.21.15.18:0/597364481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 0x557a9fac3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.490+0000 7f0bc1400640 1 -- 172.21.15.18:0/597364481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a9f9c3940 con 0x557a9fabea70 2024-09-13T16:59:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.490+0000 7f0bc1400640 1 --2- 172.21.15.18:0/597364481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fabee70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40115b0 tx=0x7f0bb4011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89d447d378583df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.490+0000 7f0bae000640 1 -- 172.21.15.18:0/597364481 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4004d20 con 0x557a9fabea70 2024-09-13T16:59:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.491+0000 7f0bae000640 1 -- 172.21.15.18:0/597364481 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bb4004e80 con 0x557a9fabea70 2024-09-13T16:59:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.491+0000 7f0bae000640 1 -- 172.21.15.18:0/597364481 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb400f8c0 con 0x557a9fabea70 2024-09-13T16:59:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.491+0000 7f0bc6212740 1 -- 172.21.15.18:0/597364481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 msgr2=0x557a9fabee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.491+0000 7f0bc6212740 1 --2- 172.21.15.18:0/597364481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fabee70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40115b0 tx=0x7f0bb4011a70 comp rx=0 tx=0).stop 2024-09-13T16:59:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.491+0000 7f0bc6212740 1 -- 172.21.15.18:0/597364481 shutdown_connections 2024-09-13T16:59:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.491+0000 7f0bc6212740 1 --2- 172.21.15.18:0/597364481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fac4440 0x557a9fac6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.491+0000 7f0bc6212740 1 --2- 172.21.15.18:0/597364481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 0x557a9fac3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.491+0000 7f0bc6212740 1 --2- 172.21.15.18:0/597364481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fabee70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.491+0000 7f0bc6212740 1 -- 172.21.15.18:0/597364481 >> 172.21.15.18:0/597364481 conn(0x557a9faba0e0 msgr2=0x557a9faba4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.491+0000 7f0bb9600640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0ba40a1110 0x7f0ba40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.492+0000 7f0bc6212740 1 -- 172.21.15.18:0/597364481 shutdown_connections 2024-09-13T16:59:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.492+0000 7f0bc6212740 1 -- 172.21.15.18:0/597364481 wait complete. 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.492+0000 7f0bb9600640 1 -- 172.21.15.18:0/1335482280 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0bb00cc820 con 0x7f0bbc0fe580 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.492+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0ba40a1110 0x7f0ba40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.492+0000 7f0bc6212740 1 -- start start 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.492+0000 7f0bc6212740 1 Processor -- start 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0ba40a1110 0x7f0ba40a35d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8005ab0 tx=0x7f0ba8005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fac8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabf3b0 0x557a9fac8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fac4440 0x557a9facfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc6212740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9fa21af0 con 0x557a9fabea70 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc6212740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9f9dff20 con 0x557a9fac4440 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc6212740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9f9dfbc0 con 0x557a9fabf3b0 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc6212740 10 client.0 _ll_register_callbacks cb 0x557a9fa11a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:59:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fac8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fac8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33816/0 (socket says 172.21.15.18:33816) 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc0a00640 1 -- 172.21.15.18:0/764176038 learned_addr learned my addr 172.21.15.18:0/764176038 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabf3b0 0x557a9fac8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.493+0000 7f0bc1400640 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fac4440 0x557a9facfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.494+0000 7f0bc0a00640 1 -- 172.21.15.18:0/764176038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabf3b0 msgr2=0x557a9fac8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.494+0000 7f0bc0a00640 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabf3b0 0x557a9fac8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.494+0000 7f0bc0a00640 1 -- 172.21.15.18:0/764176038 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fac4440 msgr2=0x557a9facfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.494+0000 7f0bc0a00640 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fac4440 0x557a9facfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.494+0000 7f0bc0a00640 1 -- 172.21.15.18:0/764176038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb4009e20 con 0x557a9fabea70 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.494+0000 7f0bc0a00640 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fac8740 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0095db0 tx=0x7f0bb0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a88ac1a5b951518 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.494+0000 7f0ba2a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.494+0000 7f0ba2a00640 1 -- 172.21.15.18:0/764176038 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00b7ea0 con 0x557a9fabea70 2024-09-13T16:59:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.494+0000 7f0bc6212740 1 -- 172.21.15.18:0/764176038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a9fa147d0 con 0x557a9fabea70 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.494+0000 7f0ba2a00640 1 -- 172.21.15.18:0/764176038 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0bb0009d90 con 0x557a9fabea70 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0ba2a00640 1 -- 172.21.15.18:0/764176038 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bb0014020 con 0x557a9fabea70 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0bc6212740 10 client.15714 fetch_fsmap learned FSMap version 35 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0bc6212740 1 -- 172.21.15.18:0/764176038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x557a9fa20170 con 0x557a9fabea70 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0ba2a00640 1 -- 172.21.15.18:0/764176038 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bb00b1080 con 0x557a9fabea70 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0ba2a00640 1 -- 172.21.15.18:0/764176038 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0bb00a18a0 con 0x557a9fabea70 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0bc6212740 10 client.15714 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0bc6212740 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0bc6212740 20 client.15714 populate_metadata read hostname 'smithi018' 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0bc6212740 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557a9fad4430 0x557a9fad6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0bc6212740 4 client.15714 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.495+0000 7f0bc6212740 1 -- 172.21.15.18:0/764176038 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a9f715300 con 0x557a9fad4430 2024-09-13T16:59:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.496+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557a9fad4430 0x557a9fad6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.496+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557a9fad4430 0x557a9fad6850 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9306a771e79e1f4f server_cookie=a13daea52c359d47 in_seq=0 out_seq=0 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.496+0000 7f0ba2a00640 10 client.15714 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0ba2a00640 1 -- 172.21.15.18:0/764176038 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557a9f715300 con 0x557a9fad4430 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0ba2a00640 10 client.15714 handle_command_reply: tid=0 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 client.15714 shutdown 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 -- 172.21.15.18:0/764176038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 msgr2=0x557a9fac8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fac8740 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0095db0 tx=0x7f0bb0009f90 comp rx=0 tx=0).stop 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 -- 172.21.15.18:0/764176038 shutdown_connections 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557a9fad4430 0x557a9fad6850 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fac4440 0x557a9facfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabf3b0 0x557a9fac8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 --2- 172.21.15.18:0/764176038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fabea70 0x557a9fac8740 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 -- 172.21.15.18:0/764176038 >> 172.21.15.18:0/764176038 conn(0x557a9faba0e0 msgr2=0x557a9fabb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0ba2a00640 0 client.15714 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 -- 172.21.15.18:0/764176038 shutdown_connections 2024-09-13T16:59:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.497+0000 7f0bc6212740 1 -- 172.21.15.18:0/764176038 wait complete. 2024-09-13T16:59:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.498+0000 7f0bc6212740 20 client.15714 trim_cache size 0 max 16384 2024-09-13T16:59:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.511+0000 7f0bc6212740 1 Processor -- start 2024-09-13T16:59:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.511+0000 7f0bc6212740 1 -- start start 2024-09-13T16:59:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.511+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabea70 0x557a9fab5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.511+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 0x557a9facfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.511+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 0x557a9fac84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.511+0000 7f0bc6212740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9f788e60 con 0x557a9fac4440 2024-09-13T16:59:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.511+0000 7f0bc6212740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9fac9870 con 0x557a9fabf3b0 2024-09-13T16:59:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.511+0000 7f0bc6212740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9fabf890 con 0x557a9fabea70 2024-09-13T16:59:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.511+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabea70 0x557a9fab5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.511+0000 7f0bbbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 0x557a9facfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bbbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 0x557a9facfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:59008/0 (socket says 172.21.15.18:59008) 2024-09-13T16:59:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bc1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 0x557a9fac84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bbbe00640 1 -- 172.21.15.18:0/1301946449 learned_addr learned my addr 172.21.15.18:0/1301946449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bc0a00640 1 --2- 172.21.15.18:0/1301946449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabea70 0x557a9fab5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:47728/0 (socket says 172.21.15.18:47728) 2024-09-13T16:59:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bbbe00640 1 -- 172.21.15.18:0/1301946449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabea70 msgr2=0x557a9fab5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/1301946449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabea70 0x557a9fab5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bbbe00640 1 -- 172.21.15.18:0/1301946449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 msgr2=0x557a9fac84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/1301946449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 0x557a9fac84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bbbe00640 1 -- 172.21.15.18:0/1301946449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a9f9c2180 con 0x557a9fabf3b0 2024-09-13T16:59:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bc1400640 1 --2- 172.21.15.18:0/1301946449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 0x557a9fac84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:59:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/1301946449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 0x557a9facfc80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8000c00 tx=0x7f0ba8041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56855f9f4280f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.512+0000 7f0baea00640 1 -- 172.21.15.18:0/1301946449 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba804f040 con 0x557a9fabf3b0 2024-09-13T16:59:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0baea00640 1 -- 172.21.15.18:0/1301946449 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ba80553b0 con 0x557a9fabf3b0 2024-09-13T16:59:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0baea00640 1 -- 172.21.15.18:0/1301946449 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8041070 con 0x557a9fabf3b0 2024-09-13T16:59:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0bc6212740 1 -- 172.21.15.18:0/1301946449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 msgr2=0x557a9facfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0bc6212740 1 --2- 172.21.15.18:0/1301946449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 0x557a9facfc80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8000c00 tx=0x7f0ba8041000 comp rx=0 tx=0).stop 2024-09-13T16:59:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0bc6212740 1 -- 172.21.15.18:0/1301946449 shutdown_connections 2024-09-13T16:59:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0bc6212740 1 --2- 172.21.15.18:0/1301946449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 0x557a9fac84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0bc6212740 1 --2- 172.21.15.18:0/1301946449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabf3b0 0x557a9facfc80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0bc6212740 1 --2- 172.21.15.18:0/1301946449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabea70 0x557a9fab5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0bc6212740 1 -- 172.21.15.18:0/1301946449 >> 172.21.15.18:0/1301946449 conn(0x557a9faba0e0 msgr2=0x557a9fac0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0bc6212740 1 -- 172.21.15.18:0/1301946449 shutdown_connections 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.513+0000 7f0bc6212740 1 -- 172.21.15.18:0/1301946449 wait complete. 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.514+0000 7f0bc6212740 1 -- start start 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.514+0000 7f0bc6212740 1 Processor -- start 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.514+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabea70 0x557a9facfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.514+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabf3b0 0x557a9facc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.514+0000 7f0bc6212740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 0x557a9facca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.514+0000 7f0bc6212740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9faccfb0 con 0x557a9fac4440 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.514+0000 7f0bc6212740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9facd120 con 0x557a9fabea70 2024-09-13T16:59:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.514+0000 7f0bc6212740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9fb2a950 con 0x557a9fabf3b0 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc6212740 10 client.0 _ll_register_callbacks cb 0x7f0bb4009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabea70 0x557a9facfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 0x557a9facca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabea70 0x557a9facfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:59010/0 (socket says 172.21.15.18:59010) 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc0a00640 1 -- 172.21.15.18:0/1119421327 learned_addr learned my addr 172.21.15.18:0/1119421327 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabf3b0 0x557a9facc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc0a00640 1 -- 172.21.15.18:0/1119421327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabf3b0 msgr2=0x557a9facc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc0a00640 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabf3b0 0x557a9facc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc0a00640 1 -- 172.21.15.18:0/1119421327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 msgr2=0x557a9facca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc0a00640 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 0x557a9facca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc0a00640 1 -- 172.21.15.18:0/1119421327 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc104820 con 0x557a9fabea70 2024-09-13T16:59:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0bc0a00640 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabea70 0x557a9facfa40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0097c00 tx=0x7f0bb00961d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da21fee973489c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.515+0000 7f0ba2a00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0ba2a00640 1 -- 172.21.15.18:0/1119421327 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0014030 con 0x557a9fabea70 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0ba2a00640 1 -- 172.21.15.18:0/1119421327 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0bb0015070 con 0x557a9fabea70 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0bc6212740 1 -- 172.21.15.18:0/1119421327 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a9fa4bc90 con 0x557a9fabea70 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0ba2a00640 1 -- 172.21.15.18:0/1119421327 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bb00b7ea0 con 0x557a9fabea70 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0bc6212740 10 client.25799 fetch_fsmap learned FSMap version 35 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0bc6212740 1 -- 172.21.15.18:0/1119421327 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x557a9f9e7560 con 0x557a9fabea70 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0ba2a00640 1 -- 172.21.15.18:0/1119421327 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557a9fa4bc90 con 0x557a9fabea70 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0ba2a00640 1 -- 172.21.15.18:0/1119421327 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0bb0010460 con 0x557a9fabea70 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0bc6212740 10 client.25799 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0bc6212740 10 client.25799 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0bc6212740 20 client.25799 populate_metadata read hostname 'smithi018' 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0bc6212740 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557a9fb2c040 0x557a9fb2e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0bc6212740 4 client.25799 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:59:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.516+0000 7f0bc6212740 1 -- 172.21.15.18:0/1119421327 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557a9f726600 con 0x557a9fb2c040 2024-09-13T16:59:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.517+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557a9fb2c040 0x557a9fb2e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.517+0000 7f0bbbe00640 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557a9fb2c040 0x557a9fb2e460 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dc899a1829bd673 server_cookie=d3473c2606623e31 in_seq=0 out_seq=0 2024-09-13T16:59:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:35.517+0000 7f0ba2a00640 10 client.25799 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:35.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:35 smithi094 ceph-mon[35259]: pgmap v605: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 399 op/s 2024-09-13T16:59:35.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:35 smithi018 ceph-mon[30981]: pgmap v605: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 399 op/s 2024-09-13T16:59:35.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:35 smithi144 ceph-mon[35328]: pgmap v605: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 399 op/s 2024-09-13T16:59:37.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:37 smithi094 ceph-mon[35259]: pgmap v606: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 402 op/s 2024-09-13T16:59:37.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:37 smithi018 ceph-mon[30981]: pgmap v606: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 402 op/s 2024-09-13T16:59:37.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:37 smithi144 ceph-mon[35328]: pgmap v606: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 402 op/s 2024-09-13T16:59:39.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:39 smithi094 ceph-mon[35259]: pgmap v607: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 542 op/s 2024-09-13T16:59:39.669 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:39 smithi018 ceph-mon[30981]: pgmap v607: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 542 op/s 2024-09-13T16:59:39.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:39 smithi144 ceph-mon[35328]: pgmap v607: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 542 op/s 2024-09-13T16:59:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.823+0000 7f0ba2a00640 1 -- 172.21.15.18:0/1119421327 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557a9f726600 con 0x557a9fb2c040 2024-09-13T16:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.823+0000 7f0ba2a00640 10 client.25799 handle_command_reply: tid=0 2024-09-13T16:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.823+0000 7f0bc6212740 1 client.25799 shutdown 2024-09-13T16:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.824+0000 7f0bc6212740 1 -- 172.21.15.18:0/1119421327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabea70 msgr2=0x557a9facfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.824+0000 7f0bc6212740 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabea70 0x557a9facfa40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0097c00 tx=0x7f0bb00961d0 comp rx=0 tx=0).stop 2024-09-13T16:59:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.824+0000 7f0bc6212740 1 -- 172.21.15.18:0/1119421327 shutdown_connections 2024-09-13T16:59:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.824+0000 7f0bc6212740 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x557a9fb2c040 0x557a9fb2e460 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.824+0000 7f0bc6212740 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a9fac4440 0x557a9facca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.824+0000 7f0bc6212740 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a9fabf3b0 0x557a9facc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.824+0000 7f0bc6212740 1 --2- 172.21.15.18:0/1119421327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557a9fabea70 0x557a9facfa40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.824+0000 7f0bc6212740 1 -- 172.21.15.18:0/1119421327 >> 172.21.15.18:0/1119421327 conn(0x557a9faba0e0 msgr2=0x557a9fac84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.824+0000 7f0ba2a00640 0 client.25799 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.825+0000 7f0bc6212740 1 -- 172.21.15.18:0/1119421327 shutdown_connections 2024-09-13T16:59:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.825+0000 7f0bc6212740 1 -- 172.21.15.18:0/1119421327 wait complete. 2024-09-13T16:59:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.826+0000 7f0bc6212740 20 client.25799 trim_cache size 0 max 16384 2024-09-13T16:59:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:59:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:59:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:59:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:59:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 -- 172.21.15.18:0/1335482280 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0ba40a1110 msgr2=0x7f0ba40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0ba40a1110 0x7f0ba40a35d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8005ab0 tx=0x7f0ba8005780 comp rx=0 tx=0).stop 2024-09-13T16:59:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 -- 172.21.15.18:0/1335482280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bbc0fe580 msgr2=0x7f0bbc19c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bbc0fe580 0x7f0bbc19c340 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000d950 tx=0x7f0bb000dd50 comp rx=0 tx=0).stop 2024-09-13T16:59:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 -- 172.21.15.18:0/1335482280 shutdown_connections 2024-09-13T16:59:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bbc103880 0x7f0bbc1a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0bbc100ed0 0x7f0bbc19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0ba40a1110 0x7f0ba40a35d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 --2- 172.21.15.18:0/1335482280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bbc0fe580 0x7f0bbc19c340 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 -- 172.21.15.18:0/1335482280 >> 172.21.15.18:0/1335482280 conn(0x7f0bbc0fa370 msgr2=0x7f0bbc0fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 -- 172.21.15.18:0/1335482280 shutdown_connections 2024-09-13T16:59:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:39.827+0000 7f0bc3400640 1 -- 172.21.15.18:0/1335482280 wait complete. 2024-09-13T16:59:41.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:41 smithi094 ceph-mon[35259]: pgmap v608: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 1.17k op/s 2024-09-13T16:59:41.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:41 smithi018 ceph-mon[30981]: pgmap v608: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 1.17k op/s 2024-09-13T16:59:41.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:41 smithi144 ceph-mon[35328]: pgmap v608: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 1.17k op/s 2024-09-13T16:59:43.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:43 smithi094 ceph-mon[35259]: pgmap v609: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 1.45k op/s 2024-09-13T16:59:43.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:43 smithi018 ceph-mon[30981]: pgmap v609: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 1.45k op/s 2024-09-13T16:59:43.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:43 smithi144 ceph-mon[35328]: pgmap v609: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 1.45k op/s 2024-09-13T16:59:45.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:45 smithi094 ceph-mon[35259]: pgmap v610: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 1.49k op/s 2024-09-13T16:59:45.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:45 smithi018 ceph-mon[30981]: pgmap v610: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 1.49k op/s 2024-09-13T16:59:45.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:45 smithi144 ceph-mon[35328]: pgmap v610: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 1.49k op/s 2024-09-13T16:59:47.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:47 smithi094 ceph-mon[35259]: pgmap v611: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.0 MiB/s wr, 1.53k op/s 2024-09-13T16:59:47.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:47 smithi018 ceph-mon[30981]: pgmap v611: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.0 MiB/s wr, 1.53k op/s 2024-09-13T16:59:47.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:47 smithi144 ceph-mon[35328]: pgmap v611: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.0 MiB/s wr, 1.53k op/s 2024-09-13T16:59:49.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:49 smithi094 ceph-mon[35259]: pgmap v612: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.54k op/s 2024-09-13T16:59:49.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:49 smithi018 ceph-mon[30981]: pgmap v612: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.54k op/s 2024-09-13T16:59:49.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:49 smithi144 ceph-mon[35328]: pgmap v612: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.54k op/s 2024-09-13T16:59:51.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:51 smithi094 ceph-mon[35259]: pgmap v613: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 1.33k op/s 2024-09-13T16:59:51.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:51 smithi018 ceph-mon[30981]: pgmap v613: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 1.33k op/s 2024-09-13T16:59:51.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:51 smithi144 ceph-mon[35328]: pgmap v613: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 1.33k op/s 2024-09-13T16:59:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.962+0000 7ff6b7200640 1 -- 172.21.15.18:0/888351668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6b8103920 msgr2=0x7ff6b810a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.962+0000 7ff6b7200640 1 --2- 172.21.15.18:0/888351668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6b8103920 0x7ff6b810a1b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009be0 tx=0x7ff6b002a6c0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.963+0000 7ff6b7200640 1 -- 172.21.15.18:0/888351668 shutdown_connections 2024-09-13T16:59:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.963+0000 7ff6b7200640 1 --2- 172.21.15.18:0/888351668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6b8102f60 0x7ff6b81033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.963+0000 7ff6b7200640 1 --2- 172.21.15.18:0/888351668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6b8103920 0x7ff6b810a1b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.963+0000 7ff6b7200640 1 --2- 172.21.15.18:0/888351668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b8101d70 0x7ff6b8102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.963+0000 7ff6b7200640 1 -- 172.21.15.18:0/888351668 >> 172.21.15.18:0/888351668 conn(0x7ff6b80fd4d0 msgr2=0x7ff6b80ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.963+0000 7ff6b7200640 1 -- 172.21.15.18:0/888351668 shutdown_connections 2024-09-13T16:59:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.963+0000 7ff6b7200640 1 -- 172.21.15.18:0/888351668 wait complete. 2024-09-13T16:59:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.964+0000 7ff6b7200640 1 Processor -- start 2024-09-13T16:59:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.964+0000 7ff6b7200640 1 -- start start 2024-09-13T16:59:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.964+0000 7ff6b7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6b8101d70 0x7ff6b8197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.964+0000 7ff6b7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b8102f60 0x7ff6b8198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.964+0000 7ff6b7200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6b8103920 0x7ff6b819f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.964+0000 7ff6b7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b819f800 con 0x7ff6b8101d70 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.964+0000 7ff6b7200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b819f970 con 0x7ff6b8103920 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.964+0000 7ff6b7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b819fb30 con 0x7ff6b8102f60 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.964+0000 7ff6b5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6b8101d70 0x7ff6b8197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.965+0000 7ff6b5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6b8101d70 0x7ff6b8197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57250/0 (socket says 172.21.15.18:57250) 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.965+0000 7ff6b5e00640 1 -- 172.21.15.18:0/2470492942 learned_addr learned my addr 172.21.15.18:0/2470492942 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.965+0000 7ff6b5400640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b8102f60 0x7ff6b8198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.965+0000 7ff6b6800640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6b8103920 0x7ff6b819f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.965+0000 7ff6b5e00640 1 -- 172.21.15.18:0/2470492942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b8102f60 msgr2=0x7ff6b8198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.965+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b8102f60 0x7ff6b8198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.965+0000 7ff6b5e00640 1 -- 172.21.15.18:0/2470492942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6b8103920 msgr2=0x7ff6b819f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.965+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6b8103920 0x7ff6b819f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.965+0000 7ff6b5e00640 1 -- 172.21.15.18:0/2470492942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009560 con 0x7ff6b8101d70 2024-09-13T16:59:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.965+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6b8101d70 0x7ff6b8197d20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800e9c0 tx=0x7ff6a800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.966+0000 7ff6aea00640 1 -- 172.21.15.18:0/2470492942 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80096e0 con 0x7ff6b8101d70 2024-09-13T16:59:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.966+0000 7ff6aea00640 1 -- 172.21.15.18:0/2470492942 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6a80044f0 con 0x7ff6b8101d70 2024-09-13T16:59:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.966+0000 7ff6b7200640 1 -- 172.21.15.18:0/2470492942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b0009840 con 0x7ff6b8101d70 2024-09-13T16:59:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.966+0000 7ff6aea00640 1 -- 172.21.15.18:0/2470492942 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8010430 con 0x7ff6b8101d70 2024-09-13T16:59:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.966+0000 7ff6b7200640 1 -- 172.21.15.18:0/2470492942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b81a0190 con 0x7ff6b8101d70 2024-09-13T16:59:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6bf85f740 1 Processor -- start 2024-09-13T16:59:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6bf85f740 1 -- start start 2024-09-13T16:59:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6aea00640 1 -- 172.21.15.18:0/2470492942 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff6a80035f0 con 0x7ff6b8101d70 2024-09-13T16:59:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628d9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628d95c0 0x559d628de080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628de650 0x559d628e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d627e4bb0 con 0x559d628de650 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d62842a70 con 0x559d628d8c80 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d62840200 con 0x559d628d95c0 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6b6800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628d9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6b5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628de650 0x559d628e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6b6800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628d9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:56722/0 (socket says 172.21.15.18:56722) 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.969+0000 7ff6b6800640 1 -- 172.21.15.18:0/2607257012 learned_addr learned my addr 172.21.15.18:0/2607257012 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.970+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/2607257012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628d95c0 0x559d628de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.970+0000 7ff6b5400640 1 -- 172.21.15.18:0/2607257012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628d95c0 msgr2=0x559d628de080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.970+0000 7ff6b5400640 1 --2- 172.21.15.18:0/2607257012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628d95c0 0x559d628de080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.970+0000 7ff6b5400640 1 -- 172.21.15.18:0/2607257012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 msgr2=0x559d628d9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.970+0000 7ff6b5400640 1 --2- 172.21.15.18:0/2607257012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628d9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.970+0000 7ff6b5400640 1 -- 172.21.15.18:0/2607257012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d627dd940 con 0x559d628de650 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.970+0000 7ff6b5400640 1 --2- 172.21.15.18:0/2607257012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628de650 0x559d628e0b10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4005fd0 tx=0x7ff6a4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c57e9fa4e49ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.970+0000 7ff6aea00640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff69c0a11b0 0x7ff69c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.971+0000 7ff6a3400640 1 -- 172.21.15.18:0/2607257012 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4004220 con 0x559d628de650 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.971+0000 7ff6a3400640 1 -- 172.21.15.18:0/2607257012 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6a4004380 con 0x559d628de650 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.971+0000 7ff6a3400640 1 -- 172.21.15.18:0/2607257012 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4019830 con 0x559d628de650 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.971+0000 7ff6aea00640 1 -- 172.21.15.18:0/2470492942 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7ff6a8014070 con 0x7ff6b8101d70 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.971+0000 7ff6b6800640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff69c0a11b0 0x7ff69c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.971+0000 7ff6bf85f740 1 -- 172.21.15.18:0/2607257012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628de650 msgr2=0x559d628e0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.971+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/2607257012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628de650 0x559d628e0b10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4005fd0 tx=0x7ff6a4011810 comp rx=0 tx=0).stop 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.972+0000 7ff6bf85f740 1 -- 172.21.15.18:0/2607257012 shutdown_connections 2024-09-13T16:59:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.972+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/2607257012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628de650 0x559d628e0b10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.972+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/2607257012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628d95c0 0x559d628de080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.972+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/2607257012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628d9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.972+0000 7ff6bf85f740 1 -- 172.21.15.18:0/2607257012 >> 172.21.15.18:0/2607257012 conn(0x559d628d42f0 msgr2=0x559d628d46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.972+0000 7ff6bf85f740 1 -- 172.21.15.18:0/2607257012 shutdown_connections 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.972+0000 7ff6b6800640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff69c0a11b0 0x7ff69c0a3670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0031040 tx=0x7ff6b0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.972+0000 7ff6bf85f740 1 -- 172.21.15.18:0/2607257012 wait complete. 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.972+0000 7ff6bf85f740 1 -- start start 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.972+0000 7ff6bf85f740 1 Processor -- start 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628e2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6283baf0 con 0x559d628d95c0 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d627f9f20 con 0x559d628d8c80 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d627f9bc0 con 0x559d628de650 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6bf85f740 10 client.0 _ll_register_callbacks cb 0x559d6282ba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6b5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6b5e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628e2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6b5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57272/0 (socket says 172.21.15.18:57272) 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6b5400640 1 -- 172.21.15.18:0/666028129 learned_addr learned my addr 172.21.15.18:0/666028129 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6b5e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628e2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:56736/0 (socket says 172.21.15.18:56736) 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.973+0000 7ff6b6800640 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.974+0000 7ff6b5e00640 1 -- 172.21.15.18:0/666028129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 msgr2=0x559d628e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.974+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.974+0000 7ff6b5e00640 1 -- 172.21.15.18:0/666028129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 msgr2=0x559d628e2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.974+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.974+0000 7ff6b5e00640 1 -- 172.21.15.18:0/666028129 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a4009a10 con 0x559d628d8c80 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.974+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628e2820 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x559d628d9ff0 tx=0x7ff6a8096470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0bafd77c5c46f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.974+0000 7ff697e00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.974+0000 7ff697e00640 1 -- 172.21.15.18:0/666028129 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8099c40 con 0x559d628d8c80 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.974+0000 7ff697e00640 1 -- 172.21.15.18:0/666028129 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7ff6a800cd80 con 0x559d628d8c80 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.974+0000 7ff6bf85f740 1 -- 172.21.15.18:0/666028129 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d62865c90 con 0x559d628d8c80 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff697e00640 1 -- 172.21.15.18:0/666028129 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6a8099a60 con 0x559d628d8c80 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff6bf85f740 10 client.25811 fetch_fsmap learned FSMap version 35 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff6bf85f740 1 -- 172.21.15.18:0/666028129 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x559d6283a170 con 0x559d628d8c80 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff697e00640 1 -- 172.21.15.18:0/666028129 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559d62865c90 con 0x559d628d8c80 2024-09-13T16:59:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff697e00640 1 -- 172.21.15.18:0/666028129 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7ff6a801f060 con 0x559d628d8c80 2024-09-13T16:59:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff6bf85f740 10 client.25811 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T16:59:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff6bf85f740 10 client.25811 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:59:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff6bf85f740 20 client.25811 populate_metadata read hostname 'smithi018' 2024-09-13T16:59:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559d628ee510 0x559d628f0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff6bf85f740 4 client.25811 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:59:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.975+0000 7ff6bf85f740 1 -- 172.21.15.18:0/666028129 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d6282e7d0 con 0x559d628ee510 2024-09-13T16:59:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.976+0000 7ff6b5400640 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559d628ee510 0x559d628f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.976+0000 7ff6b5400640 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559d628ee510 0x559d628f0930 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64f703fe967412e0 server_cookie=b6307eb4fade0764 in_seq=0 out_seq=0 2024-09-13T16:59:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.976+0000 7ff697e00640 10 client.25811 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff697e00640 1 -- 172.21.15.18:0/666028129 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559d6282e7d0 con 0x559d628ee510 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff697e00640 10 client.25811 handle_command_reply: tid=0 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 client.25811 shutdown 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 -- 172.21.15.18:0/666028129 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 msgr2=0x559d628e2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628e2820 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x559d628d9ff0 tx=0x7ff6a8096470 comp rx=0 tx=0).stop 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 -- 172.21.15.18:0/666028129 shutdown_connections 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559d628ee510 0x559d628f0930 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff697e00640 0 client.25811 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/666028129 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628e2820 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 -- 172.21.15.18:0/666028129 >> 172.21.15.18:0/666028129 conn(0x559d628d42f0 msgr2=0x559d628d5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 -- 172.21.15.18:0/666028129 shutdown_connections 2024-09-13T16:59:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 1 -- 172.21.15.18:0/666028129 wait complete. 2024-09-13T16:59:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.977+0000 7ff6bf85f740 20 client.25811 trim_cache size 0 max 16384 2024-09-13T16:59:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6bf85f740 1 Processor -- start 2024-09-13T16:59:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6bf85f740 1 -- start start 2024-09-13T16:59:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628ddf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d625a2e60 con 0x559d628d95c0 2024-09-13T16:59:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d628ee080 con 0x559d628d8c80 2024-09-13T16:59:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d628eca70 con 0x559d628de650 2024-09-13T16:59:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6b5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6b5e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6b5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57278/0 (socket says 172.21.15.18:57278) 2024-09-13T16:59:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6b5e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628dd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:56742/0 (socket says 172.21.15.18:56742) 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6b5400640 1 -- 172.21.15.18:0/2536459439 learned_addr learned my addr 172.21.15.18:0/2536459439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.991+0000 7ff6b6800640 1 --2- 172.21.15.18:0/2536459439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628ddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.992+0000 7ff6b5e00640 1 -- 172.21.15.18:0/2536459439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 msgr2=0x559d628ddf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.992+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/2536459439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628ddf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.992+0000 7ff6b5e00640 1 -- 172.21.15.18:0/2536459439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 msgr2=0x559d628e9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.992+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/2536459439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.992+0000 7ff6b5e00640 1 -- 172.21.15.18:0/2536459439 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d627dc180 con 0x559d628d8c80 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.992+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/2536459439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628dd9f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff6a809a090 tx=0x7ff6a80964e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d47b79789be512 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.992+0000 7ff6a3e00640 1 -- 172.21.15.18:0/2536459439 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8099c40 con 0x559d628d8c80 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.992+0000 7ff6a3e00640 1 -- 172.21.15.18:0/2536459439 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6a8099a60 con 0x559d628d8c80 2024-09-13T16:59:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.992+0000 7ff6a3e00640 1 -- 172.21.15.18:0/2536459439 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80b8500 con 0x559d628d8c80 2024-09-13T16:59:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.993+0000 7ff6bf85f740 1 -- 172.21.15.18:0/2536459439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 msgr2=0x559d628dd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.993+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/2536459439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628dd9f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff6a809a090 tx=0x7ff6a80964e0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.993+0000 7ff6bf85f740 1 -- 172.21.15.18:0/2536459439 shutdown_connections 2024-09-13T16:59:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.993+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/2536459439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.993+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/2536459439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628ddf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.993+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/2536459439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628dd9f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.993+0000 7ff6bf85f740 1 -- 172.21.15.18:0/2536459439 >> 172.21.15.18:0/2536459439 conn(0x559d628d42f0 msgr2=0x559d628da3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.993+0000 7ff6bf85f740 1 -- 172.21.15.18:0/2536459439 shutdown_connections 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.993+0000 7ff6bf85f740 1 -- 172.21.15.18:0/2536459439 wait complete. 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.993+0000 7ff6bf85f740 1 -- start start 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6bf85f740 1 Processor -- start 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628e9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6bf85f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628e8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d628e8b70 con 0x559d628d95c0 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d628e8ce0 con 0x559d628d8c80 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6bf85f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d628e8ea0 con 0x559d628de650 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6bf85f740 10 client.0 _ll_register_callbacks cb 0x7ff6a80d05a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6b5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6b5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57292/0 (socket says 172.21.15.18:57292) 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6b5400640 1 -- 172.21.15.18:0/847568619 learned_addr learned my addr 172.21.15.18:0/847568619 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628e9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.994+0000 7ff6b6800640 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff6b5400640 1 -- 172.21.15.18:0/847568619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 msgr2=0x559d628e8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff6b5400640 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628e8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff6b5400640 1 -- 172.21.15.18:0/847568619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 msgr2=0x559d628e9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff6b5400640 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628e9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff6b5400640 1 -- 172.21.15.18:0/847568619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d6283a170 con 0x559d628d95c0 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff6b6800640 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628e8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff6b5400640 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e80f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4000c00 tx=0x7ff6a4009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd95aedf05e6ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff697e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T16:59:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff697e00640 1 -- 172.21.15.18:0/847568619 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a402ad10 con 0x559d628d95c0 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff697e00640 1 -- 172.21.15.18:0/847568619 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7ff6a40051e0 con 0x559d628d95c0 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.995+0000 7ff6bf85f740 1 -- 172.21.15.18:0/847568619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6a4004380 con 0x559d628d95c0 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff697e00640 1 -- 172.21.15.18:0/847568619 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6a402ae70 con 0x559d628d95c0 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff6bf85f740 10 client.15738 fetch_fsmap learned FSMap version 35 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff6bf85f740 1 -- 172.21.15.18:0/847568619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x559d62801560 con 0x559d628d95c0 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff697e00640 1 -- 172.21.15.18:0/847568619 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6a4004380 con 0x559d628d95c0 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff697e00640 1 -- 172.21.15.18:0/847568619 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7ff6a4004660 con 0x559d628d95c0 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff6bf85f740 10 client.15738 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff6bf85f740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff6bf85f740 20 client.15738 populate_metadata read hostname 'smithi018' 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559d62946230 0x559d62948650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff6bf85f740 4 client.15738 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:59:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff6bf85f740 1 -- 172.21.15.18:0/847568619 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559d6252f300 con 0x559d62946230 2024-09-13T16:59:53.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.996+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559d62946230 0x559d62948650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:53.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.997+0000 7ff6b5e00640 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559d62946230 0x559d62948650 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e3b29de4387b8f3 server_cookie=442885356fe22e7a in_seq=0 out_seq=0 2024-09-13T16:59:53.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:52.997+0000 7ff697e00640 10 client.15738 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff697e00640 1 -- 172.21.15.18:0/847568619 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559d6252f300 con 0x559d62946230 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff697e00640 10 client.15738 handle_command_reply: tid=0 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 client.15738 shutdown 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 -- 172.21.15.18:0/847568619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 msgr2=0x559d628e80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e80f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4000c00 tx=0x7ff6a4009790 comp rx=0 tx=0).stop 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 -- 172.21.15.18:0/847568619 shutdown_connections 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559d62946230 0x559d62948650 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d628d95c0 0x559d628e80f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff697e00640 0 client.15738 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d628de650 0x559d628e8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 --2- 172.21.15.18:0/847568619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559d628d8c80 0x559d628e9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 -- 172.21.15.18:0/847568619 >> 172.21.15.18:0/847568619 conn(0x559d628d42f0 msgr2=0x559d628da3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 -- 172.21.15.18:0/847568619 shutdown_connections 2024-09-13T16:59:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 1 -- 172.21.15.18:0/847568619 wait complete. 2024-09-13T16:59:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.570+0000 7ff6bf85f740 20 client.15738 trim_cache size 0 max 16384 2024-09-13T16:59:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T16:59:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T16:59:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T16:59:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T16:59:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 -- 172.21.15.18:0/2470492942 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff69c0a11b0 msgr2=0x7ff69c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff69c0a11b0 0x7ff69c0a3670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0031040 tx=0x7ff6b0005fd0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 -- 172.21.15.18:0/2470492942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6b8101d70 msgr2=0x7ff6b8197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6b8101d70 0x7ff6b8197d20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800e9c0 tx=0x7ff6a800ee80 comp rx=0 tx=0).stop 2024-09-13T16:59:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 -- 172.21.15.18:0/2470492942 shutdown_connections 2024-09-13T16:59:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6b8103920 0x7ff6b819f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6b8102f60 0x7ff6b8198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ff69c0a11b0 0x7ff69c0a3670 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 --2- 172.21.15.18:0/2470492942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6b8101d70 0x7ff6b8197d20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 -- 172.21.15.18:0/2470492942 >> 172.21.15.18:0/2470492942 conn(0x7ff6b80fd4d0 msgr2=0x7ff6b8106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 -- 172.21.15.18:0/2470492942 shutdown_connections 2024-09-13T16:59:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T16:59:53.571+0000 7ff6b7200640 1 -- 172.21.15.18:0/2470492942 wait complete. 2024-09-13T16:59:53.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:53 smithi094 ceph-mon[35259]: pgmap v614: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 707 op/s 2024-09-13T16:59:53.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:53 smithi018 ceph-mon[30981]: pgmap v614: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 707 op/s 2024-09-13T16:59:53.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:53 smithi144 ceph-mon[35328]: pgmap v614: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 707 op/s 2024-09-13T16:59:55.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:55 smithi094 ceph-mon[35259]: pgmap v615: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 363 op/s 2024-09-13T16:59:55.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:55 smithi018 ceph-mon[30981]: pgmap v615: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 363 op/s 2024-09-13T16:59:55.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:55 smithi144 ceph-mon[35328]: pgmap v615: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 363 op/s 2024-09-13T16:59:57.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:57 smithi094 ceph-mon[35259]: pgmap v616: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 351 op/s 2024-09-13T16:59:57.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:57 smithi018 ceph-mon[30981]: pgmap v616: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 351 op/s 2024-09-13T16:59:57.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:57 smithi144 ceph-mon[35328]: pgmap v616: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 351 op/s 2024-09-13T16:59:59.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 16:59:59 smithi094 ceph-mon[35259]: pgmap v617: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 405 op/s 2024-09-13T16:59:59.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 16:59:59 smithi018 ceph-mon[30981]: pgmap v617: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 405 op/s 2024-09-13T16:59:59.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 16:59:59 smithi144 ceph-mon[35328]: pgmap v617: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 405 op/s 2024-09-13T17:00:00.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:00 smithi144 ceph-mon[35328]: overall HEALTH_OK 2024-09-13T17:00:00.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:00 smithi018 ceph-mon[30981]: overall HEALTH_OK 2024-09-13T17:00:00.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:00 smithi094 ceph-mon[35259]: overall HEALTH_OK 2024-09-13T17:00:01.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:01 smithi094 ceph-mon[35259]: pgmap v618: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 497 op/s 2024-09-13T17:00:01.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:01 smithi018 ceph-mon[30981]: pgmap v618: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 497 op/s 2024-09-13T17:00:01.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:01 smithi144 ceph-mon[35328]: pgmap v618: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 497 op/s 2024-09-13T17:00:03.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:03 smithi018 ceph-mon[30981]: pgmap v619: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 594 op/s 2024-09-13T17:00:03.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:03 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:03.964 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:03 smithi094 ceph-mon[35259]: pgmap v619: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 594 op/s 2024-09-13T17:00:03.964 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:03 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:03.965 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:03 smithi144 ceph-mon[35328]: pgmap v619: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 594 op/s 2024-09-13T17:00:03.965 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:03 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:04.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:04.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:04 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:04.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:04 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T17:00:04.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:04.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:04 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:04.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:04 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T17:00:04.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:04.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:04 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:04.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:04 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T17:00:05.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:05 smithi018 ceph-mon[30981]: pgmap v620: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 619 op/s 2024-09-13T17:00:05.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:05 smithi144 ceph-mon[35328]: pgmap v620: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 619 op/s 2024-09-13T17:00:05.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:05 smithi094 ceph-mon[35259]: pgmap v620: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 619 op/s 2024-09-13T17:00:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.688+0000 7f021d200640 1 -- 172.21.15.18:0/3192021939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0218102f60 msgr2=0x7f02181033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.688+0000 7f021d200640 1 --2- 172.21.15.18:0/3192021939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0218102f60 0x7f02181033e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0204009900 tx=0x7f020402a3f0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.688+0000 7f021d200640 1 -- 172.21.15.18:0/3192021939 shutdown_connections 2024-09-13T17:00:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.688+0000 7f021d200640 1 --2- 172.21.15.18:0/3192021939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0218102f60 0x7f02181033e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.688+0000 7f021d200640 1 --2- 172.21.15.18:0/3192021939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0218103920 0x7f021810a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.688+0000 7f021d200640 1 --2- 172.21.15.18:0/3192021939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0218101d70 0x7f0218102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.688+0000 7f021d200640 1 -- 172.21.15.18:0/3192021939 >> 172.21.15.18:0/3192021939 conn(0x7f02180fd510 msgr2=0x7f02180ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.688+0000 7f021d200640 1 -- 172.21.15.18:0/3192021939 shutdown_connections 2024-09-13T17:00:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.688+0000 7f021d200640 1 -- 172.21.15.18:0/3192021939 wait complete. 2024-09-13T17:00:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.689+0000 7f021d200640 1 Processor -- start 2024-09-13T17:00:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.689+0000 7f021d200640 1 -- start start 2024-09-13T17:00:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.689+0000 7f021d200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0218101d70 0x7f0218197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.689+0000 7f021d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0218102f60 0x7f0218198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.689+0000 7f021d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0218103920 0x7f021819f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.689+0000 7f021d200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021819f7c0 con 0x7f0218103920 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.689+0000 7f021d200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021819f930 con 0x7f0218101d70 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.689+0000 7f021d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021819faf0 con 0x7f0218102f60 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.689+0000 7f0217400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0218101d70 0x7f0218197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f0217400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0218101d70 0x7f0218197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:57322/0 (socket says 172.21.15.18:57322) 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f0217400640 1 -- 172.21.15.18:0/1292278413 learned_addr learned my addr 172.21.15.18:0/1292278413 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f0216a00640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0218102f60 0x7f0218198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f0217e00640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0218103920 0x7f021819f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f0217400640 1 -- 172.21.15.18:0/1292278413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0218102f60 msgr2=0x7f0218198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f0217400640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0218102f60 0x7f0218198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f0217400640 1 -- 172.21.15.18:0/1292278413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0218103920 msgr2=0x7f021819f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f0217400640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0218103920 0x7f021819f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f0217400640 1 -- 172.21.15.18:0/1292278413 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204009560 con 0x7f0218101d70 2024-09-13T17:00:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f0217400640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0218101d70 0x7f0218197d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f020800e9c0 tx=0x7f020800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.690+0000 7f020fe00640 1 -- 172.21.15.18:0/1292278413 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208009700 con 0x7f0218101d70 2024-09-13T17:00:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.691+0000 7f021d200640 1 -- 172.21.15.18:0/1292278413 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021819fdd0 con 0x7f0218101d70 2024-09-13T17:00:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.691+0000 7f020fe00640 1 -- 172.21.15.18:0/1292278413 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02080044e0 con 0x7f0218101d70 2024-09-13T17:00:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.691+0000 7f020fe00640 1 -- 172.21.15.18:0/1292278413 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208010430 con 0x7f0218101d70 2024-09-13T17:00:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.691+0000 7f021d200640 1 -- 172.21.15.18:0/1292278413 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02181a01f0 con 0x7f0218101d70 2024-09-13T17:00:06.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.693+0000 7f02216d2740 1 Processor -- start 2024-09-13T17:00:06.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f02216d2740 1 -- start start 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f020fe00640 1 -- 172.21.15.18:0/1292278413 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0208003f60 con 0x7f0218101d70 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f02216d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae264080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f02216d2740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae2645c0 0x559bae269080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f02216d2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae269650 0x559bae26bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f02216d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae16fbb0 con 0x559bae263c80 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f02216d2740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae1cda70 con 0x559bae2645c0 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f02216d2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae1cb200 con 0x559bae269650 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f0217400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae2645c0 0x559bae269080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f0217e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae264080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f0217e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae264080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51298/0 (socket says 172.21.15.18:51298) 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f0217e00640 1 -- 172.21.15.18:0/2330880830 learned_addr learned my addr 172.21.15.18:0/2330880830 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f0217400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae2645c0 0x559bae269080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:57336/0 (socket says 172.21.15.18:57336) 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.694+0000 7f0216a00640 1 --2- 172.21.15.18:0/2330880830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae269650 0x559bae26bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f0217e00640 1 -- 172.21.15.18:0/2330880830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae269650 msgr2=0x559bae26bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f0217e00640 1 --2- 172.21.15.18:0/2330880830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae269650 0x559bae26bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f0217e00640 1 -- 172.21.15.18:0/2330880830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae2645c0 msgr2=0x559bae269080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f0217e00640 1 --2- 172.21.15.18:0/2330880830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae2645c0 0x559bae269080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f0217e00640 1 -- 172.21.15.18:0/2330880830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bae168940 con 0x559bae263c80 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f0216a00640 1 --2- 172.21.15.18:0/2330880830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae269650 0x559bae26bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f0217e00640 1 --2- 172.21.15.18:0/2330880830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae264080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0210009fd0 tx=0x7f02100118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36623c64fd4ddf47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f020cc00640 1 -- 172.21.15.18:0/2330880830 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210004d20 con 0x559bae263c80 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f020cc00640 1 -- 172.21.15.18:0/2330880830 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0210004e80 con 0x559bae263c80 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f020cc00640 1 -- 172.21.15.18:0/2330880830 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210005280 con 0x559bae263c80 2024-09-13T17:00:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.695+0000 7f020fe00640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f01fc0a1130 0x7f01fc0a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f020fe00640 1 -- 172.21.15.18:0/1292278413 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0208014070 con 0x7f0218101d70 2024-09-13T17:00:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f0217400640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f01fc0a1130 0x7f01fc0a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f02216d2740 1 -- 172.21.15.18:0/2330880830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 msgr2=0x559bae264080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f02216d2740 1 --2- 172.21.15.18:0/2330880830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae264080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0210009fd0 tx=0x7f02100118d0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f02216d2740 1 -- 172.21.15.18:0/2330880830 shutdown_connections 2024-09-13T17:00:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f02216d2740 1 --2- 172.21.15.18:0/2330880830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae269650 0x559bae26bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f02216d2740 1 --2- 172.21.15.18:0/2330880830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae2645c0 0x559bae269080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f02216d2740 1 --2- 172.21.15.18:0/2330880830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae264080 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f02216d2740 1 -- 172.21.15.18:0/2330880830 >> 172.21.15.18:0/2330880830 conn(0x559bae25f2f0 msgr2=0x559bae25f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f02216d2740 1 -- 172.21.15.18:0/2330880830 shutdown_connections 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f02216d2740 1 -- 172.21.15.18:0/2330880830 wait complete. 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.696+0000 7f0217400640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f01fc0a1130 0x7f01fc0a35f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0208096be0 tx=0x7f02080d0920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.697+0000 7f02216d2740 1 -- start start 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.697+0000 7f02216d2740 1 Processor -- start 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.697+0000 7f02216d2740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae263c80 0x559bae26d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.697+0000 7f02216d2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae26de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.697+0000 7f02216d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae269650 0x559bae274ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.697+0000 7f02216d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae1c6af0 con 0x559bae269650 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.697+0000 7f02216d2740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae184f20 con 0x559bae263c80 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.697+0000 7f02216d2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae184bc0 con 0x559bae2645c0 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.697+0000 7f02216d2740 10 client.0 _ll_register_callbacks cb 0x559bae1b6a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0216a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae26de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0216a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae26de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:54682/0 (socket says 172.21.15.18:54682) 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0217e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae263c80 0x559bae26d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0216a00640 1 -- 172.21.15.18:0/2231591633 learned_addr learned my addr 172.21.15.18:0/2231591633 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0217e00640 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae269650 0x559bae274ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0216a00640 1 -- 172.21.15.18:0/2231591633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae263c80 msgr2=0x559bae26d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0216a00640 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae263c80 0x559bae26d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0216a00640 1 -- 172.21.15.18:0/2231591633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae269650 msgr2=0x559bae274ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0216a00640 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae269650 0x559bae274ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0216a00640 1 -- 172.21.15.18:0/2231591633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0210009c80 con 0x559bae2645c0 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0216a00640 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae26de90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f020402a9e0 tx=0x7f0204004450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ce11c628a9a01d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.698+0000 7f0201600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f0201600640 1 -- 172.21.15.18:0/2231591633 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204003ac0 con 0x559bae2645c0 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f02216d2740 1 -- 172.21.15.18:0/2231591633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559bae1b97d0 con 0x559bae2645c0 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f0201600640 1 -- 172.21.15.18:0/2231591633 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0204003c20 con 0x559bae2645c0 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f0201600640 1 -- 172.21.15.18:0/2231591633 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0204003de0 con 0x559bae2645c0 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f02216d2740 10 client.25771 fetch_fsmap learned FSMap version 35 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f02216d2740 1 -- 172.21.15.18:0/2231591633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x559bae1c5170 con 0x559bae2645c0 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f0201600640 1 -- 172.21.15.18:0/2231591633 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559bae1b97d0 con 0x559bae2645c0 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f0201600640 1 -- 172.21.15.18:0/2231591633 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f02040455f0 con 0x559bae2645c0 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f02216d2740 10 client.25771 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f02216d2740 10 client.25771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:00:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f02216d2740 20 client.25771 populate_metadata read hostname 'smithi018' 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f02216d2740 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559bae2795e0 0x559bae27ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f02216d2740 4 client.25771 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.699+0000 7f02216d2740 1 -- 172.21.15.18:0/2231591633 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559badeba300 con 0x559bae2795e0 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.700+0000 7f0217e00640 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559bae2795e0 0x559bae27ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.700+0000 7f0217e00640 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559bae2795e0 0x559bae27ba00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=828fdbd5db161dae server_cookie=265f8bb67c1d70ea in_seq=0 out_seq=0 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.700+0000 7f0201600640 10 client.25771 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.701+0000 7f0201600640 1 -- 172.21.15.18:0/2231591633 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559badeba300 con 0x559bae2795e0 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.701+0000 7f0201600640 10 client.25771 handle_command_reply: tid=0 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.701+0000 7f02216d2740 1 client.25771 shutdown 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 1 -- 172.21.15.18:0/2231591633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 msgr2=0x559bae26de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae26de90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f020402a9e0 tx=0x7f0204004450 comp rx=0 tx=0).stop 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 1 -- 172.21.15.18:0/2231591633 shutdown_connections 2024-09-13T17:00:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559bae2795e0 0x559bae27ba00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae269650 0x559bae274ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae26de90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 1 --2- 172.21.15.18:0/2231591633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae263c80 0x559bae26d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 1 -- 172.21.15.18:0/2231591633 >> 172.21.15.18:0/2231591633 conn(0x559bae25f2f0 msgr2=0x559bae260b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f0201600640 0 client.25771 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 1 -- 172.21.15.18:0/2231591633 shutdown_connections 2024-09-13T17:00:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 1 -- 172.21.15.18:0/2231591633 wait complete. 2024-09-13T17:00:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.702+0000 7f02216d2740 20 client.25771 trim_cache size 0 max 16384 2024-09-13T17:00:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.717+0000 7f02216d2740 1 Processor -- start 2024-09-13T17:00:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.717+0000 7f02216d2740 1 -- start start 2024-09-13T17:00:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.717+0000 7f02216d2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae263c80 0x559bae2654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.717+0000 7f02216d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae2645c0 0x559bae265a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.717+0000 7f02216d2740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae269650 0x559bae274e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.717+0000 7f02216d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559badf2de60 con 0x559bae2645c0 2024-09-13T17:00:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.717+0000 7f02216d2740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae2599f0 con 0x559bae269650 2024-09-13T17:00:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.717+0000 7f02216d2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae26e850 con 0x559bae263c80 2024-09-13T17:00:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0216a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae2645c0 0x559bae265a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0216a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae2645c0 0x559bae265a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51324/0 (socket says 172.21.15.18:51324) 2024-09-13T17:00:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0216a00640 1 -- 172.21.15.18:0/3278403326 learned_addr learned my addr 172.21.15.18:0/3278403326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0217e00640 1 --2- 172.21.15.18:0/3278403326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae269650 0x559bae274e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0217e00640 1 --2- 172.21.15.18:0/3278403326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae263c80 0x559bae2654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0216a00640 1 -- 172.21.15.18:0/3278403326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae263c80 msgr2=0x559bae2654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0216a00640 1 --2- 172.21.15.18:0/3278403326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae263c80 0x559bae2654e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0216a00640 1 -- 172.21.15.18:0/3278403326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae269650 msgr2=0x559bae274e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0216a00640 1 --2- 172.21.15.18:0/3278403326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae269650 0x559bae274e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0216a00640 1 -- 172.21.15.18:0/3278403326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bae167180 con 0x559bae2645c0 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.718+0000 7f0216a00640 1 --2- 172.21.15.18:0/3278403326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae2645c0 0x559bae265a20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0204045980 tx=0x7f02040092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febcfb005715a714 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f020d600640 1 -- 172.21.15.18:0/3278403326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204045680 con 0x559bae2645c0 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f020d600640 1 -- 172.21.15.18:0/3278403326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0204045c70 con 0x559bae2645c0 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f020d600640 1 -- 172.21.15.18:0/3278403326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02040319c0 con 0x559bae2645c0 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f02216d2740 1 -- 172.21.15.18:0/3278403326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae2645c0 msgr2=0x559bae265a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f02216d2740 1 --2- 172.21.15.18:0/3278403326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae2645c0 0x559bae265a20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0204045980 tx=0x7f02040092b0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f02216d2740 1 -- 172.21.15.18:0/3278403326 shutdown_connections 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f02216d2740 1 --2- 172.21.15.18:0/3278403326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae2645c0 0x559bae265a20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f02216d2740 1 --2- 172.21.15.18:0/3278403326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae269650 0x559bae274e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f02216d2740 1 --2- 172.21.15.18:0/3278403326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae263c80 0x559bae2654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f02216d2740 1 -- 172.21.15.18:0/3278403326 >> 172.21.15.18:0/3278403326 conn(0x559bae25f2f0 msgr2=0x559bae26d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f02216d2740 1 -- 172.21.15.18:0/3278403326 shutdown_connections 2024-09-13T17:00:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.719+0000 7f02216d2740 1 -- 172.21.15.18:0/3278403326 wait complete. 2024-09-13T17:00:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.720+0000 7f02216d2740 1 -- start start 2024-09-13T17:00:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.720+0000 7f02216d2740 1 Processor -- start 2024-09-13T17:00:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.720+0000 7f02216d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae274a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.720+0000 7f02216d2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae274f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.720+0000 7f02216d2740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae269650 0x559bae2715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.720+0000 7f02216d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae271ce0 con 0x559bae263c80 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.720+0000 7f02216d2740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae271e50 con 0x559bae269650 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.720+0000 7f02216d2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bae272010 con 0x559bae2645c0 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.720+0000 7f02216d2740 10 client.0 _ll_register_callbacks cb 0x7f0210009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0217e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae274a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0217e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae274a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51330/0 (socket says 172.21.15.18:51330) 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0217e00640 1 -- 172.21.15.18:0/1919563958 learned_addr learned my addr 172.21.15.18:0/1919563958 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0217e00640 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae269650 0x559bae2715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0216a00640 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae274f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0216a00640 1 -- 172.21.15.18:0/1919563958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae269650 msgr2=0x559bae2715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0216a00640 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae269650 0x559bae2715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0216a00640 1 -- 172.21.15.18:0/1919563958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 msgr2=0x559bae274a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0216a00640 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae274a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0216a00640 1 -- 172.21.15.18:0/1919563958 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bae1c5170 con 0x559bae2645c0 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0216a00640 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae274f40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x559bae280aa0 tx=0x7f0204003af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1a11094240d39c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.721+0000 7f0201600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f0201600640 1 -- 172.21.15.18:0/1919563958 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204031940 con 0x559bae2645c0 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f02216d2740 1 -- 172.21.15.18:0/1919563958 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559bae1f0c90 con 0x559bae2645c0 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f0201600640 1 -- 172.21.15.18:0/1919563958 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0204000e40 con 0x559bae2645c0 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f0201600640 1 -- 172.21.15.18:0/1919563958 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0204003e70 con 0x559bae2645c0 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f02216d2740 10 client.25777 fetch_fsmap learned FSMap version 35 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f02216d2740 1 -- 172.21.15.18:0/1919563958 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x559bae18c560 con 0x559bae2645c0 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f0201600640 1 -- 172.21.15.18:0/1919563958 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0204064020 con 0x559bae2645c0 2024-09-13T17:00:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f0201600640 1 -- 172.21.15.18:0/1919563958 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0204059070 con 0x559bae2645c0 2024-09-13T17:00:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f02216d2740 10 client.25777 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:00:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f02216d2740 10 client.25777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:00:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f02216d2740 20 client.25777 populate_metadata read hostname 'smithi018' 2024-09-13T17:00:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.722+0000 7f02216d2740 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559bae2d0e40 0x559bae2d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.723+0000 7f02216d2740 4 client.25777 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:00:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.723+0000 7f02216d2740 1 -- 172.21.15.18:0/1919563958 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559badecb600 con 0x559bae2d0e40 2024-09-13T17:00:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.723+0000 7f0217e00640 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559bae2d0e40 0x559bae2d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.723+0000 7f0217e00640 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559bae2d0e40 0x559bae2d3260 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4437c14e400a171e server_cookie=4607f1be4f01695a in_seq=0 out_seq=0 2024-09-13T17:00:06.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:06.723+0000 7f0201600640 10 client.25777 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:07.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:07 smithi018 ceph-mon[30981]: pgmap v621: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 713 op/s 2024-09-13T17:00:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.714+0000 7f0201600640 1 -- 172.21.15.18:0/1919563958 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559badecb600 con 0x559bae2d0e40 2024-09-13T17:00:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.714+0000 7f0201600640 10 client.25777 handle_command_reply: tid=0 2024-09-13T17:00:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 client.25777 shutdown 2024-09-13T17:00:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 -- 172.21.15.18:0/1919563958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 msgr2=0x559bae274f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae274f40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x559bae280aa0 tx=0x7f0204003af0 comp rx=0 tx=0).stop 2024-09-13T17:00:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 -- 172.21.15.18:0/1919563958 shutdown_connections 2024-09-13T17:00:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x559bae2d0e40 0x559bae2d3260 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x559bae269650 0x559bae2715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559bae2645c0 0x559bae274f40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 --2- 172.21.15.18:0/1919563958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bae263c80 0x559bae274a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 -- 172.21.15.18:0/1919563958 >> 172.21.15.18:0/1919563958 conn(0x559bae25f2f0 msgr2=0x559bae268720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f0201600640 0 client.25777 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 -- 172.21.15.18:0/1919563958 shutdown_connections 2024-09-13T17:00:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.715+0000 7f02216d2740 1 -- 172.21.15.18:0/1919563958 wait complete. 2024-09-13T17:00:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.717+0000 7f02216d2740 20 client.25777 trim_cache size 0 max 16384 2024-09-13T17:00:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T17:00:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T17:00:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T17:00:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T17:00:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.717+0000 7f021d200640 1 -- 172.21.15.18:0/1292278413 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f01fc0a1130 msgr2=0x7f01fc0a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.717+0000 7f021d200640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f01fc0a1130 0x7f01fc0a35f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0208096be0 tx=0x7f02080d0920 comp rx=0 tx=0).stop 2024-09-13T17:00:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.717+0000 7f021d200640 1 -- 172.21.15.18:0/1292278413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0218101d70 msgr2=0x7f0218197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.717+0000 7f021d200640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0218101d70 0x7f0218197d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f020800e9c0 tx=0x7f020800ee80 comp rx=0 tx=0).stop 2024-09-13T17:00:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.718+0000 7f021d200640 1 -- 172.21.15.18:0/1292278413 shutdown_connections 2024-09-13T17:00:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.718+0000 7f021d200640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f01fc0a1130 0x7f01fc0a35f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:07.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.718+0000 7f021d200640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0218103920 0x7f021819f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:07.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.718+0000 7f021d200640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0218102f60 0x7f0218198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:07.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.718+0000 7f021d200640 1 --2- 172.21.15.18:0/1292278413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0218101d70 0x7f0218197d00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:07.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.718+0000 7f021d200640 1 -- 172.21.15.18:0/1292278413 >> 172.21.15.18:0/1292278413 conn(0x7f02180fd510 msgr2=0x7f0218106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:07.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.718+0000 7f021d200640 1 -- 172.21.15.18:0/1292278413 shutdown_connections 2024-09-13T17:00:07.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:07.718+0000 7f021d200640 1 -- 172.21.15.18:0/1292278413 wait complete. 2024-09-13T17:00:07.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:07 smithi144 ceph-mon[35328]: pgmap v621: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 713 op/s 2024-09-13T17:00:07.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:07 smithi094 ceph-mon[35259]: pgmap v621: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 713 op/s 2024-09-13T17:00:09.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:09 smithi018 ceph-mon[30981]: pgmap v622: 129 pgs: 129 active+clean; 1020 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 691 op/s 2024-09-13T17:00:09.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:09 smithi144 ceph-mon[35328]: pgmap v622: 129 pgs: 129 active+clean; 1020 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 691 op/s 2024-09-13T17:00:09.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:09 smithi094 ceph-mon[35259]: pgmap v622: 129 pgs: 129 active+clean; 1020 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 691 op/s 2024-09-13T17:00:11.696 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:11 smithi018 ceph-mon[30981]: pgmap v623: 129 pgs: 129 active+clean; 1007 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 668 op/s 2024-09-13T17:00:11.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:11 smithi144 ceph-mon[35328]: pgmap v623: 129 pgs: 129 active+clean; 1007 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 668 op/s 2024-09-13T17:00:11.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:11 smithi094 ceph-mon[35259]: pgmap v623: 129 pgs: 129 active+clean; 1007 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 668 op/s 2024-09-13T17:00:13.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:13 smithi018 ceph-mon[30981]: pgmap v624: 129 pgs: 129 active+clean; 995 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 613 op/s 2024-09-13T17:00:13.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:13 smithi144 ceph-mon[35328]: pgmap v624: 129 pgs: 129 active+clean; 995 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 613 op/s 2024-09-13T17:00:13.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:13 smithi094 ceph-mon[35259]: pgmap v624: 129 pgs: 129 active+clean; 995 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 613 op/s 2024-09-13T17:00:15.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:15 smithi018 ceph-mon[30981]: pgmap v625: 129 pgs: 129 active+clean; 991 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 527 op/s 2024-09-13T17:00:15.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:15 smithi144 ceph-mon[35328]: pgmap v625: 129 pgs: 129 active+clean; 991 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 527 op/s 2024-09-13T17:00:15.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:15 smithi094 ceph-mon[35259]: pgmap v625: 129 pgs: 129 active+clean; 991 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 527 op/s 2024-09-13T17:00:17.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:17 smithi018 ceph-mon[30981]: pgmap v626: 129 pgs: 129 active+clean; 985 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 505 op/s 2024-09-13T17:00:17.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:17 smithi144 ceph-mon[35328]: pgmap v626: 129 pgs: 129 active+clean; 985 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 505 op/s 2024-09-13T17:00:17.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:17 smithi094 ceph-mon[35259]: pgmap v626: 129 pgs: 129 active+clean; 985 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 505 op/s 2024-09-13T17:00:19.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:19 smithi018 ceph-mon[30981]: pgmap v627: 129 pgs: 129 active+clean; 978 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 426 op/s 2024-09-13T17:00:19.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:19 smithi144 ceph-mon[35328]: pgmap v627: 129 pgs: 129 active+clean; 978 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 426 op/s 2024-09-13T17:00:19.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:19 smithi094 ceph-mon[35259]: pgmap v627: 129 pgs: 129 active+clean; 978 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 426 op/s 2024-09-13T17:00:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.846+0000 7fe2d0a00640 1 -- 172.21.15.18:0/1567652402 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2cc074470 msgr2=0x7fe2cc0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.846+0000 7fe2d0a00640 1 --2- 172.21.15.18:0/1567652402 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2cc074470 0x7fe2cc0728c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009900 tx=0x7fe2bc02a480 comp rx=0 tx=0).stop 2024-09-13T17:00:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.846+0000 7fe2d0a00640 1 -- 172.21.15.18:0/1567652402 shutdown_connections 2024-09-13T17:00:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.846+0000 7fe2d0a00640 1 --2- 172.21.15.18:0/1567652402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2cc072e90 0x7fe2cc0732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.846+0000 7fe2d0a00640 1 --2- 172.21.15.18:0/1567652402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2cc107a00 0x7fe2cc109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.846+0000 7fe2d0a00640 1 --2- 172.21.15.18:0/1567652402 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2cc074470 0x7fe2cc0728c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.846+0000 7fe2d0a00640 1 -- 172.21.15.18:0/1567652402 >> 172.21.15.18:0/1567652402 conn(0x7fe2cc0fb2f0 msgr2=0x7fe2cc0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.846+0000 7fe2d0a00640 1 -- 172.21.15.18:0/1567652402 shutdown_connections 2024-09-13T17:00:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.847+0000 7fe2d0a00640 1 -- 172.21.15.18:0/1567652402 wait complete. 2024-09-13T17:00:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.847+0000 7fe2d0a00640 1 Processor -- start 2024-09-13T17:00:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2d0a00640 1 -- start start 2024-09-13T17:00:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2d0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2cc072e90 0x7fe2cc197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2d0a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2cc074470 0x7fe2cc1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2d0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2cc107a00 0x7fe2cc19f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2d0a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc19f7c0 con 0x7fe2cc107a00 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2d0a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc19f930 con 0x7fe2cc074470 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2d0a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc19faf0 con 0x7fe2cc072e90 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2caa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2cc074470 0x7fe2cc1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2caa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2cc074470 0x7fe2cc1981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:40300/0 (socket says 172.21.15.18:40300) 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2caa00640 1 -- 172.21.15.18:0/3703449897 learned_addr learned my addr 172.21.15.18:0/3703449897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2cbe00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2cc107a00 0x7fe2cc19f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.848+0000 7fe2cb400640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2cc072e90 0x7fe2cc197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.849+0000 7fe2caa00640 1 -- 172.21.15.18:0/3703449897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2cc072e90 msgr2=0x7fe2cc197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.849+0000 7fe2caa00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2cc072e90 0x7fe2cc197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.849+0000 7fe2caa00640 1 -- 172.21.15.18:0/3703449897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2cc107a00 msgr2=0x7fe2cc19f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.849+0000 7fe2caa00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2cc107a00 0x7fe2cc19f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.849+0000 7fe2caa00640 1 -- 172.21.15.18:0/3703449897 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc009560 con 0x7fe2cc074470 2024-09-13T17:00:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.849+0000 7fe2caa00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2cc074470 0x7fe2cc1981f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800e9f0 tx=0x7fe2b800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.849+0000 7fe2c3e00640 1 -- 172.21.15.18:0/3703449897 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8009700 con 0x7fe2cc074470 2024-09-13T17:00:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.849+0000 7fe2c3e00640 1 -- 172.21.15.18:0/3703449897 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2b800cd80 con 0x7fe2cc074470 2024-09-13T17:00:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.849+0000 7fe2d0a00640 1 -- 172.21.15.18:0/3703449897 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc19fdd0 con 0x7fe2cc074470 2024-09-13T17:00:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.849+0000 7fe2c3e00640 1 -- 172.21.15.18:0/3703449897 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8018860 con 0x7fe2cc074470 2024-09-13T17:00:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.850+0000 7fe2d0a00640 1 -- 172.21.15.18:0/3703449897 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc1a0280 con 0x7fe2cc074470 2024-09-13T17:00:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2d4fc4740 1 Processor -- start 2024-09-13T17:00:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2d4fc4740 1 -- start start 2024-09-13T17:00:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393490 0x55ab02393890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 0x55ab02398890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02398e60 0x55ab0239b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab02296bb0 con 0x55ab02393dd0 2024-09-13T17:00:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab022f4a70 con 0x55ab02393490 2024-09-13T17:00:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab022f2200 con 0x55ab02398e60 2024-09-13T17:00:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2cbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393490 0x55ab02393890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2cbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393490 0x55ab02393890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:40306/0 (socket says 172.21.15.18:40306) 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2cb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 0x55ab02398890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.853+0000 7fe2cbe00640 1 -- 172.21.15.18:0/2907284815 learned_addr learned my addr 172.21.15.18:0/2907284815 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.854+0000 7fe2c3e00640 1 -- 172.21.15.18:0/3703449897 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe2b80189c0 con 0x7fe2cc074470 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.854+0000 7fe2cbe00640 1 -- 172.21.15.18:0/2907284815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02398e60 msgr2=0x55ab0239b320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.854+0000 7fe2cbe00640 1 --2- 172.21.15.18:0/2907284815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02398e60 0x55ab0239b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.854+0000 7fe2cbe00640 1 -- 172.21.15.18:0/2907284815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 msgr2=0x55ab02398890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.854+0000 7fe2cbe00640 1 --2- 172.21.15.18:0/2907284815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 0x55ab02398890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.854+0000 7fe2cbe00640 1 -- 172.21.15.18:0/2907284815 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0228f940 con 0x55ab02393490 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.854+0000 7fe2cb400640 1 --2- 172.21.15.18:0/2907284815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 0x55ab02398890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.854+0000 7fe2cbe00640 1 --2- 172.21.15.18:0/2907284815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393490 0x55ab02393890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009fd0 tx=0x7fe2c40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6066e0f402db8da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.854+0000 7fe2c0c00640 1 -- 172.21.15.18:0/2907284815 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4004d20 con 0x55ab02393490 2024-09-13T17:00:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.854+0000 7fe2c0c00640 1 -- 172.21.15.18:0/2907284815 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2c4004e80 con 0x55ab02393490 2024-09-13T17:00:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2c0c00640 1 -- 172.21.15.18:0/2907284815 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4005280 con 0x55ab02393490 2024-09-13T17:00:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/2907284815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393490 msgr2=0x55ab02393890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/2907284815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393490 0x55ab02393890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009fd0 tx=0x7fe2c40118d0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2c3e00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2b00a1130 0x7fe2b00a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/2907284815 shutdown_connections 2024-09-13T17:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/2907284815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 0x55ab02398890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/2907284815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02398e60 0x55ab0239b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/2907284815 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393490 0x55ab02393890 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/2907284815 >> 172.21.15.18:0/2907284815 conn(0x55ab023862f0 msgr2=0x55ab023866f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2c3e00640 1 -- 172.21.15.18:0/3703449897 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fe2b8014070 con 0x7fe2cc074470 2024-09-13T17:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2cb400640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2b00a1130 0x7fe2b00a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.855+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/2907284815 shutdown_connections 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.856+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/2907284815 wait complete. 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.856+0000 7fe2d4fc4740 1 -- start start 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.856+0000 7fe2cb400640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2b00a1130 0x7fe2b00a35f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc198b80 tx=0x7fe2bc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.856+0000 7fe2d4fc4740 1 Processor -- start 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 0x55ab0239d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393dd0 0x55ab0239d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab022edaf0 con 0x55ab02393490 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab022abf20 con 0x55ab02398e60 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab022abbc0 con 0x55ab02393dd0 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2d4fc4740 10 client.0 _ll_register_callbacks cb 0x55ab022dda70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393dd0 0x55ab0239d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2cbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2cb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 0x55ab0239d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393dd0 0x55ab0239d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:33394/0 (socket says 172.21.15.18:33394) 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2caa00640 1 -- 172.21.15.18:0/180359867 learned_addr learned my addr 172.21.15.18:0/180359867 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2cbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:40320/0 (socket says 172.21.15.18:40320) 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2caa00640 1 -- 172.21.15.18:0/180359867 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 msgr2=0x55ab023a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2caa00640 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2caa00640 1 -- 172.21.15.18:0/180359867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 msgr2=0x55ab0239d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2caa00640 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 0x55ab0239d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2caa00640 1 -- 172.21.15.18:0/180359867 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c4009c80 con 0x55ab02393dd0 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.857+0000 7fe2cbe00640 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.858+0000 7fe2caa00640 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393dd0 0x55ab0239d690 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8096620 tx=0x7fe2b8099a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9809f17d099be59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.858+0000 7fe2b5600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:00:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.858+0000 7fe2b5600640 1 -- 172.21.15.18:0/180359867 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80a24f0 con 0x55ab02393dd0 2024-09-13T17:00:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.858+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/180359867 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab022e07d0 con 0x55ab02393dd0 2024-09-13T17:00:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.858+0000 7fe2b5600640 1 -- 172.21.15.18:0/180359867 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fe2b80cabe0 con 0x55ab02393dd0 2024-09-13T17:00:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.858+0000 7fe2b5600640 1 -- 172.21.15.18:0/180359867 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2b80cada0 con 0x55ab02393dd0 2024-09-13T17:00:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.858+0000 7fe2d4fc4740 10 client.25786 fetch_fsmap learned FSMap version 35 2024-09-13T17:00:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.858+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/180359867 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55ab022ec170 con 0x55ab02393dd0 2024-09-13T17:00:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.858+0000 7fe2b5600640 1 -- 172.21.15.18:0/180359867 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ab022e07d0 con 0x55ab02393dd0 2024-09-13T17:00:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.859+0000 7fe2b5600640 1 -- 172.21.15.18:0/180359867 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fe2b8099080 con 0x55ab02393dd0 2024-09-13T17:00:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.859+0000 7fe2d4fc4740 10 client.25786 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.859+0000 7fe2d4fc4740 10 client.25786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.859+0000 7fe2d4fc4740 20 client.25786 populate_metadata read hostname 'smithi018' 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.859+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ab023a8d90 0x55ab023ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.859+0000 7fe2d4fc4740 4 client.25786 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.859+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/180359867 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab01fe1300 con 0x55ab023a8d90 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.859+0000 7fe2cb400640 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ab023a8d90 0x55ab023ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.859+0000 7fe2cb400640 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ab023a8d90 0x55ab023ab1b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=440e37e172b5d817 server_cookie=b8535ef7f1b525f3 in_seq=0 out_seq=0 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.859+0000 7fe2b5600640 10 client.25786 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.860+0000 7fe2b5600640 1 -- 172.21.15.18:0/180359867 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ab01fe1300 con 0x55ab023a8d90 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.860+0000 7fe2b5600640 10 client.25786 handle_command_reply: tid=0 2024-09-13T17:00:20.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.860+0000 7fe2d4fc4740 1 client.25786 shutdown 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.860+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/180359867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393dd0 msgr2=0x55ab0239d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.860+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393dd0 0x55ab0239d690 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8096620 tx=0x7fe2b8099a80 comp rx=0 tx=0).stop 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.860+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/180359867 shutdown_connections 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.860+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ab023a8d90 0x55ab023ab1b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.861+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.861+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393dd0 0x55ab0239d690 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.861+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/180359867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 0x55ab0239d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.861+0000 7fe2b5600640 0 client.25786 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.861+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/180359867 >> 172.21.15.18:0/180359867 conn(0x55ab023862f0 msgr2=0x55ab02387b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.861+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/180359867 shutdown_connections 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.861+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/180359867 wait complete. 2024-09-13T17:00:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.861+0000 7fe2d4fc4740 20 client.25786 trim_cache size 0 max 16384 2024-09-13T17:00:20.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.875+0000 7fe2d4fc4740 1 Processor -- start 2024-09-13T17:00:20.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.875+0000 7fe2d4fc4740 1 -- start start 2024-09-13T17:00:20.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.875+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 0x55ab02385c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.875+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393dd0 0x55ab023a4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.875+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02398e60 0x55ab0239c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.875+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab02054e60 con 0x55ab02393490 2024-09-13T17:00:20.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.875+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0238a800 con 0x55ab02393dd0 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.875+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab023a7330 con 0x55ab02398e60 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2caa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393dd0 0x55ab023a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2cb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 0x55ab02385c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2caa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393dd0 0x55ab023a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:40324/0 (socket says 172.21.15.18:40324) 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2caa00640 1 -- 172.21.15.18:0/1845837615 learned_addr learned my addr 172.21.15.18:0/1845837615 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2cbe00640 1 --2- 172.21.15.18:0/1845837615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02398e60 0x55ab0239c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2caa00640 1 -- 172.21.15.18:0/1845837615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02398e60 msgr2=0x55ab0239c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2caa00640 1 --2- 172.21.15.18:0/1845837615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02398e60 0x55ab0239c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2caa00640 1 -- 172.21.15.18:0/1845837615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 msgr2=0x55ab02385c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2caa00640 1 --2- 172.21.15.18:0/1845837615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 0x55ab02385c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2caa00640 1 -- 172.21.15.18:0/1845837615 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0228e180 con 0x55ab02393dd0 2024-09-13T17:00:20.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2cb400640 1 --2- 172.21.15.18:0/1845837615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 0x55ab02385c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:00:20.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.876+0000 7fe2caa00640 1 --2- 172.21.15.18:0/1845837615 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393dd0 0x55ab023a4640 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c6a0 tx=0x7fe2b809e020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95bbef04f3a50b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:20.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.877+0000 7fe2c1600640 1 -- 172.21.15.18:0/1845837615 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8099ef0 con 0x55ab02393dd0 2024-09-13T17:00:20.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.877+0000 7fe2c1600640 1 -- 172.21.15.18:0/1845837615 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2b80a24f0 con 0x55ab02393dd0 2024-09-13T17:00:20.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.877+0000 7fe2c1600640 1 -- 172.21.15.18:0/1845837615 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80cae40 con 0x55ab02393dd0 2024-09-13T17:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.877+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/1845837615 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393dd0 msgr2=0x55ab023a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.877+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/1845837615 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393dd0 0x55ab023a4640 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c6a0 tx=0x7fe2b809e020 comp rx=0 tx=0).stop 2024-09-13T17:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.878+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/1845837615 shutdown_connections 2024-09-13T17:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.878+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/1845837615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02398e60 0x55ab0239c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.878+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/1845837615 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02393dd0 0x55ab023a4640 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.878+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/1845837615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393490 0x55ab02385c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.878+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/1845837615 >> 172.21.15.18:0/1845837615 conn(0x55ab023862f0 msgr2=0x55ab02394d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.878+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/1845837615 shutdown_connections 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.878+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/1845837615 wait complete. 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.879+0000 7fe2d4fc4740 1 -- start start 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.879+0000 7fe2d4fc4740 1 Processor -- start 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.879+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393490 0x55ab023a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.879+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 0x55ab023a4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.879+0000 7fe2d4fc4740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.879+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab023a0f70 con 0x55ab02393dd0 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.879+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab023a10e0 con 0x55ab02398e60 2024-09-13T17:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.879+0000 7fe2d4fc4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab023a12a0 con 0x55ab02393490 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.879+0000 7fe2d4fc4740 10 client.0 _ll_register_callbacks cb 0x7fe2c4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2caa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 0x55ab023a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2cbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393490 0x55ab023a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393490 0x55ab023a3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:33408/0 (socket says 172.21.15.18:33408) 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2cb400640 1 -- 172.21.15.18:0/551292334 learned_addr learned my addr 172.21.15.18:0/551292334 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2cbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:40326/0 (socket says 172.21.15.18:40326) 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2caa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 0x55ab023a4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47280/0 (socket says 172.21.15.18:47280) 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2cb400640 1 -- 172.21.15.18:0/551292334 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 msgr2=0x55ab023a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2cb400640 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2cb400640 1 -- 172.21.15.18:0/551292334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 msgr2=0x55ab023a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2cb400640 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 0x55ab023a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.880+0000 7fe2cb400640 1 -- 172.21.15.18:0/551292334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2bc004390 con 0x55ab02393490 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.881+0000 7fe2cb400640 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393490 0x55ab023a3ef0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc005070 tx=0x7fe2bc009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30e751e281c5486f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.881+0000 7fe2b5600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.881+0000 7fe2b5600640 1 -- 172.21.15.18:0/551292334 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc04e040 con 0x55ab02393490 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.881+0000 7fe2b5600640 1 -- 172.21.15.18:0/551292334 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fe2bc0543e0 con 0x55ab02393490 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.881+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/551292334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab02317c90 con 0x55ab02393490 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.881+0000 7fe2b5600640 1 -- 172.21.15.18:0/551292334 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2bc0545a0 con 0x55ab02393490 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.881+0000 7fe2d4fc4740 10 client.25792 fetch_fsmap learned FSMap version 35 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.881+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/551292334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55ab022ec170 con 0x55ab02393490 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.881+0000 7fe2b5600640 1 -- 172.21.15.18:0/551292334 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ab02317c90 con 0x55ab02393490 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.882+0000 7fe2b5600640 1 -- 172.21.15.18:0/551292334 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fe2bc0315a0 con 0x55ab02393490 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.882+0000 7fe2d4fc4740 10 client.25792 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.882+0000 7fe2d4fc4740 10 client.25792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.882+0000 7fe2d4fc4740 20 client.25792 populate_metadata read hostname 'smithi018' 2024-09-13T17:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.882+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ab024007f0 0x55ab02402c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.882+0000 7fe2d4fc4740 4 client.25792 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.882+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/551292334 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ab01ff2600 con 0x55ab024007f0 2024-09-13T17:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.882+0000 7fe2caa00640 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ab024007f0 0x55ab02402c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.883+0000 7fe2caa00640 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ab024007f0 0x55ab02402c10 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a299d98dbae3c4f server_cookie=f3e7daed26105bd4 in_seq=0 out_seq=0 2024-09-13T17:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.883+0000 7fe2b5600640 10 client.25792 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.958+0000 7fe2b5600640 1 -- 172.21.15.18:0/551292334 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ab01ff2600 con 0x55ab024007f0 2024-09-13T17:00:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.958+0000 7fe2b5600640 10 client.25792 handle_command_reply: tid=0 2024-09-13T17:00:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.958+0000 7fe2d4fc4740 1 client.25792 shutdown 2024-09-13T17:00:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.958+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/551292334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393490 msgr2=0x55ab023a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.958+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393490 0x55ab023a3ef0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc005070 tx=0x7fe2bc009260 comp rx=0 tx=0).stop 2024-09-13T17:00:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.959+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/551292334 shutdown_connections 2024-09-13T17:00:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.959+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55ab024007f0 0x55ab02402c10 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.959+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab02393dd0 0x55ab023a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.959+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55ab02398e60 0x55ab023a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.959+0000 7fe2d4fc4740 1 --2- 172.21.15.18:0/551292334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab02393490 0x55ab023a3ef0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.959+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/551292334 >> 172.21.15.18:0/551292334 conn(0x55ab023862f0 msgr2=0x55ab0239c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:20.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.959+0000 7fe2b5600640 0 client.25792 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:20.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.959+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/551292334 shutdown_connections 2024-09-13T17:00:20.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.960+0000 7fe2d4fc4740 1 -- 172.21.15.18:0/551292334 wait complete. 2024-09-13T17:00:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T17:00:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T17:00:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T17:00:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T17:00:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.961+0000 7fe2d4fc4740 20 client.25792 trim_cache size 0 max 16384 2024-09-13T17:00:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 -- 172.21.15.18:0/3703449897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2b00a1130 msgr2=0x7fe2b00a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2b00a1130 0x7fe2b00a35f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc198b80 tx=0x7fe2bc0314a0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 -- 172.21.15.18:0/3703449897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2cc074470 msgr2=0x7fe2cc1981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2cc074470 0x7fe2cc1981f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800e9f0 tx=0x7fe2b800eeb0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 -- 172.21.15.18:0/3703449897 shutdown_connections 2024-09-13T17:00:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe2b00a1130 0x7fe2b00a35f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2cc107a00 0x7fe2cc19f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2cc074470 0x7fe2cc1981f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 --2- 172.21.15.18:0/3703449897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2cc072e90 0x7fe2cc197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 -- 172.21.15.18:0/3703449897 >> 172.21.15.18:0/3703449897 conn(0x7fe2cc0fb2f0 msgr2=0x7fe2cc103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 -- 172.21.15.18:0/3703449897 shutdown_connections 2024-09-13T17:00:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:20.963+0000 7fe2d0a00640 1 -- 172.21.15.18:0/3703449897 wait complete. 2024-09-13T17:00:21.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:21 smithi018 ceph-mon[30981]: pgmap v628: 129 pgs: 129 active+clean; 970 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 418 op/s 2024-09-13T17:00:21.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:21 smithi144 ceph-mon[35328]: pgmap v628: 129 pgs: 129 active+clean; 970 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 418 op/s 2024-09-13T17:00:21.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:21 smithi094 ceph-mon[35259]: pgmap v628: 129 pgs: 129 active+clean; 970 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 418 op/s 2024-09-13T17:00:23.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:23 smithi144 ceph-mon[35328]: pgmap v629: 129 pgs: 129 active+clean; 955 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 381 op/s 2024-09-13T17:00:23.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:23 smithi094 ceph-mon[35259]: pgmap v629: 129 pgs: 129 active+clean; 955 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 381 op/s 2024-09-13T17:00:23.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:23 smithi018 ceph-mon[30981]: pgmap v629: 129 pgs: 129 active+clean; 955 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 381 op/s 2024-09-13T17:00:25.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:25 smithi144 ceph-mon[35328]: pgmap v630: 129 pgs: 129 active+clean; 946 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 324 op/s 2024-09-13T17:00:25.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:25 smithi094 ceph-mon[35259]: pgmap v630: 129 pgs: 129 active+clean; 946 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 324 op/s 2024-09-13T17:00:25.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:25 smithi018 ceph-mon[30981]: pgmap v630: 129 pgs: 129 active+clean; 946 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 324 op/s 2024-09-13T17:00:27.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:27 smithi144 ceph-mon[35328]: pgmap v631: 129 pgs: 129 active+clean; 939 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 332 op/s 2024-09-13T17:00:27.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:27 smithi094 ceph-mon[35259]: pgmap v631: 129 pgs: 129 active+clean; 939 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 332 op/s 2024-09-13T17:00:27.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:27 smithi018 ceph-mon[30981]: pgmap v631: 129 pgs: 129 active+clean; 939 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 332 op/s 2024-09-13T17:00:29.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:29 smithi144 ceph-mon[35328]: pgmap v632: 129 pgs: 129 active+clean; 923 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 360 op/s 2024-09-13T17:00:29.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:29 smithi094 ceph-mon[35259]: pgmap v632: 129 pgs: 129 active+clean; 923 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 360 op/s 2024-09-13T17:00:29.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:29 smithi018 ceph-mon[30981]: pgmap v632: 129 pgs: 129 active+clean; 923 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 360 op/s 2024-09-13T17:00:31.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:31 smithi144 ceph-mon[35328]: pgmap v633: 129 pgs: 129 active+clean; 909 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 376 op/s 2024-09-13T17:00:31.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:31 smithi094 ceph-mon[35259]: pgmap v633: 129 pgs: 129 active+clean; 909 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 376 op/s 2024-09-13T17:00:31.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:31 smithi018 ceph-mon[30981]: pgmap v633: 129 pgs: 129 active+clean; 909 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 376 op/s 2024-09-13T17:00:33.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:33 smithi144 ceph-mon[35328]: pgmap v634: 129 pgs: 129 active+clean; 900 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 382 op/s 2024-09-13T17:00:33.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:33 smithi094 ceph-mon[35259]: pgmap v634: 129 pgs: 129 active+clean; 900 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 382 op/s 2024-09-13T17:00:33.918 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:33 smithi018 ceph-mon[30981]: pgmap v634: 129 pgs: 129 active+clean; 900 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 382 op/s 2024-09-13T17:00:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.156+0000 7fed52000640 1 -- 172.21.15.18:0/662709016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed4c1005e0 msgr2=0x7fed4c1029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.156+0000 7fed52000640 1 --2- 172.21.15.18:0/662709016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed4c1005e0 0x7fed4c1029d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fed40009900 tx=0x7fed4002a3f0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.157+0000 7fed52000640 1 -- 172.21.15.18:0/662709016 shutdown_connections 2024-09-13T17:00:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.157+0000 7fed52000640 1 --2- 172.21.15.18:0/662709016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed4c105920 0x7fed4c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.157+0000 7fed52000640 1 --2- 172.21.15.18:0/662709016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed4c102f10 0x7fed4c105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.157+0000 7fed52000640 1 --2- 172.21.15.18:0/662709016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed4c1005e0 0x7fed4c1029d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.157+0000 7fed52000640 1 -- 172.21.15.18:0/662709016 >> 172.21.15.18:0/662709016 conn(0x7fed4c0fa1c0 msgr2=0x7fed4c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.157+0000 7fed52000640 1 -- 172.21.15.18:0/662709016 shutdown_connections 2024-09-13T17:00:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.158+0000 7fed52000640 1 -- 172.21.15.18:0/662709016 wait complete. 2024-09-13T17:00:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.159+0000 7fed52000640 1 Processor -- start 2024-09-13T17:00:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.160+0000 7fed52000640 1 -- start start 2024-09-13T17:00:34.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.163+0000 7fed52000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed4c1005e0 0x7fed4c0fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.163+0000 7fed52000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed4c102f10 0x7fed4c0fe590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.163+0000 7fed52000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed4c105920 0x7fed4c0fead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.163+0000 7fed50c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed4c1005e0 0x7fed4c0fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed50c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed4c1005e0 0x7fed4c0fff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:35852/0 (socket says 172.21.15.18:35852) 2024-09-13T17:00:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed50c00640 1 -- 172.21.15.18:0/1719335783 learned_addr learned my addr 172.21.15.18:0/1719335783 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed51600640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed4c105920 0x7fed4c0fead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c1a6040 con 0x7fed4c105920 2024-09-13T17:00:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0ff010 con 0x7fed4c102f10 2024-09-13T17:00:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0ff1d0 con 0x7fed4c1005e0 2024-09-13T17:00:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed4be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed4c102f10 0x7fed4c0fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed50c00640 1 -- 172.21.15.18:0/1719335783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed4c102f10 msgr2=0x7fed4c0fe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed50c00640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed4c102f10 0x7fed4c0fe590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed50c00640 1 -- 172.21.15.18:0/1719335783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed4c105920 msgr2=0x7fed4c0fead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed50c00640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed4c105920 0x7fed4c0fead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.164+0000 7fed50c00640 1 -- 172.21.15.18:0/1719335783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed44009840 con 0x7fed4c1005e0 2024-09-13T17:00:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.165+0000 7fed50c00640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed4c1005e0 0x7fed4c0fff50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed40004650 tx=0x7fed40003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.165+0000 7fed49600640 1 -- 172.21.15.18:0/1719335783 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400315a0 con 0x7fed4c1005e0 2024-09-13T17:00:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.165+0000 7fed49600640 1 -- 172.21.15.18:0/1719335783 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed40031bc0 con 0x7fed4c1005e0 2024-09-13T17:00:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.165+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed40009560 con 0x7fed4c1005e0 2024-09-13T17:00:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.165+0000 7fed49600640 1 -- 172.21.15.18:0/1719335783 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4003bb90 con 0x7fed4c1005e0 2024-09-13T17:00:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.165+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c070b10 con 0x7fed4c1005e0 2024-09-13T17:00:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.172+0000 7fed563d9740 1 Processor -- start 2024-09-13T17:00:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.173+0000 7fed49600640 1 -- 172.21.15.18:0/1719335783 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fed4003a3c0 con 0x7fed4c1005e0 2024-09-13T17:00:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.177+0000 7fed49600640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fed340a1200 0x7fed340a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.178+0000 7fed49600640 1 -- 172.21.15.18:0/1719335783 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fed400ed7d0 con 0x7fed4c1005e0 2024-09-13T17:00:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.179+0000 7fed563d9740 1 -- start start 2024-09-13T17:00:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.179+0000 7fed563d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef0d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.180+0000 7fed563d9740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.180+0000 7fed563d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef12650 0x55e5cef14b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.180+0000 7fed563d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cee18bb0 con 0x55e5cef12650 2024-09-13T17:00:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.180+0000 7fed563d9740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cee76a70 con 0x55e5cef0d5c0 2024-09-13T17:00:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.180+0000 7fed563d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cee74200 con 0x55e5cef0cc80 2024-09-13T17:00:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.180+0000 7fed4be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.180+0000 7fed4be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:33452/0 (socket says 172.21.15.18:33452) 2024-09-13T17:00:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.180+0000 7fed4be00640 1 -- 172.21.15.18:0/3684541536 learned_addr learned my addr 172.21.15.18:0/3684541536 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.181+0000 7fed50c00640 1 --2- 172.21.15.18:0/3684541536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef0d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.182+0000 7fed4be00640 1 -- 172.21.15.18:0/3684541536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 msgr2=0x55e5cef0d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.182+0000 7fed4be00640 1 --2- 172.21.15.18:0/3684541536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef0d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.182+0000 7fed4be00640 1 -- 172.21.15.18:0/3684541536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef12650 msgr2=0x55e5cef14b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.182+0000 7fed4be00640 1 --2- 172.21.15.18:0/3684541536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef12650 0x55e5cef14b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.182+0000 7fed4be00640 1 -- 172.21.15.18:0/3684541536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5cee11940 con 0x55e5cef0d5c0 2024-09-13T17:00:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.182+0000 7fed50c00640 1 --2- 172.21.15.18:0/3684541536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef0d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:00:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.182+0000 7fed4be00640 1 --2- 172.21.15.18:0/3684541536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12080 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fed3800dcb0 tx=0x7fed3800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca97faa45533bfb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.182+0000 7fed51600640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fed340a1200 0x7fed340a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.185+0000 7fed3e000640 1 -- 172.21.15.18:0/3684541536 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38004030 con 0x55e5cef0d5c0 2024-09-13T17:00:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.185+0000 7fed3e000640 1 -- 172.21.15.18:0/3684541536 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed380035f0 con 0x55e5cef0d5c0 2024-09-13T17:00:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.185+0000 7fed3e000640 1 -- 172.21.15.18:0/3684541536 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380116a0 con 0x55e5cef0d5c0 2024-09-13T17:00:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.186+0000 7fed563d9740 1 -- 172.21.15.18:0/3684541536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 msgr2=0x55e5cef12080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.186+0000 7fed563d9740 1 --2- 172.21.15.18:0/3684541536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12080 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fed3800dcb0 tx=0x7fed3800f730 comp rx=0 tx=0).stop 2024-09-13T17:00:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.187+0000 7fed563d9740 1 -- 172.21.15.18:0/3684541536 shutdown_connections 2024-09-13T17:00:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.187+0000 7fed563d9740 1 --2- 172.21.15.18:0/3684541536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef12650 0x55e5cef14b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.187+0000 7fed563d9740 1 --2- 172.21.15.18:0/3684541536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12080 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.187+0000 7fed563d9740 1 --2- 172.21.15.18:0/3684541536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef0d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.187+0000 7fed563d9740 1 -- 172.21.15.18:0/3684541536 >> 172.21.15.18:0/3684541536 conn(0x55e5cef082f0 msgr2=0x55e5cef086f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.188+0000 7fed563d9740 1 -- 172.21.15.18:0/3684541536 shutdown_connections 2024-09-13T17:00:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.188+0000 7fed563d9740 1 -- 172.21.15.18:0/3684541536 wait complete. 2024-09-13T17:00:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.188+0000 7fed563d9740 1 -- start start 2024-09-13T17:00:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.189+0000 7fed563d9740 1 Processor -- start 2024-09-13T17:00:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.189+0000 7fed51600640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fed340a1200 0x7fed340a36c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fed44005fd0 tx=0x7fed44009b70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.190+0000 7fed563d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef27930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.190+0000 7fed563d9740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef27e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.190+0000 7fed563d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef12650 0x55e5cef2eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.191+0000 7fed50c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef27930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.191+0000 7fed50c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef27930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:35876/0 (socket says 172.21.15.18:35876) 2024-09-13T17:00:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.191+0000 7fed4be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef27e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.191+0000 7fed4be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef27e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:33454/0 (socket says 172.21.15.18:33454) 2024-09-13T17:00:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.191+0000 7fed51600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef12650 0x55e5cef2eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.193+0000 7fed51600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef12650 0x55e5cef2eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48570/0 (socket says 172.21.15.18:48570) 2024-09-13T17:00:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.193+0000 7fed563d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cee6faf0 con 0x55e5cef12650 2024-09-13T17:00:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.193+0000 7fed563d9740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cee2df20 con 0x55e5cef0d5c0 2024-09-13T17:00:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.193+0000 7fed563d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cee2dbc0 con 0x55e5cef0cc80 2024-09-13T17:00:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.193+0000 7fed563d9740 10 client.0 _ll_register_callbacks cb 0x55e5cee5fa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:00:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.193+0000 7fed50c00640 1 -- 172.21.15.18:0/2396984293 learned_addr learned my addr 172.21.15.18:0/2396984293 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.194+0000 7fed50c00640 1 -- 172.21.15.18:0/2396984293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 msgr2=0x55e5cef27e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.194+0000 7fed50c00640 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef27e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.194+0000 7fed50c00640 1 -- 172.21.15.18:0/2396984293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef12650 msgr2=0x55e5cef2eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.194+0000 7fed50c00640 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef12650 0x55e5cef2eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.194+0000 7fed50c00640 1 -- 172.21.15.18:0/2396984293 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3800d8e0 con 0x55e5cef0cc80 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.194+0000 7fed50c00640 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef27930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fed400b80f0 tx=0x7fed40031e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47dcdcc1cad024be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.194+0000 7fed32a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.195+0000 7fed32a00640 1 -- 172.21.15.18:0/2396984293 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4003bd30 con 0x55e5cef0cc80 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.195+0000 7fed32a00640 1 -- 172.21.15.18:0/2396984293 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fed400b7d90 con 0x55e5cef0cc80 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.195+0000 7fed563d9740 1 -- 172.21.15.18:0/2396984293 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5cee99c90 con 0x55e5cef0cc80 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.195+0000 7fed32a00640 1 -- 172.21.15.18:0/2396984293 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed4003be90 con 0x55e5cef0cc80 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.195+0000 7fed563d9740 10 client.25804 fetch_fsmap learned FSMap version 35 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.195+0000 7fed563d9740 1 -- 172.21.15.18:0/2396984293 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55e5cee6e170 con 0x55e5cef0cc80 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.195+0000 7fed32a00640 1 -- 172.21.15.18:0/2396984293 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e5cee99c90 con 0x55e5cef0cc80 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.195+0000 7fed32a00640 1 -- 172.21.15.18:0/2396984293 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fed400bb8e0 con 0x55e5cef0cc80 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.196+0000 7fed563d9740 10 client.25804 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.196+0000 7fed563d9740 10 client.25804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:00:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.196+0000 7fed563d9740 20 client.25804 populate_metadata read hostname 'smithi018' 2024-09-13T17:00:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.196+0000 7fed563d9740 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55e5cef332f0 0x55e5cef35710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.196+0000 7fed563d9740 4 client.25804 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:00:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.196+0000 7fed563d9740 1 -- 172.21.15.18:0/2396984293 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5cee627d0 con 0x55e5cef332f0 2024-09-13T17:00:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.196+0000 7fed4be00640 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55e5cef332f0 0x55e5cef35710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.197+0000 7fed4be00640 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55e5cef332f0 0x55e5cef35710 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf20b8177dac0e88 server_cookie=6d9cf1627ee4e6a7 in_seq=0 out_seq=0 2024-09-13T17:00:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.197+0000 7fed32a00640 10 client.25804 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.219+0000 7fed32a00640 1 -- 172.21.15.18:0/2396984293 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e5cee627d0 con 0x55e5cef332f0 2024-09-13T17:00:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.219+0000 7fed32a00640 10 client.25804 handle_command_reply: tid=0 2024-09-13T17:00:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.219+0000 7fed563d9740 1 client.25804 shutdown 2024-09-13T17:00:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.220+0000 7fed563d9740 1 -- 172.21.15.18:0/2396984293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 msgr2=0x55e5cef27930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.220+0000 7fed563d9740 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef27930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fed400b80f0 tx=0x7fed40031e70 comp rx=0 tx=0).stop 2024-09-13T17:00:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.220+0000 7fed563d9740 1 -- 172.21.15.18:0/2396984293 shutdown_connections 2024-09-13T17:00:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.220+0000 7fed563d9740 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55e5cef332f0 0x55e5cef35710 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.220+0000 7fed563d9740 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef12650 0x55e5cef2eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.220+0000 7fed563d9740 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0d5c0 0x55e5cef27e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.220+0000 7fed563d9740 1 --2- 172.21.15.18:0/2396984293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef27930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.220+0000 7fed563d9740 1 -- 172.21.15.18:0/2396984293 >> 172.21.15.18:0/2396984293 conn(0x55e5cef082f0 msgr2=0x55e5cef09b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.220+0000 7fed32a00640 0 client.25804 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.227+0000 7fed563d9740 1 -- 172.21.15.18:0/2396984293 shutdown_connections 2024-09-13T17:00:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.227+0000 7fed563d9740 1 -- 172.21.15.18:0/2396984293 wait complete. 2024-09-13T17:00:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.228+0000 7fed563d9740 20 client.25804 trim_cache size 0 max 16384 2024-09-13T17:00:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.251+0000 7fed563d9740 1 Processor -- start 2024-09-13T17:00:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.251+0000 7fed563d9740 1 -- start start 2024-09-13T17:00:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.251+0000 7fed563d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef11b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.251+0000 7fed563d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.251+0000 7fed563d9740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef12650 0x55e5cef2ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.252+0000 7fed50c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef11b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.252+0000 7fed563d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cebd6e60 con 0x55e5cef0d5c0 2024-09-13T17:00:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.252+0000 7fed563d9740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cef3a890 con 0x55e5cef12650 2024-09-13T17:00:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.252+0000 7fed563d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cef35980 con 0x55e5cef0cc80 2024-09-13T17:00:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.252+0000 7fed50c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef11b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:35878/0 (socket says 172.21.15.18:35878) 2024-09-13T17:00:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.252+0000 7fed50c00640 1 -- 172.21.15.18:0/951829752 learned_addr learned my addr 172.21.15.18:0/951829752 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.253+0000 7fed4be00640 1 --2- 172.21.15.18:0/951829752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.252+0000 7fed51600640 1 --2- 172.21.15.18:0/951829752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef12650 0x55e5cef2ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.253+0000 7fed50c00640 1 -- 172.21.15.18:0/951829752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef12650 msgr2=0x55e5cef2ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.253+0000 7fed50c00640 1 --2- 172.21.15.18:0/951829752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef12650 0x55e5cef2ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.253+0000 7fed50c00640 1 -- 172.21.15.18:0/951829752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 msgr2=0x55e5cef12060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.253+0000 7fed50c00640 1 --2- 172.21.15.18:0/951829752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.253+0000 7fed50c00640 1 -- 172.21.15.18:0/951829752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5cee10180 con 0x55e5cef0cc80 2024-09-13T17:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.253+0000 7fed4be00640 1 --2- 172.21.15.18:0/951829752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.254+0000 7fed50c00640 1 --2- 172.21.15.18:0/951829752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef11b20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed400bb380 tx=0x7fed400b9c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6990648867309d7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.254+0000 7fed3ea00640 1 -- 172.21.15.18:0/951829752 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400b79c0 con 0x55e5cef0cc80 2024-09-13T17:00:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.254+0000 7fed3ea00640 1 -- 172.21.15.18:0/951829752 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed400bafe0 con 0x55e5cef0cc80 2024-09-13T17:00:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.255+0000 7fed3ea00640 1 -- 172.21.15.18:0/951829752 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400b79c0 con 0x55e5cef0cc80 2024-09-13T17:00:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.255+0000 7fed563d9740 1 -- 172.21.15.18:0/951829752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 msgr2=0x55e5cef11b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.255+0000 7fed563d9740 1 --2- 172.21.15.18:0/951829752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef11b20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed400bb380 tx=0x7fed400b9c30 comp rx=0 tx=0).stop 2024-09-13T17:00:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.257+0000 7fed563d9740 1 -- 172.21.15.18:0/951829752 shutdown_connections 2024-09-13T17:00:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.257+0000 7fed563d9740 1 --2- 172.21.15.18:0/951829752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 0x55e5cef12060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.257+0000 7fed563d9740 1 --2- 172.21.15.18:0/951829752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef12650 0x55e5cef2ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.257+0000 7fed563d9740 1 --2- 172.21.15.18:0/951829752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef0cc80 0x55e5cef11b20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.257+0000 7fed563d9740 1 -- 172.21.15.18:0/951829752 >> 172.21.15.18:0/951829752 conn(0x55e5cef082f0 msgr2=0x55e5cef086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.257+0000 7fed563d9740 1 -- 172.21.15.18:0/951829752 shutdown_connections 2024-09-13T17:00:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.257+0000 7fed563d9740 1 -- 172.21.15.18:0/951829752 wait complete. 2024-09-13T17:00:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.258+0000 7fed563d9740 1 -- start start 2024-09-13T17:00:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.258+0000 7fed563d9740 1 Processor -- start 2024-09-13T17:00:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.258+0000 7fed563d9740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0cc80 0x55e5cef2ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed563d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 0x55e5cef2d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed563d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef12650 0x55e5cef2e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed563d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cef2e850 con 0x55e5cef0d5c0 2024-09-13T17:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed563d9740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cef2e9c0 con 0x55e5cef0cc80 2024-09-13T17:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed563d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cef2eb80 con 0x55e5cef12650 2024-09-13T17:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed563d9740 10 client.0 _ll_register_callbacks cb 0x7fed3800d440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed50c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0cc80 0x55e5cef2ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed51600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef12650 0x55e5cef2e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed51600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef12650 0x55e5cef2e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:35882/0 (socket says 172.21.15.18:35882) 2024-09-13T17:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed51600640 1 -- 172.21.15.18:0/4082681324 learned_addr learned my addr 172.21.15.18:0/4082681324 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.259+0000 7fed4be00640 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 0x55e5cef2d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.260+0000 7fed50c00640 1 -- 172.21.15.18:0/4082681324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef12650 msgr2=0x55e5cef2e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.260+0000 7fed50c00640 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef12650 0x55e5cef2e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.260+0000 7fed50c00640 1 -- 172.21.15.18:0/4082681324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 msgr2=0x55e5cef2d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.260+0000 7fed50c00640 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 0x55e5cef2d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.260+0000 7fed50c00640 1 -- 172.21.15.18:0/4082681324 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5cee6e170 con 0x55e5cef0cc80 2024-09-13T17:00:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.260+0000 7fed51600640 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef12650 0x55e5cef2e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:00:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.261+0000 7fed50c00640 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0cc80 0x55e5cef2ce60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55e5cef0a310 tx=0x7fed400bb7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=facd8d01ae969bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.261+0000 7fed32a00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T17:00:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.261+0000 7fed32a00640 1 -- 172.21.15.18:0/4082681324 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400a63d0 con 0x55e5cef0cc80 2024-09-13T17:00:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.261+0000 7fed32a00640 1 -- 172.21.15.18:0/4082681324 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fed400bb8e0 con 0x55e5cef0cc80 2024-09-13T17:00:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed563d9740 1 -- 172.21.15.18:0/4082681324 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed380035f0 con 0x55e5cef0cc80 2024-09-13T17:00:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed32a00640 1 -- 172.21.15.18:0/4082681324 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed400b79c0 con 0x55e5cef0cc80 2024-09-13T17:00:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed563d9740 10 client.25871 fetch_fsmap learned FSMap version 35 2024-09-13T17:00:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed563d9740 1 -- 172.21.15.18:0/4082681324 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55e5cee35560 con 0x55e5cef0cc80 2024-09-13T17:00:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed32a00640 1 -- 172.21.15.18:0/4082681324 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed380035f0 con 0x55e5cef0cc80 2024-09-13T17:00:34.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed32a00640 1 -- 172.21.15.18:0/4082681324 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fed400bac00 con 0x55e5cef0cc80 2024-09-13T17:00:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed563d9740 10 client.25871 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:00:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed563d9740 10 client.25871 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:00:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed563d9740 20 client.25871 populate_metadata read hostname 'smithi018' 2024-09-13T17:00:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed563d9740 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55e5cef8a540 0x55e5cef8c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed563d9740 4 client.25871 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:00:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.262+0000 7fed563d9740 1 -- 172.21.15.18:0/4082681324 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e5ceb63300 con 0x55e5cef8a540 2024-09-13T17:00:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.263+0000 7fed4be00640 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55e5cef8a540 0x55e5cef8c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.263+0000 7fed4be00640 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55e5cef8a540 0x55e5cef8c960 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a81d640da2cf7b2 server_cookie=de3e7a083685146a in_seq=0 out_seq=0 2024-09-13T17:00:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:34.263+0000 7fed32a00640 10 client.25871 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:35.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:35 smithi144 ceph-mon[35328]: pgmap v635: 129 pgs: 129 active+clean; 896 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 359 op/s 2024-09-13T17:00:35.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:35 smithi094 ceph-mon[35259]: pgmap v635: 129 pgs: 129 active+clean; 896 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 359 op/s 2024-09-13T17:00:35.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:35 smithi018 ceph-mon[30981]: pgmap v635: 129 pgs: 129 active+clean; 896 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 359 op/s 2024-09-13T17:00:37.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:37 smithi144 ceph-mon[35328]: pgmap v636: 129 pgs: 129 active+clean; 885 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 493 op/s 2024-09-13T17:00:37.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:37 smithi094 ceph-mon[35259]: pgmap v636: 129 pgs: 129 active+clean; 885 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 493 op/s 2024-09-13T17:00:37.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:37 smithi018 ceph-mon[30981]: pgmap v636: 129 pgs: 129 active+clean; 885 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 493 op/s 2024-09-13T17:00:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed32a00640 1 -- 172.21.15.18:0/4082681324 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e5ceb63300 con 0x55e5cef8a540 2024-09-13T17:00:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed32a00640 10 client.25871 handle_command_reply: tid=0 2024-09-13T17:00:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 client.25871 shutdown 2024-09-13T17:00:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 -- 172.21.15.18:0/4082681324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0cc80 msgr2=0x55e5cef2ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0cc80 0x55e5cef2ce60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55e5cef0a310 tx=0x7fed400bb7c0 comp rx=0 tx=0).stop 2024-09-13T17:00:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 -- 172.21.15.18:0/4082681324 shutdown_connections 2024-09-13T17:00:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55e5cef8a540 0x55e5cef8c960 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5cef0d5c0 0x55e5cef2d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5cef12650 0x55e5cef2e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 --2- 172.21.15.18:0/4082681324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55e5cef0cc80 0x55e5cef2ce60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed32a00640 0 client.25871 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 -- 172.21.15.18:0/4082681324 >> 172.21.15.18:0/4082681324 conn(0x55e5cef082f0 msgr2=0x55e5cef0e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 -- 172.21.15.18:0/4082681324 shutdown_connections 2024-09-13T17:00:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.619+0000 7fed563d9740 1 -- 172.21.15.18:0/4082681324 wait complete. 2024-09-13T17:00:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed563d9740 20 client.25871 trim_cache size 0 max 16384 2024-09-13T17:00:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T17:00:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T17:00:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T17:00:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T17:00:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fed340a1200 msgr2=0x7fed340a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fed340a1200 0x7fed340a36c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fed44005fd0 tx=0x7fed44009b70 comp rx=0 tx=0).stop 2024-09-13T17:00:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed4c1005e0 msgr2=0x7fed4c0fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed4c1005e0 0x7fed4c0fff50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed40004650 tx=0x7fed40003b90 comp rx=0 tx=0).stop 2024-09-13T17:00:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 shutdown_connections 2024-09-13T17:00:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fed340a1200 0x7fed340a36c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed4c105920 0x7fed4c0fead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed4c102f10 0x7fed4c0fe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 --2- 172.21.15.18:0/1719335783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed4c1005e0 0x7fed4c0fff50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 >> 172.21.15.18:0/1719335783 conn(0x7fed4c0fa1c0 msgr2=0x7fed4c100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 shutdown_connections 2024-09-13T17:00:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:38.620+0000 7fed52000640 1 -- 172.21.15.18:0/1719335783 wait complete. 2024-09-13T17:00:39.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:39 smithi144 ceph-mon[35328]: pgmap v637: 129 pgs: 129 active+clean; 878 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 794 op/s 2024-09-13T17:00:39.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:39 smithi094 ceph-mon[35259]: pgmap v637: 129 pgs: 129 active+clean; 878 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 794 op/s 2024-09-13T17:00:39.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:39 smithi018 ceph-mon[30981]: pgmap v637: 129 pgs: 129 active+clean; 878 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 794 op/s 2024-09-13T17:00:41.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:41 smithi144 ceph-mon[35328]: pgmap v638: 129 pgs: 129 active+clean; 875 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.10k op/s 2024-09-13T17:00:41.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:41 smithi094 ceph-mon[35259]: pgmap v638: 129 pgs: 129 active+clean; 875 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.10k op/s 2024-09-13T17:00:41.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:41 smithi018 ceph-mon[30981]: pgmap v638: 129 pgs: 129 active+clean; 875 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.10k op/s 2024-09-13T17:00:43.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:43 smithi094 ceph-mon[35259]: pgmap v639: 129 pgs: 129 active+clean; 865 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 1.34k op/s 2024-09-13T17:00:43.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:43 smithi018 ceph-mon[30981]: pgmap v639: 129 pgs: 129 active+clean; 865 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 1.34k op/s 2024-09-13T17:00:44.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:43 smithi144 ceph-mon[35328]: pgmap v639: 129 pgs: 129 active+clean; 865 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 1.34k op/s 2024-09-13T17:00:45.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:45 smithi094 ceph-mon[35259]: pgmap v640: 129 pgs: 129 active+clean; 853 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 1.36k op/s 2024-09-13T17:00:45.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:45 smithi018 ceph-mon[30981]: pgmap v640: 129 pgs: 129 active+clean; 853 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 1.36k op/s 2024-09-13T17:00:46.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:45 smithi144 ceph-mon[35328]: pgmap v640: 129 pgs: 129 active+clean; 853 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 1.36k op/s 2024-09-13T17:00:47.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:47 smithi018 ceph-mon[30981]: pgmap v641: 129 pgs: 129 active+clean; 844 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 1.38k op/s 2024-09-13T17:00:47.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:47 smithi094 ceph-mon[35259]: pgmap v641: 129 pgs: 129 active+clean; 844 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 1.38k op/s 2024-09-13T17:00:48.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:47 smithi144 ceph-mon[35328]: pgmap v641: 129 pgs: 129 active+clean; 844 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 1.38k op/s 2024-09-13T17:00:49.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:49 smithi018 ceph-mon[30981]: pgmap v642: 129 pgs: 129 active+clean; 832 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 1.30k op/s 2024-09-13T17:00:49.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:49 smithi094 ceph-mon[35259]: pgmap v642: 129 pgs: 129 active+clean; 832 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 1.30k op/s 2024-09-13T17:00:50.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:49 smithi144 ceph-mon[35328]: pgmap v642: 129 pgs: 129 active+clean; 832 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 1.30k op/s 2024-09-13T17:00:50.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:50 smithi094 ceph-mon[35259]: pgmap v643: 129 pgs: 129 active+clean; 822 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 1.00k op/s 2024-09-13T17:00:50.959 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:50 smithi018 ceph-mon[30981]: pgmap v643: 129 pgs: 129 active+clean; 822 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 1.00k op/s 2024-09-13T17:00:51.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:50 smithi144 ceph-mon[35328]: pgmap v643: 129 pgs: 129 active+clean; 822 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 1.00k op/s 2024-09-13T17:00:51.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.788+0000 7f0c27200640 1 -- 172.21.15.18:0/3300219410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c28100d40 msgr2=0x7f0c281011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.788+0000 7f0c27200640 1 --2- 172.21.15.18:0/3300219410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c28100d40 0x7f0c281011c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009900 tx=0x7f0c1402a3f0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.788+0000 7f0c27200640 1 -- 172.21.15.18:0/3300219410 shutdown_connections 2024-09-13T17:00:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.788+0000 7f0c27200640 1 --2- 172.21.15.18:0/3300219410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c28101700 0x7f0c28107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.788+0000 7f0c27200640 1 --2- 172.21.15.18:0/3300219410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c28100d40 0x7f0c281011c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.788+0000 7f0c27200640 1 --2- 172.21.15.18:0/3300219410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c280ffb50 0x7f0c280fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.788+0000 7f0c27200640 1 -- 172.21.15.18:0/3300219410 >> 172.21.15.18:0/3300219410 conn(0x7f0c280fb2f0 msgr2=0x7f0c280fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.788+0000 7f0c27200640 1 -- 172.21.15.18:0/3300219410 shutdown_connections 2024-09-13T17:00:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.788+0000 7f0c27200640 1 -- 172.21.15.18:0/3300219410 wait complete. 2024-09-13T17:00:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.789+0000 7f0c27200640 1 Processor -- start 2024-09-13T17:00:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.789+0000 7f0c27200640 1 -- start start 2024-09-13T17:00:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.789+0000 7f0c27200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c280ffb50 0x7f0c28195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.789+0000 7f0c27200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c28100d40 0x7f0c28195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.789+0000 7f0c27200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c28101700 0x7f0c2819d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.789+0000 7f0c27200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2819d590 con 0x7f0c28100d40 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.789+0000 7f0c27200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2819d700 con 0x7f0c28101700 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.789+0000 7f0c27200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2819d8c0 con 0x7f0c280ffb50 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.790+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c280ffb50 0x7f0c28195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.790+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c280ffb50 0x7f0c28195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:37922/0 (socket says 172.21.15.18:37922) 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.790+0000 7f0c25e00640 1 -- 172.21.15.18:0/3403613786 learned_addr learned my addr 172.21.15.18:0/3403613786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.790+0000 7f0c25400640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c28100d40 0x7f0c28195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.790+0000 7f0c26800640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c28101700 0x7f0c2819d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.790+0000 7f0c25e00640 1 -- 172.21.15.18:0/3403613786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c28101700 msgr2=0x7f0c2819d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.790+0000 7f0c25e00640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c28101700 0x7f0c2819d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.790+0000 7f0c25e00640 1 -- 172.21.15.18:0/3403613786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c28100d40 msgr2=0x7f0c28195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.790+0000 7f0c25e00640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c28100d40 0x7f0c28195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.790+0000 7f0c25e00640 1 -- 172.21.15.18:0/3403613786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c14009560 con 0x7f0c280ffb50 2024-09-13T17:00:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.791+0000 7f0c25e00640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c280ffb50 0x7f0c28195aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800e9c0 tx=0x7f0c1800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.791+0000 7f0c1ea00640 1 -- 172.21.15.18:0/3403613786 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18009700 con 0x7f0c280ffb50 2024-09-13T17:00:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.791+0000 7f0c1ea00640 1 -- 172.21.15.18:0/3403613786 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c180044e0 con 0x7f0c280ffb50 2024-09-13T17:00:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.791+0000 7f0c1ea00640 1 -- 172.21.15.18:0/3403613786 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18010430 con 0x7f0c280ffb50 2024-09-13T17:00:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.791+0000 7f0c27200640 1 -- 172.21.15.18:0/3403613786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c28072740 con 0x7f0c280ffb50 2024-09-13T17:00:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.791+0000 7f0c27200640 1 -- 172.21.15.18:0/3403613786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c28072bd0 con 0x7f0c280ffb50 2024-09-13T17:00:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.794+0000 7f0c2fa39740 1 Processor -- start 2024-09-13T17:00:51.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c2fa39740 1 -- start start 2024-09-13T17:00:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b22678c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678c5c0 0x55b226791080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b226791650 0x55b226793b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b226697bb0 con 0x55b22678c5c0 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2266f5a70 con 0x55b22678bc80 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2266f3200 con 0x55b226791650 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c26800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b22678c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c26800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b22678c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:58908/0 (socket says 172.21.15.18:58908) 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c26800640 1 -- 172.21.15.18:0/512508426 learned_addr learned my addr 172.21.15.18:0/512508426 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c25400640 1 --2- 172.21.15.18:0/512508426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b226791650 0x55b226793b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.795+0000 7f0c26800640 1 -- 172.21.15.18:0/512508426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b226791650 msgr2=0x55b226793b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.796+0000 7f0c26800640 1 --2- 172.21.15.18:0/512508426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b226791650 0x55b226793b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.796+0000 7f0c26800640 1 -- 172.21.15.18:0/512508426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678c5c0 msgr2=0x55b226791080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:00:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.796+0000 7f0c26800640 1 --2- 172.21.15.18:0/512508426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678c5c0 0x55b226791080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.796+0000 7f0c26800640 1 -- 172.21.15.18:0/512508426 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b226690940 con 0x55b22678bc80 2024-09-13T17:00:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.796+0000 7f0c26800640 1 --2- 172.21.15.18:0/512508426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b22678c080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009630 tx=0x7f0c20009af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf60422c13b2b7dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.796+0000 7f0c1ea00640 1 -- 172.21.15.18:0/3403613786 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0c180035f0 con 0x7f0c280ffb50 2024-09-13T17:00:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.796+0000 7f0c13400640 1 -- 172.21.15.18:0/512508426 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2001d070 con 0x55b22678bc80 2024-09-13T17:00:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.796+0000 7f0c13400640 1 -- 172.21.15.18:0/512508426 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c200100d0 con 0x55b22678bc80 2024-09-13T17:00:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.796+0000 7f0c13400640 1 -- 172.21.15.18:0/512508426 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c20015040 con 0x55b22678bc80 2024-09-13T17:00:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.797+0000 7f0c2fa39740 1 -- 172.21.15.18:0/512508426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 msgr2=0x55b22678c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.797+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/512508426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b22678c080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009630 tx=0x7f0c20009af0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.797+0000 7f0c2fa39740 1 -- 172.21.15.18:0/512508426 shutdown_connections 2024-09-13T17:00:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.797+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/512508426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678c5c0 0x55b226791080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.797+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/512508426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b226791650 0x55b226793b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.797+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/512508426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b22678c080 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.797+0000 7f0c2fa39740 1 -- 172.21.15.18:0/512508426 >> 172.21.15.18:0/512508426 conn(0x55b2267872f0 msgr2=0x55b2267876f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.797+0000 7f0c2fa39740 1 -- 172.21.15.18:0/512508426 shutdown_connections 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.797+0000 7f0c2fa39740 1 -- 172.21.15.18:0/512508426 wait complete. 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.798+0000 7f0c2fa39740 1 -- start start 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.798+0000 7f0c2fa39740 1 Processor -- start 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.798+0000 7f0c1ea00640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c0c0a1040 0x7f0c0c0a3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.798+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 0x55b226795970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c1ea00640 1 -- 172.21.15.18:0/3403613786 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0c18014070 con 0x7f0c280ffb50 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b226795eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b226791650 0x55b22679cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2266eeaf0 con 0x55b22678bc80 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2266acf20 con 0x55b226791650 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2266acbc0 con 0x55b22678c5c0 2024-09-13T17:00:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c2fa39740 10 client.0 _ll_register_callbacks cb 0x55b2266dea70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c26800640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c0c0a1040 0x7f0c0c0a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 0x55b226795970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c25400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b226795eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c25400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b226795eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:37926/0 (socket says 172.21.15.18:37926) 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c25400640 1 -- 172.21.15.18:0/1239898517 learned_addr learned my addr 172.21.15.18:0/1239898517 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.799+0000 7f0c26800640 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b226791650 0x55b22679cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.800+0000 7f0c25400640 1 -- 172.21.15.18:0/1239898517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b226791650 msgr2=0x55b22679cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.800+0000 7f0c25400640 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b226791650 0x55b22679cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.800+0000 7f0c25400640 1 -- 172.21.15.18:0/1239898517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 msgr2=0x55b226795970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.800+0000 7f0c25400640 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 0x55b226795970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.800+0000 7f0c25400640 1 -- 172.21.15.18:0/1239898517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c20010e30 con 0x55b22678c5c0 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.800+0000 7f0c26800640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c0c0a1040 0x7f0c0c0a3500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000e980 tx=0x7f0c20010580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.800+0000 7f0c25e00640 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 0x55b226795970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:00:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.800+0000 7f0c25400640 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b226795eb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c1402a9e0 tx=0x7f0c14004510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32ce1edd2960ba4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.800+0000 7f0c07e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:00:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.801+0000 7f0c07e00640 1 -- 172.21.15.18:0/1239898517 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c14003a80 con 0x55b22678c5c0 2024-09-13T17:00:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.801+0000 7f0c07e00640 1 -- 172.21.15.18:0/1239898517 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0c14003be0 con 0x55b22678c5c0 2024-09-13T17:00:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.801+0000 7f0c2fa39740 1 -- 172.21.15.18:0/1239898517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b226718c90 con 0x55b22678c5c0 2024-09-13T17:00:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.801+0000 7f0c07e00640 1 -- 172.21.15.18:0/1239898517 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c14003da0 con 0x55b22678c5c0 2024-09-13T17:00:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.801+0000 7f0c2fa39740 10 client.25822 fetch_fsmap learned FSMap version 35 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.801+0000 7f0c2fa39740 1 -- 172.21.15.18:0/1239898517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55b2266ed170 con 0x55b22678c5c0 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.801+0000 7f0c07e00640 1 -- 172.21.15.18:0/1239898517 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b226718c90 con 0x55b22678c5c0 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.802+0000 7f0c07e00640 1 -- 172.21.15.18:0/1239898517 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0c140456b0 con 0x55b22678c5c0 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.802+0000 7f0c2fa39740 10 client.25822 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.802+0000 7f0c2fa39740 10 client.25822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.802+0000 7f0c2fa39740 20 client.25822 populate_metadata read hostname 'smithi018' 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.802+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b2267a1610 0x55b2267a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.802+0000 7f0c2fa39740 4 client.25822 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.802+0000 7f0c2fa39740 1 -- 172.21.15.18:0/1239898517 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2266e17d0 con 0x55b2267a1610 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.802+0000 7f0c25e00640 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b2267a1610 0x55b2267a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.802+0000 7f0c25e00640 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b2267a1610 0x55b2267a3a30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e8eade3583a0f42 server_cookie=948acc6776ba7054 in_seq=0 out_seq=0 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.802+0000 7f0c07e00640 10 client.25822 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.803+0000 7f0c07e00640 1 -- 172.21.15.18:0/1239898517 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b2266e17d0 con 0x55b2267a1610 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.803+0000 7f0c07e00640 10 client.25822 handle_command_reply: tid=0 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.803+0000 7f0c2fa39740 1 client.25822 shutdown 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.803+0000 7f0c2fa39740 1 -- 172.21.15.18:0/1239898517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 msgr2=0x55b226795eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.803+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b226795eb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c1402a9e0 tx=0x7f0c14004510 comp rx=0 tx=0).stop 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.804+0000 7f0c2fa39740 1 -- 172.21.15.18:0/1239898517 shutdown_connections 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.804+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b2267a1610 0x55b2267a3a30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.804+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b226791650 0x55b22679cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.804+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b226795eb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.804+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/1239898517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 0x55b226795970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.804+0000 7f0c07e00640 0 client.25822 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.804+0000 7f0c2fa39740 1 -- 172.21.15.18:0/1239898517 >> 172.21.15.18:0/1239898517 conn(0x55b2267872f0 msgr2=0x55b226788b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.804+0000 7f0c2fa39740 1 -- 172.21.15.18:0/1239898517 shutdown_connections 2024-09-13T17:00:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.804+0000 7f0c2fa39740 1 -- 172.21.15.18:0/1239898517 wait complete. 2024-09-13T17:00:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.804+0000 7f0c2fa39740 20 client.25822 trim_cache size 0 max 16384 2024-09-13T17:00:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.820+0000 7f0c2fa39740 1 Processor -- start 2024-09-13T17:00:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.820+0000 7f0c2fa39740 1 -- start start 2024-09-13T17:00:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.820+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b226786c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.820+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678c5c0 0x55b22679ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.820+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b226791650 0x55b226795950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.820+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b226455e60 con 0x55b22678c5c0 2024-09-13T17:00:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.820+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b226781940 con 0x55b22678bc80 2024-09-13T17:00:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.820+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b22678caa0 con 0x55b226791650 2024-09-13T17:00:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b226786c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b226786c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:58928/0 (socket says 172.21.15.18:58928) 2024-09-13T17:00:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25e00640 1 -- 172.21.15.18:0/3969525549 learned_addr learned my addr 172.21.15.18:0/3969525549 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c26800640 1 --2- 172.21.15.18:0/3969525549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b226791650 0x55b226795950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25400640 1 --2- 172.21.15.18:0/3969525549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678c5c0 0x55b22679ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25e00640 1 -- 172.21.15.18:0/3969525549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b226791650 msgr2=0x55b226795950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25e00640 1 --2- 172.21.15.18:0/3969525549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b226791650 0x55b226795950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25e00640 1 -- 172.21.15.18:0/3969525549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678c5c0 msgr2=0x55b22679ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25e00640 1 --2- 172.21.15.18:0/3969525549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678c5c0 0x55b22679ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25e00640 1 -- 172.21.15.18:0/3969525549 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b22668f180 con 0x55b22678bc80 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25400640 1 --2- 172.21.15.18:0/3969525549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678c5c0 0x55b22679ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c25e00640 1 --2- 172.21.15.18:0/3969525549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b226786c70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800c6a0 tx=0x7f0c18000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf6016ac9d643891 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.821+0000 7f0c13e00640 1 -- 172.21.15.18:0/3969525549 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1809df60 con 0x55b22678bc80 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.822+0000 7f0c13e00640 1 -- 172.21.15.18:0/3969525549 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c18082070 con 0x55b22678bc80 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.822+0000 7f0c13e00640 1 -- 172.21.15.18:0/3969525549 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c180a2340 con 0x55b22678bc80 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.822+0000 7f0c2fa39740 1 -- 172.21.15.18:0/3969525549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 msgr2=0x55b226786c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.822+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/3969525549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b226786c70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800c6a0 tx=0x7f0c18000bc0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.822+0000 7f0c2fa39740 1 -- 172.21.15.18:0/3969525549 shutdown_connections 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.822+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/3969525549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678c5c0 0x55b22679ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.822+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/3969525549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b226791650 0x55b226795950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.822+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/3969525549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b22678bc80 0x55b226786c70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.822+0000 7f0c2fa39740 1 -- 172.21.15.18:0/3969525549 >> 172.21.15.18:0/3969525549 conn(0x55b2267872f0 msgr2=0x55b22678d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.822+0000 7f0c2fa39740 1 -- 172.21.15.18:0/3969525549 shutdown_connections 2024-09-13T17:00:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.823+0000 7f0c2fa39740 1 -- 172.21.15.18:0/3969525549 wait complete. 2024-09-13T17:00:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.823+0000 7f0c2fa39740 1 -- start start 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.823+0000 7f0c2fa39740 1 Processor -- start 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.823+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 0x55b22679c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.823+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b22679ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.823+0000 7f0c2fa39740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b226791650 0x55b226799210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.823+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b226799910 con 0x55b22678bc80 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.823+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b226799a80 con 0x55b226791650 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.823+0000 7f0c2fa39740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b226799c40 con 0x55b22678c5c0 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c2fa39740 10 client.0 _ll_register_callbacks cb 0x7f0c20010c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b22679ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b22679ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:37938/0 (socket says 172.21.15.18:37938) 2024-09-13T17:00:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25400640 1 -- 172.21.15.18:0/743667769 learned_addr learned my addr 172.21.15.18:0/743667769 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c26800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b226791650 0x55b226799210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25e00640 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 0x55b22679c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25400640 1 -- 172.21.15.18:0/743667769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b226791650 msgr2=0x55b226799210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25400640 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b226791650 0x55b226799210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25400640 1 -- 172.21.15.18:0/743667769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 msgr2=0x55b22679c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25400640 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 0x55b22679c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25400640 1 -- 172.21.15.18:0/743667769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c28072bd0 con 0x55b22678c5c0 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25e00640 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 0x55b22679c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c25400640 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b22679ccb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c14031500 tx=0x7f0c140456b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e82f7b3de9ce1a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.824+0000 7f0c07e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c07e00640 1 -- 172.21.15.18:0/743667769 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c140458a0 con 0x55b22678c5c0 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c2fa39740 1 -- 172.21.15.18:0/743667769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c200100d0 con 0x55b22678c5c0 2024-09-13T17:00:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c07e00640 1 -- 172.21.15.18:0/743667769 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0c14000e40 con 0x55b22678c5c0 2024-09-13T17:00:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c07e00640 1 -- 172.21.15.18:0/743667769 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c14005850 con 0x55b22678c5c0 2024-09-13T17:00:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c2fa39740 10 client.25828 fetch_fsmap learned FSMap version 35 2024-09-13T17:00:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c2fa39740 1 -- 172.21.15.18:0/743667769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55b2266b4560 con 0x55b22678c5c0 2024-09-13T17:00:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c07e00640 1 -- 172.21.15.18:0/743667769 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c200100d0 con 0x55b22678c5c0 2024-09-13T17:00:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c07e00640 1 -- 172.21.15.18:0/743667769 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0c14003a80 con 0x55b22678c5c0 2024-09-13T17:00:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c2fa39740 10 client.25828 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:00:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c2fa39740 10 client.25828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:00:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.825+0000 7f0c2fa39740 20 client.25828 populate_metadata read hostname 'smithi018' 2024-09-13T17:00:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.826+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b2267f8fc0 0x55b2267fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.826+0000 7f0c2fa39740 4 client.25828 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:00:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.826+0000 7f0c2fa39740 1 -- 172.21.15.18:0/743667769 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b2263e2300 con 0x55b2267f8fc0 2024-09-13T17:00:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.826+0000 7f0c25e00640 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b2267f8fc0 0x55b2267fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.826+0000 7f0c07e00640 10 client.25828 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:51.826+0000 7f0c25e00640 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b2267f8fc0 0x55b2267fb3e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd46a2dd5bc64276 server_cookie=dbb96b03e55f6d07 in_seq=0 out_seq=0 2024-09-13T17:00:53.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:53 smithi018 ceph-mon[30981]: pgmap v644: 129 pgs: 129 active+clean; 810 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 703 op/s 2024-09-13T17:00:53.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:53 smithi144 ceph-mon[35328]: pgmap v644: 129 pgs: 129 active+clean; 810 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 703 op/s 2024-09-13T17:00:53.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:53 smithi094 ceph-mon[35259]: pgmap v644: 129 pgs: 129 active+clean; 810 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 703 op/s 2024-09-13T17:00:54.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.821+0000 7f0c07e00640 1 -- 172.21.15.18:0/743667769 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b2263e2300 con 0x55b2267f8fc0 2024-09-13T17:00:54.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.821+0000 7f0c07e00640 10 client.25828 handle_command_reply: tid=0 2024-09-13T17:00:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.821+0000 7f0c2fa39740 1 client.25828 shutdown 2024-09-13T17:00:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.822+0000 7f0c2fa39740 1 -- 172.21.15.18:0/743667769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 msgr2=0x55b22679ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.822+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b22679ccb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c14031500 tx=0x7f0c140456b0 comp rx=0 tx=0).stop 2024-09-13T17:00:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.822+0000 7f0c2fa39740 1 -- 172.21.15.18:0/743667769 shutdown_connections 2024-09-13T17:00:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.822+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x55b2267f8fc0 0x55b2267fb3e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.822+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b226791650 0x55b226799210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.822+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b22678c5c0 0x55b22679ccb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:54.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.822+0000 7f0c2fa39740 1 --2- 172.21.15.18:0/743667769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b22678bc80 0x55b22679c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:54.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.822+0000 7f0c2fa39740 1 -- 172.21.15.18:0/743667769 >> 172.21.15.18:0/743667769 conn(0x55b2267872f0 msgr2=0x55b226795950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:54.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.822+0000 7f0c07e00640 0 client.25828 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:00:54.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.823+0000 7f0c2fa39740 1 -- 172.21.15.18:0/743667769 shutdown_connections 2024-09-13T17:00:54.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.823+0000 7f0c2fa39740 1 -- 172.21.15.18:0/743667769 wait complete. 2024-09-13T17:00:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.823+0000 7f0c2fa39740 20 client.25828 trim_cache size 0 max 16384 2024-09-13T17:00:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T17:00:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T17:00:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T17:00:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T17:00:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.825+0000 7f0c27200640 1 -- 172.21.15.18:0/3403613786 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c0c0a1040 msgr2=0x7f0c0c0a3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.825+0000 7f0c27200640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c0c0a1040 0x7f0c0c0a3500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000e980 tx=0x7f0c20010580 comp rx=0 tx=0).stop 2024-09-13T17:00:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.826+0000 7f0c27200640 1 -- 172.21.15.18:0/3403613786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c280ffb50 msgr2=0x7f0c28195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.826+0000 7f0c27200640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c280ffb50 0x7f0c28195aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800e9c0 tx=0x7f0c1800ee80 comp rx=0 tx=0).stop 2024-09-13T17:00:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.826+0000 7f0c27200640 1 -- 172.21.15.18:0/3403613786 shutdown_connections 2024-09-13T17:00:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.826+0000 7f0c27200640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0c0c0a1040 0x7f0c0c0a3500 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.826+0000 7f0c27200640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c28100d40 0x7f0c28195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.826+0000 7f0c27200640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0c28101700 0x7f0c2819d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.826+0000 7f0c27200640 1 --2- 172.21.15.18:0/3403613786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c280ffb50 0x7f0c28195aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.826+0000 7f0c27200640 1 -- 172.21.15.18:0/3403613786 >> 172.21.15.18:0/3403613786 conn(0x7f0c280fb2f0 msgr2=0x7f0c28104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.827+0000 7f0c27200640 1 -- 172.21.15.18:0/3403613786 shutdown_connections 2024-09-13T17:00:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:00:54.827+0000 7f0c27200640 1 -- 172.21.15.18:0/3403613786 wait complete. 2024-09-13T17:00:55.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:55 smithi018 ceph-mon[30981]: pgmap v645: 129 pgs: 129 active+clean; 805 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 548 op/s 2024-09-13T17:00:55.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:55 smithi144 ceph-mon[35328]: pgmap v645: 129 pgs: 129 active+clean; 805 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 548 op/s 2024-09-13T17:00:55.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:55 smithi094 ceph-mon[35259]: pgmap v645: 129 pgs: 129 active+clean; 805 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 548 op/s 2024-09-13T17:00:57.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:57 smithi018 ceph-mon[30981]: pgmap v646: 129 pgs: 129 active+clean; 800 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 760 op/s 2024-09-13T17:00:57.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:57 smithi144 ceph-mon[35328]: pgmap v646: 129 pgs: 129 active+clean; 800 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 760 op/s 2024-09-13T17:00:57.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:57 smithi094 ceph-mon[35259]: pgmap v646: 129 pgs: 129 active+clean; 800 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 760 op/s 2024-09-13T17:00:59.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:00:59 smithi018 ceph-mon[30981]: pgmap v647: 129 pgs: 129 active+clean; 781 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 1.02k op/s 2024-09-13T17:00:59.463 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:00:59 smithi094 ceph-mon[35259]: pgmap v647: 129 pgs: 129 active+clean; 781 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 1.02k op/s 2024-09-13T17:00:59.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:00:59 smithi144 ceph-mon[35328]: pgmap v647: 129 pgs: 129 active+clean; 781 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 1.02k op/s 2024-09-13T17:01:01.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:01 smithi018 ceph-mon[30981]: pgmap v648: 129 pgs: 129 active+clean; 772 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 989 KiB/s wr, 974 op/s 2024-09-13T17:01:01.493 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:01 smithi094 ceph-mon[35259]: pgmap v648: 129 pgs: 129 active+clean; 772 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 989 KiB/s wr, 974 op/s 2024-09-13T17:01:01.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:01 smithi144 ceph-mon[35328]: pgmap v648: 129 pgs: 129 active+clean; 772 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 989 KiB/s wr, 974 op/s 2024-09-13T17:01:03.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:03 smithi018 ceph-mon[30981]: pgmap v649: 129 pgs: 129 active+clean; 757 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 996 KiB/s wr, 990 op/s 2024-09-13T17:01:03.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:03 smithi144 ceph-mon[35328]: pgmap v649: 129 pgs: 129 active+clean; 757 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 996 KiB/s wr, 990 op/s 2024-09-13T17:01:03.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:03 smithi094 ceph-mon[35259]: pgmap v649: 129 pgs: 129 active+clean; 757 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 996 KiB/s wr, 990 op/s 2024-09-13T17:01:05.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:05 smithi144 ceph-mon[35328]: pgmap v650: 129 pgs: 129 active+clean; 748 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 910 KiB/s wr, 953 op/s 2024-09-13T17:01:05.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:05 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:05.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:05 smithi094 ceph-mon[35259]: pgmap v650: 129 pgs: 129 active+clean; 748 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 910 KiB/s wr, 953 op/s 2024-09-13T17:01:05.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:05 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:05.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:05 smithi018 ceph-mon[30981]: pgmap v650: 129 pgs: 129 active+clean; 748 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 910 KiB/s wr, 953 op/s 2024-09-13T17:01:05.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:05 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:06.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:06.558 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:06.558 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:06 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T17:01:06.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:06.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:06.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:06 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T17:01:06.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:06.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:06.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:06 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T17:01:07.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:07 smithi018 ceph-mon[30981]: pgmap v651: 129 pgs: 129 active+clean; 740 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 887 op/s 2024-09-13T17:01:07.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:07 smithi144 ceph-mon[35328]: pgmap v651: 129 pgs: 129 active+clean; 740 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 887 op/s 2024-09-13T17:01:07.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:07 smithi094 ceph-mon[35259]: pgmap v651: 129 pgs: 129 active+clean; 740 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 887 op/s 2024-09-13T17:01:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.961+0000 7fe928c00640 1 -- 172.21.15.18:0/249498678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe924101240 msgr2=0x7fe924101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.961+0000 7fe928c00640 1 --2- 172.21.15.18:0/249498678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe924101240 0x7fe924101640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe914009900 tx=0x7fe91402a3f0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.962+0000 7fe928c00640 1 -- 172.21.15.18:0/249498678 shutdown_connections 2024-09-13T17:01:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.962+0000 7fe928c00640 1 --2- 172.21.15.18:0/249498678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9240ff770 0x7fe9240ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.962+0000 7fe928c00640 1 --2- 172.21.15.18:0/249498678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe924100130 0x7fe924107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.962+0000 7fe928c00640 1 --2- 172.21.15.18:0/249498678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe924101240 0x7fe924101640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.962+0000 7fe928c00640 1 -- 172.21.15.18:0/249498678 >> 172.21.15.18:0/249498678 conn(0x7fe9240fb2c0 msgr2=0x7fe9240fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.962+0000 7fe928c00640 1 -- 172.21.15.18:0/249498678 shutdown_connections 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.962+0000 7fe928c00640 1 -- 172.21.15.18:0/249498678 wait complete. 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe928c00640 1 Processor -- start 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe928c00640 1 -- start start 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe928c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9240ff770 0x7fe924195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe928c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe924100130 0x7fe924196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe928c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe924101240 0x7fe92419d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe928c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92419d6c0 con 0x7fe9240ff770 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe928c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92419d830 con 0x7fe924100130 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe928c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92419d9f0 con 0x7fe924101240 2024-09-13T17:01:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe923400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9240ff770 0x7fe924195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe922a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe924100130 0x7fe924196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe922a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe924100130 0x7fe924196110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:51256/0 (socket says 172.21.15.18:51256) 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe922a00640 1 -- 172.21.15.18:0/176277259 learned_addr learned my addr 172.21.15.18:0/176277259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe923400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9240ff770 0x7fe924195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50764/0 (socket says 172.21.15.18:50764) 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.963+0000 7fe923e00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe924101240 0x7fe92419d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe922a00640 1 -- 172.21.15.18:0/176277259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe924101240 msgr2=0x7fe92419d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe922a00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe924101240 0x7fe92419d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe922a00640 1 -- 172.21.15.18:0/176277259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9240ff770 msgr2=0x7fe924195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe922a00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9240ff770 0x7fe924195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe922a00640 1 -- 172.21.15.18:0/176277259 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914009560 con 0x7fe924100130 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe922a00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe924100130 0x7fe924196110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe91000e9f0 tx=0x7fe91000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe91be00640 1 -- 172.21.15.18:0/176277259 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910009700 con 0x7fe924100130 2024-09-13T17:01:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe91be00640 1 -- 172.21.15.18:0/176277259 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe91000cd80 con 0x7fe924100130 2024-09-13T17:01:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe91be00640 1 -- 172.21.15.18:0/176277259 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910018860 con 0x7fe924100130 2024-09-13T17:01:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe928c00640 1 -- 172.21.15.18:0/176277259 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92419dcd0 con 0x7fe924100130 2024-09-13T17:01:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.964+0000 7fe928c00640 1 -- 172.21.15.18:0/176277259 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92419e190 con 0x7fe924100130 2024-09-13T17:01:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.967+0000 7fe92d03f740 1 Processor -- start 2024-09-13T17:01:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.967+0000 7fe91be00640 1 -- 172.21.15.18:0/176277259 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe9100189c0 con 0x7fe924100130 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.967+0000 7fe92d03f740 1 -- start start 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930ec80 0x56477930f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779314080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564779314650 0x564779316b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe92d03f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56477921abb0 con 0x564779314650 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe92d03f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x564779278a70 con 0x56477930ec80 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe92d03f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564779276200 con 0x56477930f5c0 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe923e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930ec80 0x56477930f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe923e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930ec80 0x56477930f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:51272/0 (socket says 172.21.15.18:51272) 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe923e00640 1 -- 172.21.15.18:0/946049417 learned_addr learned my addr 172.21.15.18:0/946049417 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe923400640 1 --2- 172.21.15.18:0/946049417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779314080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe922a00640 1 --2- 172.21.15.18:0/946049417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564779314650 0x564779316b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe923e00640 1 -- 172.21.15.18:0/946049417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 msgr2=0x564779314080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe923e00640 1 --2- 172.21.15.18:0/946049417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779314080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe923e00640 1 -- 172.21.15.18:0/946049417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564779314650 msgr2=0x564779316b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.968+0000 7fe923e00640 1 --2- 172.21.15.18:0/946049417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564779314650 0x564779316b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.969+0000 7fe923e00640 1 -- 172.21.15.18:0/946049417 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564779213940 con 0x56477930ec80 2024-09-13T17:01:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.969+0000 7fe922a00640 1 --2- 172.21.15.18:0/946049417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564779314650 0x564779316b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:01:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.969+0000 7fe923e00640 1 --2- 172.21.15.18:0/946049417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930ec80 0x56477930f080 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009fd0 tx=0x7fe91c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=975ac999b56a7b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.969+0000 7fe91be00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe9080a11b0 0x7fe9080a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.969+0000 7fe918c00640 1 -- 172.21.15.18:0/946049417 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c004d20 con 0x56477930ec80 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.969+0000 7fe918c00640 1 -- 172.21.15.18:0/946049417 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe91c004e80 con 0x56477930ec80 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.969+0000 7fe918c00640 1 -- 172.21.15.18:0/946049417 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c005280 con 0x56477930ec80 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.969+0000 7fe91be00640 1 -- 172.21.15.18:0/176277259 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fe910014070 con 0x7fe924100130 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.969+0000 7fe923400640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe9080a11b0 0x7fe9080a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.970+0000 7fe92d03f740 1 -- 172.21.15.18:0/946049417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930ec80 msgr2=0x56477930f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.970+0000 7fe92d03f740 1 --2- 172.21.15.18:0/946049417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930ec80 0x56477930f080 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009fd0 tx=0x7fe91c0118d0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.970+0000 7fe92d03f740 1 -- 172.21.15.18:0/946049417 shutdown_connections 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.970+0000 7fe92d03f740 1 --2- 172.21.15.18:0/946049417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564779314650 0x564779316b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.970+0000 7fe92d03f740 1 --2- 172.21.15.18:0/946049417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779314080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.970+0000 7fe92d03f740 1 --2- 172.21.15.18:0/946049417 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930ec80 0x56477930f080 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.970+0000 7fe92d03f740 1 -- 172.21.15.18:0/946049417 >> 172.21.15.18:0/946049417 conn(0x56477930a2f0 msgr2=0x56477930a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.970+0000 7fe923400640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe9080a11b0 0x7fe9080a3670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe914031500 tx=0x7fe914005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.970+0000 7fe92d03f740 1 -- 172.21.15.18:0/946049417 shutdown_connections 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.970+0000 7fe92d03f740 1 -- 172.21.15.18:0/946049417 wait complete. 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe92d03f740 1 -- start start 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe92d03f740 1 Processor -- start 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x564779311210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930f5c0 0x564779311750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564779314650 0x5647793126c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe92d03f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x564779271af0 con 0x56477930ec80 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe92d03f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56477922ff20 con 0x56477930f5c0 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe92d03f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56477922fbc0 con 0x564779314650 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe92d03f740 10 client.0 _ll_register_callbacks cb 0x564779261a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe922a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930f5c0 0x564779311750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe923e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564779314650 0x5647793126c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe922a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930f5c0 0x564779311750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:51274/0 (socket says 172.21.15.18:51274) 2024-09-13T17:01:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe922a00640 1 -- 172.21.15.18:0/500470645 learned_addr learned my addr 172.21.15.18:0/500470645 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.971+0000 7fe923400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x564779311210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.972+0000 7fe923e00640 1 -- 172.21.15.18:0/500470645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930f5c0 msgr2=0x564779311750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.972+0000 7fe923e00640 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930f5c0 0x564779311750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.972+0000 7fe923e00640 1 -- 172.21.15.18:0/500470645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 msgr2=0x564779311210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.972+0000 7fe923e00640 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x564779311210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.972+0000 7fe923e00640 1 -- 172.21.15.18:0/500470645 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91c009c80 con 0x564779314650 2024-09-13T17:01:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.972+0000 7fe923e00640 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564779314650 0x5647793126c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe91c01b040 tx=0x7fe91c004280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2372991a6379372c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.972+0000 7fe90d600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:01:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.972+0000 7fe90d600640 1 -- 172.21.15.18:0/500470645 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c003e40 con 0x564779314650 2024-09-13T17:01:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.972+0000 7fe92d03f740 1 -- 172.21.15.18:0/500470645 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647792647d0 con 0x564779314650 2024-09-13T17:01:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.972+0000 7fe90d600640 1 -- 172.21.15.18:0/500470645 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fe91c00f4e0 con 0x564779314650 2024-09-13T17:01:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe90d600640 1 -- 172.21.15.18:0/500470645 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe91c00f6a0 con 0x564779314650 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe92d03f740 10 client.25840 fetch_fsmap learned FSMap version 35 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe92d03f740 1 -- 172.21.15.18:0/500470645 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564779270170 con 0x564779314650 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe90d600640 1 -- 172.21.15.18:0/500470645 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5647792647d0 con 0x564779314650 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe90d600640 1 -- 172.21.15.18:0/500470645 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fe91c021040 con 0x564779314650 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe92d03f740 10 client.25840 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe92d03f740 10 client.25840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe92d03f740 20 client.25840 populate_metadata read hostname 'smithi018' 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe92d03f740 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56477932cc60 0x56477932f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe92d03f740 4 client.25840 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.973+0000 7fe92d03f740 1 -- 172.21.15.18:0/500470645 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564778f65300 con 0x56477932cc60 2024-09-13T17:01:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.974+0000 7fe923400640 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56477932cc60 0x56477932f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.974+0000 7fe923400640 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56477932cc60 0x56477932f080 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a21c491f55a36b8 server_cookie=1d8b22b4bcfb0747 in_seq=0 out_seq=0 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.974+0000 7fe90d600640 10 client.25840 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.975+0000 7fe90d600640 1 -- 172.21.15.18:0/500470645 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564778f65300 con 0x56477932cc60 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.975+0000 7fe90d600640 10 client.25840 handle_command_reply: tid=0 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 client.25840 shutdown 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 -- 172.21.15.18:0/500470645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564779314650 msgr2=0x5647793126c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564779314650 0x5647793126c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe91c01b040 tx=0x7fe91c004280 comp rx=0 tx=0).stop 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 -- 172.21.15.18:0/500470645 shutdown_connections 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56477932cc60 0x56477932f080 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564779314650 0x5647793126c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe90d600640 0 client.25840 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56477930f5c0 0x564779311750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 --2- 172.21.15.18:0/500470645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x564779311210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 -- 172.21.15.18:0/500470645 >> 172.21.15.18:0/500470645 conn(0x56477930a2f0 msgr2=0x56477930bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 -- 172.21.15.18:0/500470645 shutdown_connections 2024-09-13T17:01:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 1 -- 172.21.15.18:0/500470645 wait complete. 2024-09-13T17:01:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.976+0000 7fe92d03f740 20 client.25840 trim_cache size 0 max 16384 2024-09-13T17:01:07.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.990+0000 7fe92d03f740 1 Processor -- start 2024-09-13T17:01:07.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.990+0000 7fe92d03f740 1 -- start start 2024-09-13T17:01:07.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.990+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x564779316a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.990+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779311210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.990+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 0x564779311750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.990+0000 7fe92d03f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x564778fd8e60 con 0x56477930ec80 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.990+0000 7fe92d03f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x564778f65300 con 0x564779314650 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.990+0000 7fe92d03f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56477930e800 con 0x56477930f5c0 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.990+0000 7fe923e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 0x564779311750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe923e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 0x564779311750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:51278/0 (socket says 172.21.15.18:51278) 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe923e00640 1 -- 172.21.15.18:0/352043861 learned_addr learned my addr 172.21.15.18:0/352043861 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe923400640 1 --2- 172.21.15.18:0/352043861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x564779316a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe922a00640 1 --2- 172.21.15.18:0/352043861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779311210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe923e00640 1 -- 172.21.15.18:0/352043861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 msgr2=0x564779311210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:07.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe923e00640 1 --2- 172.21.15.18:0/352043861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779311210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe923e00640 1 -- 172.21.15.18:0/352043861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 msgr2=0x564779316a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe923e00640 1 --2- 172.21.15.18:0/352043861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x564779316a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe923e00640 1 -- 172.21.15.18:0/352043861 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564779212180 con 0x564779314650 2024-09-13T17:01:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe923e00640 1 --2- 172.21.15.18:0/352043861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 0x564779311750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe91c005d70 tx=0x7fe91c011f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=924d486dd6699b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe919600640 1 -- 172.21.15.18:0/352043861 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c009ea0 con 0x564779314650 2024-09-13T17:01:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe919600640 1 -- 172.21.15.18:0/352043861 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe91c005410 con 0x564779314650 2024-09-13T17:01:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.991+0000 7fe919600640 1 -- 172.21.15.18:0/352043861 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c003e80 con 0x564779314650 2024-09-13T17:01:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 -- 172.21.15.18:0/352043861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 msgr2=0x564779311750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 --2- 172.21.15.18:0/352043861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 0x564779311750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe91c005d70 tx=0x7fe91c011f00 comp rx=0 tx=0).stop 2024-09-13T17:01:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 -- 172.21.15.18:0/352043861 shutdown_connections 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 --2- 172.21.15.18:0/352043861 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 0x564779311750 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 --2- 172.21.15.18:0/352043861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779311210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 --2- 172.21.15.18:0/352043861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x564779316a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 -- 172.21.15.18:0/352043861 >> 172.21.15.18:0/352043861 conn(0x56477930a2f0 msgr2=0x56477931afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 -- 172.21.15.18:0/352043861 shutdown_connections 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 -- 172.21.15.18:0/352043861 wait complete. 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 -- start start 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.992+0000 7fe92d03f740 1 Processor -- start 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x5647793298a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779329de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe92d03f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 0x5647793263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe92d03f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647793269a0 con 0x56477930ec80 2024-09-13T17:01:07.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe92d03f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x564779326b10 con 0x564779314650 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe92d03f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564779326cd0 con 0x56477930f5c0 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe92d03f740 10 client.0 _ll_register_callbacks cb 0x7fe91c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe922a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779329de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe923400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x5647793298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe923e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 0x5647793263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe922a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779329de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:45192/0 (socket says 172.21.15.18:45192) 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe922a00640 1 -- 172.21.15.18:0/2662153630 learned_addr learned my addr 172.21.15.18:0/2662153630 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe922a00640 1 -- 172.21.15.18:0/2662153630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 msgr2=0x5647793263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe922a00640 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 0x5647793263e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe922a00640 1 -- 172.21.15.18:0/2662153630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 msgr2=0x5647793298a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe922a00640 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x5647793298a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.993+0000 7fe922a00640 1 -- 172.21.15.18:0/2662153630 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564779270170 con 0x56477930f5c0 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.994+0000 7fe922a00640 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779329de0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe91000cfd0 tx=0x7fe910010ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34c52e6c27c168a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.994+0000 7fe90d600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.994+0000 7fe90d600640 1 -- 172.21.15.18:0/2662153630 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91009de30 con 0x56477930f5c0 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.994+0000 7fe92d03f740 1 -- 172.21.15.18:0/2662153630 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56477929bc90 con 0x56477930f5c0 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.994+0000 7fe90d600640 1 -- 172.21.15.18:0/2662153630 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fe9100a2480 con 0x56477930f5c0 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.994+0000 7fe90d600640 1 -- 172.21.15.18:0/2662153630 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9100967c0 con 0x56477930f5c0 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.994+0000 7fe92d03f740 10 client.25846 fetch_fsmap learned FSMap version 35 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.994+0000 7fe92d03f740 1 -- 172.21.15.18:0/2662153630 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564779237560 con 0x56477930f5c0 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.994+0000 7fe90d600640 1 -- 172.21.15.18:0/2662153630 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56477929bc90 con 0x56477930f5c0 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.994+0000 7fe90d600640 1 -- 172.21.15.18:0/2662153630 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fe9100a1ff0 con 0x56477930f5c0 2024-09-13T17:01:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.995+0000 7fe92d03f740 10 client.25846 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:01:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.995+0000 7fe92d03f740 10 client.25846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:01:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.995+0000 7fe92d03f740 20 client.25846 populate_metadata read hostname 'smithi018' 2024-09-13T17:01:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.995+0000 7fe92d03f740 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5647793847e0 0x564779386c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.995+0000 7fe92d03f740 4 client.25846 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:01:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.995+0000 7fe92d03f740 1 -- 172.21.15.18:0/2662153630 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564778f76600 con 0x5647793847e0 2024-09-13T17:01:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.995+0000 7fe923400640 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5647793847e0 0x564779386c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.995+0000 7fe923400640 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5647793847e0 0x564779386c00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50152b32fb3aee7c server_cookie=60f242b67e2c57f1 in_seq=0 out_seq=0 2024-09-13T17:01:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:07.995+0000 7fe90d600640 10 client.25846 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.766+0000 7fe90d600640 1 -- 172.21.15.18:0/2662153630 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564778f76600 con 0x5647793847e0 2024-09-13T17:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.766+0000 7fe90d600640 10 client.25846 handle_command_reply: tid=0 2024-09-13T17:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.766+0000 7fe92d03f740 1 client.25846 shutdown 2024-09-13T17:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.766+0000 7fe92d03f740 1 -- 172.21.15.18:0/2662153630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 msgr2=0x564779329de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.766+0000 7fe92d03f740 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779329de0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe91000cfd0 tx=0x7fe910010ea0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.767+0000 7fe92d03f740 1 -- 172.21.15.18:0/2662153630 shutdown_connections 2024-09-13T17:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.767+0000 7fe92d03f740 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5647793847e0 0x564779386c00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.767+0000 7fe92d03f740 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x564779314650 0x5647793263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.767+0000 7fe92d03f740 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56477930f5c0 0x564779329de0 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe91000cfd0 tx=0x7fe910010ea0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.767+0000 7fe92d03f740 1 --2- 172.21.15.18:0/2662153630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56477930ec80 0x5647793298a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.767+0000 7fe92d03f740 1 -- 172.21.15.18:0/2662153630 >> 172.21.15.18:0/2662153630 conn(0x56477930a2f0 msgr2=0x564779317980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.767+0000 7fe90d600640 0 client.25846 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.767+0000 7fe92d03f740 1 -- 172.21.15.18:0/2662153630 shutdown_connections 2024-09-13T17:01:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.767+0000 7fe92d03f740 1 -- 172.21.15.18:0/2662153630 wait complete. 2024-09-13T17:01:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.768+0000 7fe92d03f740 20 client.25846 trim_cache size 0 max 16384 2024-09-13T17:01:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T17:01:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T17:01:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T17:01:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T17:01:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.769+0000 7fe928c00640 1 -- 172.21.15.18:0/176277259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe9080a11b0 msgr2=0x7fe9080a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.769+0000 7fe928c00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe9080a11b0 0x7fe9080a3670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe914031500 tx=0x7fe914005780 comp rx=0 tx=0).stop 2024-09-13T17:01:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.769+0000 7fe928c00640 1 -- 172.21.15.18:0/176277259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe924100130 msgr2=0x7fe924196110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.769+0000 7fe928c00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe924100130 0x7fe924196110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe91000e9f0 tx=0x7fe91000eeb0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.769+0000 7fe928c00640 1 -- 172.21.15.18:0/176277259 shutdown_connections 2024-09-13T17:01:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.769+0000 7fe928c00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe924101240 0x7fe92419d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.769+0000 7fe928c00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe924100130 0x7fe924196110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.769+0000 7fe928c00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe9080a11b0 0x7fe9080a3670 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.769+0000 7fe928c00640 1 --2- 172.21.15.18:0/176277259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9240ff770 0x7fe924195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.769+0000 7fe928c00640 1 -- 172.21.15.18:0/176277259 >> 172.21.15.18:0/176277259 conn(0x7fe9240fb2c0 msgr2=0x7fe9240fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.771+0000 7fe928c00640 1 -- 172.21.15.18:0/176277259 shutdown_connections 2024-09-13T17:01:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:08.771+0000 7fe928c00640 1 -- 172.21.15.18:0/176277259 wait complete. 2024-09-13T17:01:09.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:09 smithi018 ceph-mon[30981]: pgmap v652: 129 pgs: 129 active+clean; 723 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 726 op/s 2024-09-13T17:01:09.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:09 smithi144 ceph-mon[35328]: pgmap v652: 129 pgs: 129 active+clean; 723 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 726 op/s 2024-09-13T17:01:09.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:09 smithi094 ceph-mon[35259]: pgmap v652: 129 pgs: 129 active+clean; 723 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 726 op/s 2024-09-13T17:01:11.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:11 smithi018 ceph-mon[30981]: pgmap v653: 129 pgs: 129 active+clean; 716 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 473 op/s 2024-09-13T17:01:11.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:11 smithi144 ceph-mon[35328]: pgmap v653: 129 pgs: 129 active+clean; 716 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 473 op/s 2024-09-13T17:01:11.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:11 smithi094 ceph-mon[35259]: pgmap v653: 129 pgs: 129 active+clean; 716 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 473 op/s 2024-09-13T17:01:13.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:13 smithi018 ceph-mon[30981]: pgmap v654: 129 pgs: 129 active+clean; 701 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 602 op/s 2024-09-13T17:01:13.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:13 smithi144 ceph-mon[35328]: pgmap v654: 129 pgs: 129 active+clean; 701 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 602 op/s 2024-09-13T17:01:13.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:13 smithi094 ceph-mon[35259]: pgmap v654: 129 pgs: 129 active+clean; 701 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 602 op/s 2024-09-13T17:01:15.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:15 smithi018 ceph-mon[30981]: pgmap v655: 129 pgs: 129 active+clean; 688 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 618 op/s 2024-09-13T17:01:15.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:15 smithi144 ceph-mon[35328]: pgmap v655: 129 pgs: 129 active+clean; 688 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 618 op/s 2024-09-13T17:01:15.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:15 smithi094 ceph-mon[35259]: pgmap v655: 129 pgs: 129 active+clean; 688 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 618 op/s 2024-09-13T17:01:17.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:17 smithi018 ceph-mon[30981]: pgmap v656: 129 pgs: 129 active+clean; 679 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 685 op/s 2024-09-13T17:01:17.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:17 smithi144 ceph-mon[35328]: pgmap v656: 129 pgs: 129 active+clean; 679 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 685 op/s 2024-09-13T17:01:17.911 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:17 smithi094 ceph-mon[35259]: pgmap v656: 129 pgs: 129 active+clean; 679 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 685 op/s 2024-09-13T17:01:19.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:19 smithi018 ceph-mon[30981]: pgmap v657: 129 pgs: 129 active+clean; 666 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 734 op/s 2024-09-13T17:01:19.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:19 smithi144 ceph-mon[35328]: pgmap v657: 129 pgs: 129 active+clean; 666 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 734 op/s 2024-09-13T17:01:19.913 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:19 smithi094 ceph-mon[35259]: pgmap v657: 129 pgs: 129 active+clean; 666 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 734 op/s 2024-09-13T17:01:21.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:20 smithi144 ceph-mon[35328]: pgmap v658: 129 pgs: 129 active+clean; 659 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 653 op/s 2024-09-13T17:01:21.411 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:20 smithi094 ceph-mon[35259]: pgmap v658: 129 pgs: 129 active+clean; 659 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 653 op/s 2024-09-13T17:01:21.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:20 smithi018 ceph-mon[30981]: pgmap v658: 129 pgs: 129 active+clean; 659 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 653 op/s 2024-09-13T17:01:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.970+0000 7f089b200640 1 -- 172.21.15.18:0/880700500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0894101700 msgr2=0x7f0894107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.970+0000 7f089b200640 1 --2- 172.21.15.18:0/880700500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0894101700 0x7f0894107f90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0890009be0 tx=0x7f089002a6d0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.971+0000 7f089b200640 1 -- 172.21.15.18:0/880700500 shutdown_connections 2024-09-13T17:01:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.971+0000 7f089b200640 1 --2- 172.21.15.18:0/880700500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0894100d40 0x7f08941011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.971+0000 7f089b200640 1 --2- 172.21.15.18:0/880700500 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0894101700 0x7f0894107f90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.971+0000 7f089b200640 1 --2- 172.21.15.18:0/880700500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08940ffb50 0x7f08940fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.971+0000 7f089b200640 1 -- 172.21.15.18:0/880700500 >> 172.21.15.18:0/880700500 conn(0x7f08940fb2f0 msgr2=0x7f08940fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.971+0000 7f089b200640 1 -- 172.21.15.18:0/880700500 shutdown_connections 2024-09-13T17:01:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.971+0000 7f089b200640 1 -- 172.21.15.18:0/880700500 wait complete. 2024-09-13T17:01:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.973+0000 7f089b200640 1 Processor -- start 2024-09-13T17:01:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.973+0000 7f089b200640 1 -- start start 2024-09-13T17:01:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.974+0000 7f089b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08940ffb50 0x7f089406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.974+0000 7f089b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0894100d40 0x7f089406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.975+0000 7f089b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0894101700 0x7f08941a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.975+0000 7f089a800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0894101700 0x7f08941a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.975+0000 7f089a800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0894101700 0x7f08941a7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:54606/0 (socket says 172.21.15.18:54606) 2024-09-13T17:01:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.975+0000 7f089a800640 1 -- 172.21.15.18:0/1558529888 learned_addr learned my addr 172.21.15.18:0/1558529888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.975+0000 7f0899e00640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08940ffb50 0x7f089406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.975+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0894072330 con 0x7f08940ffb50 2024-09-13T17:01:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.975+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08940724a0 con 0x7f0894101700 2024-09-13T17:01:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.975+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08941a83c0 con 0x7f0894100d40 2024-09-13T17:01:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.975+0000 7f0899400640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0894100d40 0x7f089406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.976+0000 7f089a800640 1 -- 172.21.15.18:0/1558529888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0894100d40 msgr2=0x7f089406f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.976+0000 7f089a800640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0894100d40 0x7f089406f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.976+0000 7f089a800640 1 -- 172.21.15.18:0/1558529888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08940ffb50 msgr2=0x7f089406eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.976+0000 7f089a800640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08940ffb50 0x7f089406eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.976+0000 7f089a800640 1 -- 172.21.15.18:0/1558529888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890009840 con 0x7f0894101700 2024-09-13T17:01:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.976+0000 7f0899400640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0894100d40 0x7f089406f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:01:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.976+0000 7f089a800640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0894101700 0x7f08941a7e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0890034040 tx=0x7f0890030ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.977+0000 7f088ea00640 1 -- 172.21.15.18:0/1558529888 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890004040 con 0x7f0894101700 2024-09-13T17:01:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.977+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08941a85c0 con 0x7f0894101700 2024-09-13T17:01:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.977+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08941a8ac0 con 0x7f0894101700 2024-09-13T17:01:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.977+0000 7f088ea00640 1 -- 172.21.15.18:0/1558529888 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0890004660 con 0x7f0894101700 2024-09-13T17:01:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.978+0000 7f088ea00640 1 -- 172.21.15.18:0/1558529888 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890031ae0 con 0x7f0894101700 2024-09-13T17:01:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.984+0000 7f088ea00640 1 -- 172.21.15.18:0/1558529888 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0890038070 con 0x7f0894101700 2024-09-13T17:01:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.984+0000 7f089f60c740 1 Processor -- start 2024-09-13T17:01:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.984+0000 7f089f60c740 1 -- start start 2024-09-13T17:01:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.985+0000 7f089f60c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c1c80 0x5561d99c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.986+0000 7f089f60c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 0x5561d99c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.986+0000 7f089f60c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c7650 0x5561d99c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.986+0000 7f089f60c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d98cdbb0 con 0x5561d99c1c80 2024-09-13T17:01:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.986+0000 7f089f60c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d992ba70 con 0x5561d99c7650 2024-09-13T17:01:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.986+0000 7f089f60c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d9929200 con 0x5561d99c25c0 2024-09-13T17:01:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.987+0000 7f0899400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c1c80 0x5561d99c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.988+0000 7f0899e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 0x5561d99c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.988+0000 7f0899400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c1c80 0x5561d99c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36736/0 (socket says 172.21.15.18:36736) 2024-09-13T17:01:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.988+0000 7f0899400640 1 -- 172.21.15.18:0/3567719244 learned_addr learned my addr 172.21.15.18:0/3567719244 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.989+0000 7f0899400640 1 --2- 172.21.15.18:0/3567719244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c7650 0x5561d99c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.989+0000 7f088ea00640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f087c0a1200 0x7f087c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.990+0000 7f088ea00640 1 -- 172.21.15.18:0/1558529888 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f08900ed2a0 con 0x7f0894101700 2024-09-13T17:01:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.990+0000 7f0899e00640 1 -- 172.21.15.18:0/3567719244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c7650 msgr2=0x5561d99c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.990+0000 7f0899e00640 1 --2- 172.21.15.18:0/3567719244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c7650 0x5561d99c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.990+0000 7f0899e00640 1 -- 172.21.15.18:0/3567719244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c1c80 msgr2=0x5561d99c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.990+0000 7f0899e00640 1 --2- 172.21.15.18:0/3567719244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c1c80 0x5561d99c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.990+0000 7f0899e00640 1 -- 172.21.15.18:0/3567719244 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561d98c6940 con 0x5561d99c25c0 2024-09-13T17:01:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.991+0000 7f089a800640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f087c0a1200 0x7f087c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.992+0000 7f0899e00640 1 --2- 172.21.15.18:0/3567719244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 0x5561d99c7080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0888005fd0 tx=0x7f08880117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=172cccdc9fc866a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.992+0000 7f0883400640 1 -- 172.21.15.18:0/3567719244 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888005020 con 0x5561d99c25c0 2024-09-13T17:01:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.992+0000 7f0883400640 1 -- 172.21.15.18:0/3567719244 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0888005640 con 0x5561d99c25c0 2024-09-13T17:01:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.992+0000 7f0883400640 1 -- 172.21.15.18:0/3567719244 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08880126b0 con 0x5561d99c25c0 2024-09-13T17:01:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.993+0000 7f089f60c740 1 -- 172.21.15.18:0/3567719244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 msgr2=0x5561d99c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.993+0000 7f089f60c740 1 --2- 172.21.15.18:0/3567719244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 0x5561d99c7080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0888005fd0 tx=0x7f08880117b0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.993+0000 7f089f60c740 1 -- 172.21.15.18:0/3567719244 shutdown_connections 2024-09-13T17:01:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.993+0000 7f089f60c740 1 --2- 172.21.15.18:0/3567719244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c7650 0x5561d99c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.993+0000 7f089f60c740 1 --2- 172.21.15.18:0/3567719244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 0x5561d99c7080 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.993+0000 7f089f60c740 1 --2- 172.21.15.18:0/3567719244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c1c80 0x5561d99c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.993+0000 7f089f60c740 1 -- 172.21.15.18:0/3567719244 >> 172.21.15.18:0/3567719244 conn(0x5561d99bd2f0 msgr2=0x5561d99bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.993+0000 7f089f60c740 1 -- 172.21.15.18:0/3567719244 shutdown_connections 2024-09-13T17:01:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.993+0000 7f089f60c740 1 -- 172.21.15.18:0/3567719244 wait complete. 2024-09-13T17:01:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.994+0000 7f089f60c740 1 -- start start 2024-09-13T17:01:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.994+0000 7f089f60c740 1 Processor -- start 2024-09-13T17:01:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.995+0000 7f089a800640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f087c0a1200 0x7f087c0a36c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08900ba030 tx=0x7f0890009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f089f60c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f089f60c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 0x5561d99d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f089f60c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 0x5561d99db6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f089f60c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d9924af0 con 0x5561d99c25c0 2024-09-13T17:01:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f089f60c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d98e2f20 con 0x5561d99c1c80 2024-09-13T17:01:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f089f60c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d98e2bc0 con 0x5561d99c7650 2024-09-13T17:01:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f089f60c740 10 client.0 _ll_register_callbacks cb 0x5561d9914a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:01:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f0899400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 0x5561d99db6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f0899400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 0x5561d99db6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:40380/0 (socket says 172.21.15.18:40380) 2024-09-13T17:01:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f0899400640 1 -- 172.21.15.18:0/661397356 learned_addr learned my addr 172.21.15.18:0/661397356 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.996+0000 7f0899400640 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.997+0000 7f0899e00640 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 0x5561d99d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.998+0000 7f0899400640 1 -- 172.21.15.18:0/661397356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 msgr2=0x5561d99d4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.998+0000 7f0899400640 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99d4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.998+0000 7f0899400640 1 -- 172.21.15.18:0/661397356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 msgr2=0x5561d99d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.998+0000 7f0899400640 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 0x5561d99d4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.998+0000 7f0899400640 1 -- 172.21.15.18:0/661397356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08880098b0 con 0x5561d99c7650 2024-09-13T17:01:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.999+0000 7f0899400640 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 0x5561d99db6a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f08840058c0 tx=0x7f088400a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2df5cc0810a15d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.999+0000 7f0877e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:01:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:21.999+0000 7f0877e00640 1 -- 172.21.15.18:0/661397356 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08840140d0 con 0x5561d99c7650 2024-09-13T17:01:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.000+0000 7f0877e00640 1 -- 172.21.15.18:0/661397356 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0884014230 con 0x5561d99c7650 2024-09-13T17:01:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.000+0000 7f089f60c740 1 -- 172.21.15.18:0/661397356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561d994ec90 con 0x5561d99c7650 2024-09-13T17:01:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.001+0000 7f0877e00640 1 -- 172.21.15.18:0/661397356 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0884022470 con 0x5561d99c7650 2024-09-13T17:01:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.001+0000 7f089f60c740 10 client.25858 fetch_fsmap learned FSMap version 35 2024-09-13T17:01:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.001+0000 7f089f60c740 1 -- 172.21.15.18:0/661397356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5561d9923170 con 0x5561d99c7650 2024-09-13T17:01:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.001+0000 7f0877e00640 1 -- 172.21.15.18:0/661397356 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5561d994ec90 con 0x5561d99c7650 2024-09-13T17:01:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.001+0000 7f0877e00640 1 -- 172.21.15.18:0/661397356 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f08840115c0 con 0x5561d99c7650 2024-09-13T17:01:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.001+0000 7f089f60c740 10 client.25858 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:01:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.001+0000 7f089f60c740 10 client.25858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:01:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.002+0000 7f089f60c740 20 client.25858 populate_metadata read hostname 'smithi018' 2024-09-13T17:01:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.002+0000 7f089f60c740 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5561d99dfe40 0x5561d99e2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.002+0000 7f089f60c740 4 client.25858 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:01:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.002+0000 7f089f60c740 1 -- 172.21.15.18:0/661397356 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561d99177d0 con 0x5561d99dfe40 2024-09-13T17:01:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.002+0000 7f0899e00640 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5561d99dfe40 0x5561d99e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.003+0000 7f0899e00640 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5561d99dfe40 0x5561d99e2260 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=221bfe522f3c1ffd server_cookie=daeaa20d58c603a in_seq=0 out_seq=0 2024-09-13T17:01:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.003+0000 7f0877e00640 10 client.25858 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.004+0000 7f0877e00640 1 -- 172.21.15.18:0/661397356 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5561d99177d0 con 0x5561d99dfe40 2024-09-13T17:01:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.004+0000 7f0877e00640 10 client.25858 handle_command_reply: tid=0 2024-09-13T17:01:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.004+0000 7f089f60c740 1 client.25858 shutdown 2024-09-13T17:01:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.004+0000 7f089f60c740 1 -- 172.21.15.18:0/661397356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 msgr2=0x5561d99db6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.004+0000 7f089f60c740 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 0x5561d99db6a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f08840058c0 tx=0x7f088400a2d0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.005+0000 7f089f60c740 1 -- 172.21.15.18:0/661397356 shutdown_connections 2024-09-13T17:01:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.005+0000 7f089f60c740 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5561d99dfe40 0x5561d99e2260 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.005+0000 7f089f60c740 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 0x5561d99d4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.005+0000 7f089f60c740 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 0x5561d99db6a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.005+0000 7f089f60c740 1 --2- 172.21.15.18:0/661397356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99d4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.005+0000 7f089f60c740 1 -- 172.21.15.18:0/661397356 >> 172.21.15.18:0/661397356 conn(0x5561d99bd2f0 msgr2=0x5561d99beb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.005+0000 7f0877e00640 0 client.25858 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.006+0000 7f089f60c740 1 -- 172.21.15.18:0/661397356 shutdown_connections 2024-09-13T17:01:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.006+0000 7f089f60c740 1 -- 172.21.15.18:0/661397356 wait complete. 2024-09-13T17:01:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.007+0000 7f089f60c740 20 client.25858 trim_cache size 0 max 16384 2024-09-13T17:01:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.035+0000 7f089f60c740 1 Processor -- start 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.035+0000 7f089f60c740 1 -- start start 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.035+0000 7f089f60c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.035+0000 7f089f60c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 0x5561d99db660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.035+0000 7f089f60c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 0x5561d99c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.035+0000 7f089f60c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d968be60 con 0x5561d99c25c0 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.035+0000 7f089f60c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d99c2e60 con 0x5561d99c1c80 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.035+0000 7f089f60c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d99de370 con 0x5561d99c7650 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.036+0000 7f0899e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 0x5561d99db660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.036+0000 7f0899400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.036+0000 7f0899400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:54640/0 (socket says 172.21.15.18:54640) 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.036+0000 7f0899400640 1 -- 172.21.15.18:0/1124675354 learned_addr learned my addr 172.21.15.18:0/1124675354 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.037+0000 7f0899400640 1 --2- 172.21.15.18:0/1124675354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 0x5561d99c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.038+0000 7f0899400640 1 -- 172.21.15.18:0/1124675354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 msgr2=0x5561d99c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.038+0000 7f0899400640 1 --2- 172.21.15.18:0/1124675354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 0x5561d99c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.038+0000 7f0899400640 1 -- 172.21.15.18:0/1124675354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 msgr2=0x5561d99db660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.038+0000 7f0899400640 1 --2- 172.21.15.18:0/1124675354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 0x5561d99db660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.038+0000 7f0899400640 1 -- 172.21.15.18:0/1124675354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561d98c5180 con 0x5561d99c1c80 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.038+0000 7f0899e00640 1 --2- 172.21.15.18:0/1124675354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 0x5561d99db660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.039+0000 7f0899400640 1 --2- 172.21.15.18:0/1124675354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99c6a80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f088400ffe0 tx=0x7f0884000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d84c35778569db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.039+0000 7f0883e00640 1 -- 172.21.15.18:0/1124675354 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884011bf0 con 0x5561d99c1c80 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.039+0000 7f0883e00640 1 -- 172.21.15.18:0/1124675354 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f088401a070 con 0x5561d99c1c80 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.039+0000 7f0883e00640 1 -- 172.21.15.18:0/1124675354 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088402bba0 con 0x5561d99c1c80 2024-09-13T17:01:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.040+0000 7f089f60c740 1 -- 172.21.15.18:0/1124675354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 msgr2=0x5561d99c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.040+0000 7f089f60c740 1 --2- 172.21.15.18:0/1124675354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99c6a80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f088400ffe0 tx=0x7f0884000bc0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.041+0000 7f089f60c740 1 -- 172.21.15.18:0/1124675354 shutdown_connections 2024-09-13T17:01:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.041+0000 7f089f60c740 1 --2- 172.21.15.18:0/1124675354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c25c0 0x5561d99db660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.041+0000 7f089f60c740 1 --2- 172.21.15.18:0/1124675354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c7650 0x5561d99c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.041+0000 7f089f60c740 1 --2- 172.21.15.18:0/1124675354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99c6a80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.041+0000 7f089f60c740 1 -- 172.21.15.18:0/1124675354 >> 172.21.15.18:0/1124675354 conn(0x5561d99bd2f0 msgr2=0x5561d99c3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.041+0000 7f089f60c740 1 -- 172.21.15.18:0/1124675354 shutdown_connections 2024-09-13T17:01:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.041+0000 7f089f60c740 1 -- 172.21.15.18:0/1124675354 wait complete. 2024-09-13T17:01:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.041+0000 7f089f60c740 1 -- start start 2024-09-13T17:01:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.042+0000 7f089f60c740 1 Processor -- start 2024-09-13T17:01:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.043+0000 7f089f60c740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99db210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.043+0000 7f089f60c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 0x5561d99d9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.044+0000 7f089f60c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c7650 0x5561d99d9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.044+0000 7f089f60c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d99dba30 con 0x5561d99c7650 2024-09-13T17:01:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.044+0000 7f089f60c740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d99da2a0 con 0x5561d99c1c80 2024-09-13T17:01:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.044+0000 7f089f60c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561d99da460 con 0x5561d99c25c0 2024-09-13T17:01:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.044+0000 7f089f60c740 10 client.0 _ll_register_callbacks cb 0x7f08880096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:01:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.044+0000 7f0899e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 0x5561d99d9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.044+0000 7f0899400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99db210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.044+0000 7f0899e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 0x5561d99d9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:40408/0 (socket says 172.21.15.18:40408) 2024-09-13T17:01:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.045+0000 7f0899e00640 1 -- 172.21.15.18:0/1482517748 learned_addr learned my addr 172.21.15.18:0/1482517748 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.046+0000 7f0899400640 1 -- 172.21.15.18:0/1482517748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 msgr2=0x5561d99d9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.046+0000 7f0899400640 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 0x5561d99d9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.046+0000 7f0899400640 1 -- 172.21.15.18:0/1482517748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c7650 msgr2=0x5561d99d9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.046+0000 7f0899400640 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c7650 0x5561d99d9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.046+0000 7f0899400640 1 -- 172.21.15.18:0/1482517748 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0884035040 con 0x5561d99c1c80 2024-09-13T17:01:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.046+0000 7f0877e00640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-09-13T17:01:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.047+0000 7f0899400640 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99db210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0884011980 tx=0x7f08840145a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d659ee5bfafb66f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.047+0000 7f0877e00640 1 -- 172.21.15.18:0/1482517748 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884011bf0 con 0x5561d99c1c80 2024-09-13T17:01:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.047+0000 7f0877e00640 1 -- 172.21.15.18:0/1482517748 <== mon.2 v2:172.21.15.94:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0884000e40 con 0x5561d99c1c80 2024-09-13T17:01:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.047+0000 7f089f60c740 1 -- 172.21.15.18:0/1482517748 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0888005640 con 0x5561d99c1c80 2024-09-13T17:01:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.048+0000 7f0877e00640 1 -- 172.21.15.18:0/1482517748 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08840141d0 con 0x5561d99c1c80 2024-09-13T17:01:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.048+0000 7f089f60c740 10 client.25925 fetch_fsmap learned FSMap version 35 2024-09-13T17:01:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.048+0000 7f089f60c740 1 -- 172.21.15.18:0/1482517748 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5561d98ea560 con 0x5561d99c1c80 2024-09-13T17:01:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.049+0000 7f0877e00640 1 -- 172.21.15.18:0/1482517748 <== mon.2 v2:172.21.15.94:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0888005640 con 0x5561d99c1c80 2024-09-13T17:01:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.049+0000 7f0877e00640 1 -- 172.21.15.18:0/1482517748 <== mon.2 v2:172.21.15.94:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0884005110 con 0x5561d99c1c80 2024-09-13T17:01:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.049+0000 7f089f60c740 10 client.25925 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:01:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.049+0000 7f089f60c740 10 client.25925 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:01:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.049+0000 7f089f60c740 20 client.25925 populate_metadata read hostname 'smithi018' 2024-09-13T17:01:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.049+0000 7f089f60c740 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5561d9a37710 0x5561d9a39b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.049+0000 7f089f60c740 4 client.25925 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:01:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.049+0000 7f089f60c740 1 -- 172.21.15.18:0/1482517748 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5561d9618300 con 0x5561d9a37710 2024-09-13T17:01:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.050+0000 7f0899e00640 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5561d9a37710 0x5561d9a39b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.050+0000 7f0899e00640 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5561d9a37710 0x5561d9a39b30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ddb5212bc678de6 server_cookie=2ba5da2e7c978d03 in_seq=0 out_seq=0 2024-09-13T17:01:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:22.050+0000 7f0877e00640 10 client.25925 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:23.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.394+0000 7f0877e00640 1 -- 172.21.15.18:0/1482517748 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5561d9618300 con 0x5561d9a37710 2024-09-13T17:01:23.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.394+0000 7f0877e00640 10 client.25925 handle_command_reply: tid=0 2024-09-13T17:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 client.25925 shutdown 2024-09-13T17:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 -- 172.21.15.18:0/1482517748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 msgr2=0x5561d99db210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99db210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0884011980 tx=0x7f08840145a0 comp rx=0 tx=0).stop 2024-09-13T17:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 -- 172.21.15.18:0/1482517748 shutdown_connections 2024-09-13T17:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x5561d9a37710 0x5561d9a39b30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561d99c7650 0x5561d99d9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5561d99c25c0 0x5561d99d9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 --2- 172.21.15.18:0/1482517748 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5561d99c1c80 0x5561d99db210 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 -- 172.21.15.18:0/1482517748 >> 172.21.15.18:0/1482517748 conn(0x5561d99bd2f0 msgr2=0x5561d99c6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f0877e00640 0 client.25925 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 -- 172.21.15.18:0/1482517748 shutdown_connections 2024-09-13T17:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.395+0000 7f089f60c740 1 -- 172.21.15.18:0/1482517748 wait complete. 2024-09-13T17:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.396+0000 7f089f60c740 20 client.25925 trim_cache size 0 max 16384 2024-09-13T17:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T17:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T17:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T17:01:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T17:01:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.397+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f087c0a1200 msgr2=0x7f087c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.397+0000 7f089b200640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f087c0a1200 0x7f087c0a36c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08900ba030 tx=0x7f0890009500 comp rx=0 tx=0).stop 2024-09-13T17:01:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.397+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0894101700 msgr2=0x7f08941a7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.397+0000 7f089b200640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0894101700 0x7f08941a7e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0890034040 tx=0x7f0890030ee0 comp rx=0 tx=0).stop 2024-09-13T17:01:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.398+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 shutdown_connections 2024-09-13T17:01:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.398+0000 7f089b200640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0894101700 0x7f08941a7e80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.398+0000 7f089b200640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0894100d40 0x7f089406f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.398+0000 7f089b200640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f087c0a1200 0x7f087c0a36c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.398+0000 7f089b200640 1 --2- 172.21.15.18:0/1558529888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08940ffb50 0x7f089406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.398+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 >> 172.21.15.18:0/1558529888 conn(0x7f08940fb2f0 msgr2=0x7f08941041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.398+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 shutdown_connections 2024-09-13T17:01:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:23.398+0000 7f089b200640 1 -- 172.21.15.18:0/1558529888 wait complete. 2024-09-13T17:01:23.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:23 smithi018 ceph-mon[30981]: pgmap v659: 129 pgs: 129 active+clean; 648 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 713 op/s 2024-09-13T17:01:23.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:23 smithi144 ceph-mon[35328]: pgmap v659: 129 pgs: 129 active+clean; 648 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 713 op/s 2024-09-13T17:01:23.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:23 smithi094 ceph-mon[35259]: pgmap v659: 129 pgs: 129 active+clean; 648 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 713 op/s 2024-09-13T17:01:25.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:25 smithi018 ceph-mon[30981]: pgmap v660: 129 pgs: 129 active+clean; 640 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 627 op/s 2024-09-13T17:01:25.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:25 smithi144 ceph-mon[35328]: pgmap v660: 129 pgs: 129 active+clean; 640 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 627 op/s 2024-09-13T17:01:25.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:25 smithi094 ceph-mon[35259]: pgmap v660: 129 pgs: 129 active+clean; 640 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 627 op/s 2024-09-13T17:01:27.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:27 smithi018 ceph-mon[30981]: pgmap v661: 129 pgs: 129 active+clean; 625 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 634 op/s 2024-09-13T17:01:27.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:27 smithi144 ceph-mon[35328]: pgmap v661: 129 pgs: 129 active+clean; 625 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 634 op/s 2024-09-13T17:01:27.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:27 smithi094 ceph-mon[35259]: pgmap v661: 129 pgs: 129 active+clean; 625 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 634 op/s 2024-09-13T17:01:29.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:29 smithi018 ceph-mon[30981]: pgmap v662: 129 pgs: 129 active+clean; 603 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 656 op/s 2024-09-13T17:01:29.463 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:29 smithi094 ceph-mon[35259]: pgmap v662: 129 pgs: 129 active+clean; 603 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 656 op/s 2024-09-13T17:01:29.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:29 smithi144 ceph-mon[35328]: pgmap v662: 129 pgs: 129 active+clean; 603 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 656 op/s 2024-09-13T17:01:31.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:31 smithi144 ceph-mon[35328]: pgmap v663: 129 pgs: 129 active+clean; 596 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 570 op/s 2024-09-13T17:01:31.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:31 smithi094 ceph-mon[35259]: pgmap v663: 129 pgs: 129 active+clean; 596 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 570 op/s 2024-09-13T17:01:31.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:31 smithi018 ceph-mon[30981]: pgmap v663: 129 pgs: 129 active+clean; 596 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 570 op/s 2024-09-13T17:01:33.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:33 smithi144 ceph-mon[35328]: pgmap v664: 129 pgs: 129 active+clean; 585 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 609 op/s 2024-09-13T17:01:33.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:33 smithi094 ceph-mon[35259]: pgmap v664: 129 pgs: 129 active+clean; 585 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 609 op/s 2024-09-13T17:01:33.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:33 smithi018 ceph-mon[30981]: pgmap v664: 129 pgs: 129 active+clean; 585 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 609 op/s 2024-09-13T17:01:35.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:35 smithi144 ceph-mon[35328]: pgmap v665: 129 pgs: 129 active+clean; 563 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 579 op/s 2024-09-13T17:01:35.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:35 smithi094 ceph-mon[35259]: pgmap v665: 129 pgs: 129 active+clean; 563 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 579 op/s 2024-09-13T17:01:35.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:35 smithi018 ceph-mon[30981]: pgmap v665: 129 pgs: 129 active+clean; 563 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 579 op/s 2024-09-13T17:01:37.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:37 smithi144 ceph-mon[35328]: pgmap v666: 129 pgs: 129 active+clean; 552 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 615 op/s 2024-09-13T17:01:37.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:37 smithi094 ceph-mon[35259]: pgmap v666: 129 pgs: 129 active+clean; 552 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 615 op/s 2024-09-13T17:01:38.023 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:37 smithi018 ceph-mon[30981]: pgmap v666: 129 pgs: 129 active+clean; 552 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 615 op/s 2024-09-13T17:01:39.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:39 smithi144 ceph-mon[35328]: pgmap v667: 129 pgs: 129 active+clean; 539 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 656 op/s 2024-09-13T17:01:39.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:39 smithi094 ceph-mon[35259]: pgmap v667: 129 pgs: 129 active+clean; 539 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 656 op/s 2024-09-13T17:01:39.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:39 smithi018 ceph-mon[30981]: pgmap v667: 129 pgs: 129 active+clean; 539 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 656 op/s 2024-09-13T17:01:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.532+0000 7f0ea7200640 1 -- 172.21.15.18:0/2205679616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ea80ffb50 msgr2=0x7f0ea80fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.532+0000 7f0ea7200640 1 --2- 172.21.15.18:0/2205679616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ea80ffb50 0x7f0ea80fff50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009860 tx=0x7f0e9802a340 comp rx=0 tx=0).stop 2024-09-13T17:01:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.532+0000 7f0ea7200640 1 -- 172.21.15.18:0/2205679616 shutdown_connections 2024-09-13T17:01:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.532+0000 7f0ea7200640 1 --2- 172.21.15.18:0/2205679616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ea8100d40 0x7f0ea81011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.532+0000 7f0ea7200640 1 --2- 172.21.15.18:0/2205679616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea8101700 0x7f0ea8107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.532+0000 7f0ea7200640 1 --2- 172.21.15.18:0/2205679616 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ea80ffb50 0x7f0ea80fff50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.532+0000 7f0ea7200640 1 -- 172.21.15.18:0/2205679616 >> 172.21.15.18:0/2205679616 conn(0x7f0ea80fb2f0 msgr2=0x7f0ea80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.532+0000 7f0ea7200640 1 -- 172.21.15.18:0/2205679616 shutdown_connections 2024-09-13T17:01:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.532+0000 7f0ea7200640 1 -- 172.21.15.18:0/2205679616 wait complete. 2024-09-13T17:01:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.534+0000 7f0ea7200640 1 Processor -- start 2024-09-13T17:01:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.534+0000 7f0ea7200640 1 -- start start 2024-09-13T17:01:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.534+0000 7f0ea7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ea80ffb50 0x7f0ea8197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.534+0000 7f0ea7200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ea8100d40 0x7f0ea81982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.534+0000 7f0ea7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea8101700 0x7f0ea819f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.535+0000 7f0ea7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea819f860 con 0x7f0ea80ffb50 2024-09-13T17:01:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.535+0000 7f0ea7200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea819f9d0 con 0x7f0ea8100d40 2024-09-13T17:01:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.535+0000 7f0ea7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea819fb90 con 0x7f0ea8101700 2024-09-13T17:01:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.535+0000 7f0ea5400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ea8100d40 0x7f0ea81982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.535+0000 7f0ea5400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ea8100d40 0x7f0ea81982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:60418/0 (socket says 172.21.15.18:60418) 2024-09-13T17:01:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.535+0000 7f0ea5400640 1 -- 172.21.15.18:0/3746430041 learned_addr learned my addr 172.21.15.18:0/3746430041 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.535+0000 7f0ea6800640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea8101700 0x7f0ea819f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.536+0000 7f0ea5400640 1 -- 172.21.15.18:0/3746430041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea8101700 msgr2=0x7f0ea819f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.536+0000 7f0ea5400640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea8101700 0x7f0ea819f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.536+0000 7f0ea5400640 1 -- 172.21.15.18:0/3746430041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ea80ffb50 msgr2=0x7f0ea8197d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.536+0000 7f0ea5400640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ea80ffb50 0x7f0ea8197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.536+0000 7f0ea5400640 1 -- 172.21.15.18:0/3746430041 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98009490 con 0x7f0ea8100d40 2024-09-13T17:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.536+0000 7f0ea5400640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ea8100d40 0x7f0ea81982b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400b4a0 tx=0x7f0e9400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.537+0000 7f0e9ea00640 1 -- 172.21.15.18:0/3746430041 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94010610 con 0x7f0ea8100d40 2024-09-13T17:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.537+0000 7f0e9ea00640 1 -- 172.21.15.18:0/3746430041 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e94010c30 con 0x7f0ea8100d40 2024-09-13T17:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.537+0000 7f0e9ea00640 1 -- 172.21.15.18:0/3746430041 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94017dd0 con 0x7f0ea8100d40 2024-09-13T17:01:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.540+0000 7f0ea7200640 1 -- 172.21.15.18:0/3746430041 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea819fe70 con 0x7f0ea8100d40 2024-09-13T17:01:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.540+0000 7f0ea7200640 1 -- 172.21.15.18:0/3746430041 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea81a02a0 con 0x7f0ea8100d40 2024-09-13T17:01:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.546+0000 7f0e9ea00640 1 -- 172.21.15.18:0/3746430041 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0e940173f0 con 0x7f0ea8100d40 2024-09-13T17:01:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.549+0000 7f0e9ea00640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0e8c0a1230 0x7f0e8c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.549+0000 7f0e9ea00640 1 -- 172.21.15.18:0/3746430041 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0e940cc5a0 con 0x7f0ea8100d40 2024-09-13T17:01:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.551+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0e8c0a1230 0x7f0e8c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.552+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0e8c0a1230 0x7f0e8c0a36f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0e98035040 tx=0x7f0e98005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.561+0000 7f0eafdc5740 1 Processor -- start 2024-09-13T17:01:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.562+0000 7f0eafdc5740 1 -- start start 2024-09-13T17:01:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.562+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a01d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.562+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a01d5c0 0x56047a022080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.562+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a022650 0x56047a024b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.563+0000 7f0ea5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a01d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.563+0000 7f0ea5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a01d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55816/0 (socket says 172.21.15.18:55816) 2024-09-13T17:01:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.563+0000 7f0ea5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a01d5c0 0x56047a022080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.563+0000 7f0ea5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a01d5c0 0x56047a022080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:46458/0 (socket says 172.21.15.18:46458) 2024-09-13T17:01:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.563+0000 7f0ea5e00640 1 -- 172.21.15.18:0/216708970 learned_addr learned my addr 172.21.15.18:0/216708970 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.563+0000 7f0eafdc5740 1 -- 172.21.15.18:0/216708970 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560479f28bb0 con 0x56047a01cc80 2024-09-13T17:01:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.563+0000 7f0eafdc5740 1 -- 172.21.15.18:0/216708970 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x560479f86a70 con 0x56047a022650 2024-09-13T17:01:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.563+0000 7f0eafdc5740 1 -- 172.21.15.18:0/216708970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560479f84200 con 0x56047a01d5c0 2024-09-13T17:01:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.564+0000 7f0ea6800640 1 --2- 172.21.15.18:0/216708970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a022650 0x56047a024b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.564+0000 7f0ea5400640 1 -- 172.21.15.18:0/216708970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a022650 msgr2=0x56047a024b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.564+0000 7f0ea5400640 1 --2- 172.21.15.18:0/216708970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a022650 0x56047a024b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.564+0000 7f0ea5400640 1 -- 172.21.15.18:0/216708970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 msgr2=0x56047a01d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.564+0000 7f0ea5400640 1 --2- 172.21.15.18:0/216708970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a01d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.564+0000 7f0ea5400640 1 -- 172.21.15.18:0/216708970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560479f21940 con 0x56047a01d5c0 2024-09-13T17:01:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.566+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/216708970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a01d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:01:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.566+0000 7f0ea5400640 1 --2- 172.21.15.18:0/216708970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a01d5c0 0x56047a022080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0e940c9ce0 tx=0x7f0e940177f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35be75a4ff422b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.568+0000 7f0e93400640 1 -- 172.21.15.18:0/216708970 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940b90e0 con 0x56047a01d5c0 2024-09-13T17:01:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.568+0000 7f0e93400640 1 -- 172.21.15.18:0/216708970 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e94099630 con 0x56047a01d5c0 2024-09-13T17:01:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.568+0000 7f0e93400640 1 -- 172.21.15.18:0/216708970 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940cc3d0 con 0x56047a01d5c0 2024-09-13T17:01:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.569+0000 7f0eafdc5740 1 -- 172.21.15.18:0/216708970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a01d5c0 msgr2=0x56047a022080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.569+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/216708970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a01d5c0 0x56047a022080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0e940c9ce0 tx=0x7f0e940177f0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.570+0000 7f0eafdc5740 1 -- 172.21.15.18:0/216708970 shutdown_connections 2024-09-13T17:01:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.570+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/216708970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a022650 0x56047a024b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.570+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/216708970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a01d5c0 0x56047a022080 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.570+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/216708970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a01d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.571+0000 7f0eafdc5740 1 -- 172.21.15.18:0/216708970 >> 172.21.15.18:0/216708970 conn(0x56047a0182f0 msgr2=0x56047a0186f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.571+0000 7f0eafdc5740 1 -- 172.21.15.18:0/216708970 shutdown_connections 2024-09-13T17:01:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.571+0000 7f0eafdc5740 1 -- 172.21.15.18:0/216708970 wait complete. 2024-09-13T17:01:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.572+0000 7f0eafdc5740 1 -- start start 2024-09-13T17:01:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.572+0000 7f0eafdc5740 1 Processor -- start 2024-09-13T17:01:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.573+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a02f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.573+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 0x56047a02f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.573+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a0367a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.573+0000 7f0eafdc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560479f7faf0 con 0x56047a01cc80 2024-09-13T17:01:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.573+0000 7f0eafdc5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x560479f3df20 con 0x56047a01d5c0 2024-09-13T17:01:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.573+0000 7f0eafdc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560479f3dbc0 con 0x56047a022650 2024-09-13T17:01:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.573+0000 7f0eafdc5740 10 client.0 _ll_register_callbacks cb 0x560479f6fa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:01:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.575+0000 7f0ea5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a02f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.575+0000 7f0ea6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a0367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.575+0000 7f0ea6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a0367a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:46460/0 (socket says 172.21.15.18:46460) 2024-09-13T17:01:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.575+0000 7f0ea6800640 1 -- 172.21.15.18:0/3266170762 learned_addr learned my addr 172.21.15.18:0/3266170762 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.575+0000 7f0ea5400640 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 0x56047a02f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.575+0000 7f0ea6800640 1 -- 172.21.15.18:0/3266170762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 msgr2=0x56047a02f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.575+0000 7f0ea6800640 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 0x56047a02f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.575+0000 7f0ea6800640 1 -- 172.21.15.18:0/3266170762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 msgr2=0x56047a02f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.575+0000 7f0ea6800640 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a02f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.575+0000 7f0ea6800640 1 -- 172.21.15.18:0/3266170762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea81a02a0 con 0x56047a022650 2024-09-13T17:01:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.576+0000 7f0ea6800640 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a0367a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0010c40 tx=0x7f0ea000d7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddc7d410dd4b73e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.576+0000 7f0ea5400640 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 0x56047a02f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:01:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.576+0000 7f0e87e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-13T17:01:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.576+0000 7f0e87e00640 1 -- 172.21.15.18:0/3266170762 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0015070 con 0x56047a022650 2024-09-13T17:01:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.576+0000 7f0e87e00640 1 -- 172.21.15.18:0/3266170762 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0ea0004b20 con 0x56047a022650 2024-09-13T17:01:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.576+0000 7f0eafdc5740 1 -- 172.21.15.18:0/3266170762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560479fa9c90 con 0x56047a022650 2024-09-13T17:01:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.577+0000 7f0e87e00640 1 -- 172.21.15.18:0/3266170762 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea00102e0 con 0x56047a022650 2024-09-13T17:01:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.577+0000 7f0eafdc5740 10 client.25876 fetch_fsmap learned FSMap version 35 2024-09-13T17:01:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.577+0000 7f0eafdc5740 1 -- 172.21.15.18:0/3266170762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x560479f7e170 con 0x56047a022650 2024-09-13T17:01:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.578+0000 7f0e87e00640 1 -- 172.21.15.18:0/3266170762 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560479fa9c90 con 0x56047a022650 2024-09-13T17:01:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.578+0000 7f0e87e00640 1 -- 172.21.15.18:0/3266170762 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0ea0005020 con 0x56047a022650 2024-09-13T17:01:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.578+0000 7f0eafdc5740 10 client.25876 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:01:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.578+0000 7f0eafdc5740 10 client.25876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:01:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.578+0000 7f0eafdc5740 20 client.25876 populate_metadata read hostname 'smithi018' 2024-09-13T17:01:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.578+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56047a029b00 0x56047a02bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.578+0000 7f0eafdc5740 4 client.25876 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:01:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.578+0000 7f0eafdc5740 1 -- 172.21.15.18:0/3266170762 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560479f727d0 con 0x56047a029b00 2024-09-13T17:01:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.579+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56047a029b00 0x56047a02bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.580+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56047a029b00 0x56047a02bf20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92196d0f3e2ad663 server_cookie=171d61f5379f4ad4 in_seq=0 out_seq=0 2024-09-13T17:01:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.580+0000 7f0e87e00640 10 client.25876 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0e87e00640 1 -- 172.21.15.18:0/3266170762 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560479f727d0 con 0x56047a029b00 2024-09-13T17:01:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0e87e00640 10 client.25876 handle_command_reply: tid=0 2024-09-13T17:01:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0eafdc5740 1 client.25876 shutdown 2024-09-13T17:01:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0eafdc5740 1 -- 172.21.15.18:0/3266170762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 msgr2=0x56047a0367a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a0367a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0010c40 tx=0x7f0ea000d7b0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0eafdc5740 1 -- 172.21.15.18:0/3266170762 shutdown_connections 2024-09-13T17:01:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56047a029b00 0x56047a02bf20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a0367a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 0x56047a02f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/3266170762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a02f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0eafdc5740 1 -- 172.21.15.18:0/3266170762 >> 172.21.15.18:0/3266170762 conn(0x56047a0182f0 msgr2=0x56047a019b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.581+0000 7f0e87e00640 0 client.25876 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.582+0000 7f0eafdc5740 1 -- 172.21.15.18:0/3266170762 shutdown_connections 2024-09-13T17:01:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.582+0000 7f0eafdc5740 1 -- 172.21.15.18:0/3266170762 wait complete. 2024-09-13T17:01:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.583+0000 7f0eafdc5740 20 client.25876 trim_cache size 0 max 16384 2024-09-13T17:01:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.611+0000 7f0eafdc5740 1 Processor -- start 2024-09-13T17:01:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.611+0000 7f0eafdc5740 1 -- start start 2024-09-13T17:01:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.611+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01cc80 0x56047a01e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.611+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01d5c0 0x56047a036760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.611+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a01ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.611+0000 7f0eafdc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560479ce6e60 con 0x56047a01d5c0 2024-09-13T17:01:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.611+0000 7f0eafdc5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x560479fa9c90 con 0x56047a01cc80 2024-09-13T17:01:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.611+0000 7f0eafdc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56047a026500 con 0x56047a022650 2024-09-13T17:01:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.612+0000 7f0ea6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a01ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.612+0000 7f0ea5e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01cc80 0x56047a01e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.612+0000 7f0ea6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a01ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:46466/0 (socket says 172.21.15.18:46466) 2024-09-13T17:01:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.612+0000 7f0ea6800640 1 -- 172.21.15.18:0/1451204886 learned_addr learned my addr 172.21.15.18:0/1451204886 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.612+0000 7f0ea5e00640 1 -- 172.21.15.18:0/1451204886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 msgr2=0x56047a01ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.612+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/1451204886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a01ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.612+0000 7f0ea5e00640 1 -- 172.21.15.18:0/1451204886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01d5c0 msgr2=0x56047a036760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.612+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/1451204886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01d5c0 0x56047a036760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.612+0000 7f0ea5e00640 1 -- 172.21.15.18:0/1451204886 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560479f20180 con 0x56047a01cc80 2024-09-13T17:01:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.613+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/1451204886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01cc80 0x56047a01e6e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x56047a02e7a0 tx=0x7f0e98040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f18950851603892 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.613+0000 7f0e93e00640 1 -- 172.21.15.18:0/1451204886 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9804f040 con 0x56047a01cc80 2024-09-13T17:01:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.613+0000 7f0e93e00640 1 -- 172.21.15.18:0/1451204886 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e98032c70 con 0x56047a01cc80 2024-09-13T17:01:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.613+0000 7f0e93e00640 1 -- 172.21.15.18:0/1451204886 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98051610 con 0x56047a01cc80 2024-09-13T17:01:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.614+0000 7f0eafdc5740 1 -- 172.21.15.18:0/1451204886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01cc80 msgr2=0x56047a01e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.614+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/1451204886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01cc80 0x56047a01e6e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x56047a02e7a0 tx=0x7f0e98040000 comp rx=0 tx=0).stop 2024-09-13T17:01:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.614+0000 7f0eafdc5740 1 -- 172.21.15.18:0/1451204886 shutdown_connections 2024-09-13T17:01:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.614+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/1451204886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01d5c0 0x56047a036760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.614+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/1451204886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a01ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.614+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/1451204886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01cc80 0x56047a01e6e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.614+0000 7f0eafdc5740 1 -- 172.21.15.18:0/1451204886 >> 172.21.15.18:0/1451204886 conn(0x56047a0182f0 msgr2=0x56047a02f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.614+0000 7f0eafdc5740 1 -- 172.21.15.18:0/1451204886 shutdown_connections 2024-09-13T17:01:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.614+0000 7f0eafdc5740 1 -- 172.21.15.18:0/1451204886 wait complete. 2024-09-13T17:01:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.615+0000 7f0eafdc5740 1 -- start start 2024-09-13T17:01:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.615+0000 7f0eafdc5740 1 Processor -- start 2024-09-13T17:01:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a033720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 0x56047a033c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0eafdc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a099470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0eafdc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56047a0999b0 con 0x56047a01cc80 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0eafdc5740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x56047a099af0 con 0x56047a01d5c0 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0eafdc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56047a099c80 con 0x56047a022650 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0eafdc5740 10 client.0 _ll_register_callbacks cb 0x7f0e94099400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0ea5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a033720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0ea6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a099470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0ea6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a099470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:46478/0 (socket says 172.21.15.18:46478) 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0ea6800640 1 -- 172.21.15.18:0/4130479785 learned_addr learned my addr 172.21.15.18:0/4130479785 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.616+0000 7f0ea5400640 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 0x56047a033c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.617+0000 7f0ea5e00640 1 -- 172.21.15.18:0/4130479785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 msgr2=0x56047a099470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.617+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a099470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.617+0000 7f0ea5e00640 1 -- 172.21.15.18:0/4130479785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 msgr2=0x56047a033c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:01:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.617+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 0x56047a033c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.617+0000 7f0ea5e00640 1 -- 172.21.15.18:0/4130479785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9802e070 con 0x56047a01cc80 2024-09-13T17:01:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.617+0000 7f0ea5400640 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 0x56047a033c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:01:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.617+0000 7f0ea5e00640 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a033720 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009780 tx=0x7f0e98032de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4835fd93805f17ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.617+0000 7f0e87e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-13T17:01:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.618+0000 7f0e87e00640 1 -- 172.21.15.18:0/4130479785 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9804f070 con 0x56047a01cc80 2024-09-13T17:01:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.618+0000 7f0e87e00640 1 -- 172.21.15.18:0/4130479785 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f0e98043040 con 0x56047a01cc80 2024-09-13T17:01:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.618+0000 7f0eafdc5740 1 -- 172.21.15.18:0/4130479785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56047a018ea0 con 0x56047a01cc80 2024-09-13T17:01:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.619+0000 7f0e87e00640 1 -- 172.21.15.18:0/4130479785 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e98030680 con 0x56047a01cc80 2024-09-13T17:01:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.619+0000 7f0eafdc5740 10 client.15831 fetch_fsmap learned FSMap version 35 2024-09-13T17:01:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.619+0000 7f0eafdc5740 1 -- 172.21.15.18:0/4130479785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x560479f45560 con 0x56047a01cc80 2024-09-13T17:01:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.620+0000 7f0e87e00640 1 -- 172.21.15.18:0/4130479785 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56047a018ea0 con 0x56047a01cc80 2024-09-13T17:01:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.620+0000 7f0e87e00640 1 -- 172.21.15.18:0/4130479785 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0e980037f0 con 0x56047a01cc80 2024-09-13T17:01:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.620+0000 7f0eafdc5740 10 client.15831 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:01:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.620+0000 7f0eafdc5740 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T17:01:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.620+0000 7f0eafdc5740 20 client.15831 populate_metadata read hostname 'smithi018' 2024-09-13T17:01:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.620+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56047a09b410 0x56047a09d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.620+0000 7f0eafdc5740 4 client.15831 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:01:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.620+0000 7f0eafdc5740 1 -- 172.21.15.18:0/4130479785 --> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f0e94099630 con 0x56047a09b410 2024-09-13T17:01:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.621+0000 7f0ea5400640 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56047a09b410 0x56047a09d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.622+0000 7f0ea5400640 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56047a09b410 0x56047a09d830 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb15b2a90eb5e320 server_cookie=ee0a863031b9202e in_seq=0 out_seq=0 2024-09-13T17:01:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.622+0000 7f0e87e00640 10 client.15831 ms_handle_connect on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.652+0000 7f0e87e00640 1 -- 172.21.15.18:0/4130479785 <== mds.0 v2:172.21.15.94:6838/1508206800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f0e94099630 con 0x56047a09b410 2024-09-13T17:01:40.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.652+0000 7f0e87e00640 10 client.15831 handle_command_reply: tid=0 2024-09-13T17:01:40.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.652+0000 7f0eafdc5740 1 client.15831 shutdown 2024-09-13T17:01:40.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.652+0000 7f0eafdc5740 1 -- 172.21.15.18:0/4130479785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 msgr2=0x56047a033720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:40.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.652+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a033720 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009780 tx=0x7f0e98032de0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.653+0000 7f0eafdc5740 1 -- 172.21.15.18:0/4130479785 shutdown_connections 2024-09-13T17:01:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.653+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.94:6838/1508206800,v1:172.21.15.94:6839/1508206800] conn(0x56047a09b410 0x56047a09d830 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.653+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56047a022650 0x56047a099470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.653+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56047a01d5c0 0x56047a033c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.653+0000 7f0eafdc5740 1 --2- 172.21.15.18:0/4130479785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56047a01cc80 0x56047a033720 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.653+0000 7f0eafdc5740 1 -- 172.21.15.18:0/4130479785 >> 172.21.15.18:0/4130479785 conn(0x56047a0182f0 msgr2=0x56047a02f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.653+0000 7f0e87e00640 0 client.15831 ms_handle_reset on v2:172.21.15.94:6838/1508206800 2024-09-13T17:01:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.653+0000 7f0eafdc5740 1 -- 172.21.15.18:0/4130479785 shutdown_connections 2024-09-13T17:01:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.653+0000 7f0eafdc5740 1 -- 172.21.15.18:0/4130479785 wait complete. 2024-09-13T17:01:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.654+0000 7f0eafdc5740 20 client.15831 trim_cache size 0 max 16384 2024-09-13T17:01:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-13T17:01:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-13T17:01:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-13T17:01:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-13T17:01:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.655+0000 7f0ea7200640 1 -- 172.21.15.18:0/3746430041 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0e8c0a1230 msgr2=0x7f0e8c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.655+0000 7f0ea7200640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0e8c0a1230 0x7f0e8c0a36f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0e98035040 tx=0x7f0e98005760 comp rx=0 tx=0).stop 2024-09-13T17:01:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.655+0000 7f0ea7200640 1 -- 172.21.15.18:0/3746430041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ea8100d40 msgr2=0x7f0ea81982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.655+0000 7f0ea7200640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ea8100d40 0x7f0ea81982b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400b4a0 tx=0x7f0e9400b960 comp rx=0 tx=0).stop 2024-09-13T17:01:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.656+0000 7f0ea7200640 1 -- 172.21.15.18:0/3746430041 shutdown_connections 2024-09-13T17:01:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.656+0000 7f0ea7200640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea8101700 0x7f0ea819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.656+0000 7f0ea7200640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ea8100d40 0x7f0ea81982b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.656+0000 7f0ea7200640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f0e8c0a1230 0x7f0e8c0a36f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.656+0000 7f0ea7200640 1 --2- 172.21.15.18:0/3746430041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ea80ffb50 0x7f0ea8197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.656+0000 7f0ea7200640 1 -- 172.21.15.18:0/3746430041 >> 172.21.15.18:0/3746430041 conn(0x7f0ea80fb2f0 msgr2=0x7f0ea80726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.656+0000 7f0ea7200640 1 -- 172.21.15.18:0/3746430041 shutdown_connections 2024-09-13T17:01:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-13T17:01:40.656+0000 7f0ea7200640 1 -- 172.21.15.18:0/3746430041 wait complete. 2024-09-13T17:01:41.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:41 smithi144 ceph-mon[35328]: pgmap v668: 129 pgs: 129 active+clean; 535 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 575 op/s 2024-09-13T17:01:41.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:41 smithi094 ceph-mon[35259]: pgmap v668: 129 pgs: 129 active+clean; 535 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 575 op/s 2024-09-13T17:01:41.727 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:41 smithi018 ceph-mon[30981]: pgmap v668: 129 pgs: 129 active+clean; 535 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 575 op/s 2024-09-13T17:01:43.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:43 smithi144 ceph-mon[35328]: pgmap v669: 129 pgs: 129 active+clean; 524 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 619 op/s 2024-09-13T17:01:43.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:43 smithi094 ceph-mon[35259]: pgmap v669: 129 pgs: 129 active+clean; 524 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 619 op/s 2024-09-13T17:01:43.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:43 smithi018 ceph-mon[30981]: pgmap v669: 129 pgs: 129 active+clean; 524 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 619 op/s 2024-09-13T17:01:45.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:45 smithi144 ceph-mon[35328]: pgmap v670: 129 pgs: 129 active+clean; 510 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 615 op/s 2024-09-13T17:01:45.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:45 smithi094 ceph-mon[35259]: pgmap v670: 129 pgs: 129 active+clean; 510 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 615 op/s 2024-09-13T17:01:45.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:45 smithi018 ceph-mon[30981]: pgmap v670: 129 pgs: 129 active+clean; 510 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 615 op/s 2024-09-13T17:01:46.743 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-13T17:01:46.743 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T17:01:47.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:47 smithi018 ceph-mon[30981]: pgmap v671: 129 pgs: 129 active+clean; 500 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 630 op/s 2024-09-13T17:01:47.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:47 smithi144 ceph-mon[35328]: pgmap v671: 129 pgs: 129 active+clean; 500 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 630 op/s 2024-09-13T17:01:47.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:47 smithi094 ceph-mon[35259]: pgmap v671: 129 pgs: 129 active+clean; 500 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 630 op/s 2024-09-13T17:01:48.347 DEBUG:teuthology.parallel:result is None 2024-09-13T17:01:48.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T17:01:48.410 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T17:01:48.410 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-13T17:01:48.425 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T17:01:48.436 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-13T17:01:48.445 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:01:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.668+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1296498659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fec103b50 msgr2=0x7f6fec10a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.668+0000 7f6ff1a00640 1 --2- 172.21.15.18:0/1296498659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fec103b50 0x7f6fec10a3e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009ca0 tx=0x7f6fe402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:01:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.668+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1296498659 shutdown_connections 2024-09-13T17:01:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.668+0000 7f6ff1a00640 1 --2- 172.21.15.18:0/1296498659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fec103b50 0x7f6fec10a3e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.668+0000 7f6ff1a00640 1 --2- 172.21.15.18:0/1296498659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fec103190 0x7f6fec103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.668+0000 7f6ff1a00640 1 --2- 172.21.15.18:0/1296498659 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fec101fa0 0x7f6fec1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.668+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1296498659 >> 172.21.15.18:0/1296498659 conn(0x7f6fec0fd700 msgr2=0x7f6fec0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.668+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1296498659 shutdown_connections 2024-09-13T17:01:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.668+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1296498659 wait complete. 2024-09-13T17:01:48.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.669+0000 7f6ff1a00640 1 Processor -- start 2024-09-13T17:01:48.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.669+0000 7f6ff1a00640 1 -- start start 2024-09-13T17:01:48.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.669+0000 7f6ff1a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fec101fa0 0x7f6fec197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:48.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.669+0000 7f6ff1a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fec103190 0x7f6fec198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.669+0000 7f6ff1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fec103b50 0x7f6fec19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.669+0000 7f6ff1a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec19f9e0 con 0x7f6fec101fa0 2024-09-13T17:01:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.669+0000 7f6ff1a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec19fb50 con 0x7f6fec103190 2024-09-13T17:01:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.669+0000 7f6ff1a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec19fd10 con 0x7f6fec103b50 2024-09-13T17:01:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fec101fa0 0x7f6fec197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fec101fa0 0x7f6fec197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52516/0 (socket says 172.21.15.18:52516) 2024-09-13T17:01:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feaa00640 1 -- 172.21.15.18:0/1342271093 learned_addr learned my addr 172.21.15.18:0/1342271093 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6fea000640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fec103190 0x7f6fec198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feb400640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fec103b50 0x7f6fec19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feaa00640 1 -- 172.21.15.18:0/1342271093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fec103b50 msgr2=0x7f6fec19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feaa00640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fec103b50 0x7f6fec19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feaa00640 1 -- 172.21.15.18:0/1342271093 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fec103190 msgr2=0x7f6fec198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feaa00640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fec103190 0x7f6fec198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feaa00640 1 -- 172.21.15.18:0/1342271093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe4009900 con 0x7f6fec101fa0 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feb400640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fec103b50 0x7f6fec19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.670+0000 7f6feaa00640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fec101fa0 0x7f6fec197ef0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00e9c0 tx=0x7f6fdc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.671+0000 7f6fe3400640 1 -- 172.21.15.18:0/1342271093 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc009700 con 0x7f6fec101fa0 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.671+0000 7f6fe3400640 1 -- 172.21.15.18:0/1342271093 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fdc0044e0 con 0x7f6fec101fa0 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.671+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1342271093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec19fff0 con 0x7f6fec101fa0 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.671+0000 7f6fe3400640 1 -- 172.21.15.18:0/1342271093 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc010430 con 0x7f6fec101fa0 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.671+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1342271093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec1a0410 con 0x7f6fec101fa0 2024-09-13T17:01:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.672+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1342271093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec1023a0 con 0x7f6fec101fa0 2024-09-13T17:01:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.674+0000 7f6fe3400640 1 -- 172.21.15.18:0/1342271093 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6fdc003f60 con 0x7f6fec101fa0 2024-09-13T17:01:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.675+0000 7f6fe3400640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6fd00a1090 0x7f6fd00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.675+0000 7f6fe3400640 1 -- 172.21.15.18:0/1342271093 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f6fdc014070 con 0x7f6fec101fa0 2024-09-13T17:01:48.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.675+0000 7f6fea000640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6fd00a1090 0x7f6fd00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:48.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.676+0000 7f6fea000640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6fd00a1090 0x7f6fd00a3550 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6fec199400 tx=0x7f6fd8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.679+0000 7f6fe3400640 1 -- 172.21.15.18:0/1342271093 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6fdc0965c0 con 0x7f6fec101fa0 2024-09-13T17:01:48.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.866+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1342271093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fec109390 con 0x7f6fec101fa0 2024-09-13T17:01:48.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.868+0000 7f6fe3400640 1 -- 172.21.15.18:0/1342271093 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24592 (secure 0 0 0) 0x7f6fdc099be0 con 0x7f6fec101fa0 2024-09-13T17:01:48.869 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T17:01:48.870 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":94,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:59:07.048861+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:01:48.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1342271093 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6fd00a1090 msgr2=0x7f6fd00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:48.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6fd00a1090 0x7f6fd00a3550 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6fec199400 tx=0x7f6fd8005f90 comp rx=0 tx=0).stop 2024-09-13T17:01:48.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1342271093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fec101fa0 msgr2=0x7f6fec197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:48.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fec101fa0 0x7f6fec197ef0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00e9c0 tx=0x7f6fdc00ee80 comp rx=0 tx=0).stop 2024-09-13T17:01:48.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1342271093 shutdown_connections 2024-09-13T17:01:48.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fec103b50 0x7f6fec19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6fec103190 0x7f6fec198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f6fd00a1090 0x7f6fd00a3550 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 --2- 172.21.15.18:0/1342271093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fec101fa0 0x7f6fec197ef0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1342271093 >> 172.21.15.18:0/1342271093 conn(0x7f6fec0fd700 msgr2=0x7f6fec106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1342271093 shutdown_connections 2024-09-13T17:01:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:48.870+0000 7f6ff1a00640 1 -- 172.21.15.18:0/1342271093 wait complete. 2024-09-13T17:01:48.887 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:49:26.572697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:49:27.624038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:49:30.629093+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:01:48.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:01:49.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.046+0000 7f239c200640 1 -- 172.21.15.18:0/4274451216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2394101920 msgr2=0x7f23941081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.046+0000 7f239c200640 1 --2- 172.21.15.18:0/4274451216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2394101920 0x7f23941081b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f238c009ca0 tx=0x7f238c02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.046+0000 7f239c200640 1 -- 172.21.15.18:0/4274451216 shutdown_connections 2024-09-13T17:01:49.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.046+0000 7f239c200640 1 --2- 172.21.15.18:0/4274451216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2394101920 0x7f23941081b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.046+0000 7f239c200640 1 --2- 172.21.15.18:0/4274451216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2394100f60 0x7f23941013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.046+0000 7f239c200640 1 --2- 172.21.15.18:0/4274451216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23940ffd70 0x7f2394100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.046+0000 7f239c200640 1 -- 172.21.15.18:0/4274451216 >> 172.21.15.18:0/4274451216 conn(0x7f23940fb4d0 msgr2=0x7f23940fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:49.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.046+0000 7f239c200640 1 -- 172.21.15.18:0/4274451216 shutdown_connections 2024-09-13T17:01:49.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.046+0000 7f239c200640 1 -- 172.21.15.18:0/4274451216 wait complete. 2024-09-13T17:01:49.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.047+0000 7f239c200640 1 Processor -- start 2024-09-13T17:01:49.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.047+0000 7f239c200640 1 -- start start 2024-09-13T17:01:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f239c200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23940ffd70 0x7f2394195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f239c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2394100f60 0x7f2394196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f239c200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2394101920 0x7f239419d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f239c200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239419d830 con 0x7f2394101920 2024-09-13T17:01:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f239c200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239419d9a0 con 0x7f23940ffd70 2024-09-13T17:01:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f239c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239419db60 con 0x7f2394100f60 2024-09-13T17:01:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f239a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2394101920 0x7f239419d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f239a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2394101920 0x7f239419d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52536/0 (socket says 172.21.15.18:52536) 2024-09-13T17:01:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f239a200640 1 -- 172.21.15.18:0/12488908 learned_addr learned my addr 172.21.15.18:0/12488908 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f2399800640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23940ffd70 0x7f2394195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f2398e00640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2394100f60 0x7f2394196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f2399800640 1 -- 172.21.15.18:0/12488908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2394100f60 msgr2=0x7f2394196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f2399800640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2394100f60 0x7f2394196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f2399800640 1 -- 172.21.15.18:0/12488908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2394101920 msgr2=0x7f239419d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f2399800640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2394101920 0x7f239419d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f2399800640 1 -- 172.21.15.18:0/12488908 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380009490 con 0x7f23940ffd70 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.048+0000 7f239a200640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2394101920 0x7f239419d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.049+0000 7f2399800640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23940ffd70 0x7f2394195d50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f238800e9c0 tx=0x7f238800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.049+0000 7f2392000640 1 -- 172.21.15.18:0/12488908 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800ccc0 con 0x7f23940ffd70 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.049+0000 7f2392000640 1 -- 172.21.15.18:0/12488908 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23880044f0 con 0x7f23940ffd70 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.049+0000 7f239c200640 1 -- 172.21.15.18:0/12488908 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c009900 con 0x7f23940ffd70 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.049+0000 7f2392000640 1 -- 172.21.15.18:0/12488908 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388010430 con 0x7f23940ffd70 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.049+0000 7f239c200640 1 -- 172.21.15.18:0/12488908 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239419e170 con 0x7f23940ffd70 2024-09-13T17:01:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.050+0000 7f239c200640 1 -- 172.21.15.18:0/12488908 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2394107180 con 0x7f23940ffd70 2024-09-13T17:01:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.052+0000 7f2392000640 1 -- 172.21.15.18:0/12488908 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2388003f30 con 0x7f23940ffd70 2024-09-13T17:01:49.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.053+0000 7f2392000640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f237c0a1090 0x7f237c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.054+0000 7f2392000640 1 -- 172.21.15.18:0/12488908 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f2388014070 con 0x7f23940ffd70 2024-09-13T17:01:49.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.054+0000 7f2398e00640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f237c0a1090 0x7f237c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.054+0000 7f2398e00640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f237c0a1090 0x7f237c0a3550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2380009d60 tx=0x7f2380005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:49.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.056+0000 7f2392000640 1 -- 172.21.15.18:0/12488908 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f23880964c0 con 0x7f23940ffd70 2024-09-13T17:01:49.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.234+0000 7f239c200640 1 -- 172.21.15.18:0/12488908 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f239402c480 con 0x7f23940ffd70 2024-09-13T17:01:49.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.235+0000 7f2392000640 1 -- 172.21.15.18:0/12488908 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23880983f0 con 0x7f23940ffd70 2024-09-13T17:01:49.236 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T17:01:49.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 -- 172.21.15.18:0/12488908 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f237c0a1090 msgr2=0x7f237c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f237c0a1090 0x7f237c0a3550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2380009d60 tx=0x7f2380005f90 comp rx=0 tx=0).stop 2024-09-13T17:01:49.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 -- 172.21.15.18:0/12488908 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23940ffd70 msgr2=0x7f2394195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23940ffd70 0x7f2394195d50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f238800e9c0 tx=0x7f238800ee80 comp rx=0 tx=0).stop 2024-09-13T17:01:49.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 -- 172.21.15.18:0/12488908 shutdown_connections 2024-09-13T17:01:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f237c0a1090 0x7f237c0a3550 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2394101920 0x7f239419d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2394100f60 0x7f2394196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 --2- 172.21.15.18:0/12488908 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23940ffd70 0x7f2394195d50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 -- 172.21.15.18:0/12488908 >> 172.21.15.18:0/12488908 conn(0x7f23940fb4d0 msgr2=0x7f2394104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 -- 172.21.15.18:0/12488908 shutdown_connections 2024-09-13T17:01:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.237+0000 7f239c200640 1 -- 172.21.15.18:0/12488908 wait complete. 2024-09-13T17:01:49.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:01:49.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.412+0000 7f5719400640 1 -- 172.21.15.18:0/2567527229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5714072f10 msgr2=0x7f5714073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.412+0000 7f5719400640 1 --2- 172.21.15.18:0/2567527229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5714072f10 0x7f5714073370 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5700009900 tx=0x7f570002a3f0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.412+0000 7f5719400640 1 -- 172.21.15.18:0/2567527229 shutdown_connections 2024-09-13T17:01:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.412+0000 7f5719400640 1 --2- 172.21.15.18:0/2567527229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5714072f10 0x7f5714073370 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.412+0000 7f5719400640 1 --2- 172.21.15.18:0/2567527229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571410c340 0x7f571410e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.412+0000 7f5719400640 1 --2- 172.21.15.18:0/2567527229 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57140744f0 0x7f5714072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.412+0000 7f5719400640 1 -- 172.21.15.18:0/2567527229 >> 172.21.15.18:0/2567527229 conn(0x7f57140fb4d0 msgr2=0x7f57140fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.412+0000 7f5719400640 1 -- 172.21.15.18:0/2567527229 shutdown_connections 2024-09-13T17:01:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.412+0000 7f5719400640 1 -- 172.21.15.18:0/2567527229 wait complete. 2024-09-13T17:01:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.413+0000 7f5719400640 1 Processor -- start 2024-09-13T17:01:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.413+0000 7f5719400640 1 -- start start 2024-09-13T17:01:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5719400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5714072f10 0x7f571419c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5719400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57140744f0 0x7f571419c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5719400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571410c340 0x7f57141a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5719400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57141a3e40 con 0x7f5714072f10 2024-09-13T17:01:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5719400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57141a3fb0 con 0x7f57140744f0 2024-09-13T17:01:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5719400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57141a4170 con 0x7f571410c340 2024-09-13T17:01:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5712800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5714072f10 0x7f571419c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5712800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5714072f10 0x7f571419c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52552/0 (socket says 172.21.15.18:52552) 2024-09-13T17:01:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5712800640 1 -- 172.21.15.18:0/97670379 learned_addr learned my addr 172.21.15.18:0/97670379 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5711e00640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57140744f0 0x7f571419c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5713200640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571410c340 0x7f57141a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5712800640 1 -- 172.21.15.18:0/97670379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571410c340 msgr2=0x7f57141a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5712800640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571410c340 0x7f57141a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5712800640 1 -- 172.21.15.18:0/97670379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57140744f0 msgr2=0x7f571419c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5712800640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57140744f0 0x7f571419c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5712800640 1 -- 172.21.15.18:0/97670379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704009490 con 0x7f5714072f10 2024-09-13T17:01:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.414+0000 7f5713200640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571410c340 0x7f57141a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:01:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.415+0000 7f5712800640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5714072f10 0x7f571419c350 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f570400ea60 tx=0x7f570400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.415+0000 7f570b400640 1 -- 172.21.15.18:0/97670379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400cde0 con 0x7f5714072f10 2024-09-13T17:01:49.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.415+0000 7f5719400640 1 -- 172.21.15.18:0/97670379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5700009560 con 0x7f5714072f10 2024-09-13T17:01:49.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.415+0000 7f570b400640 1 -- 172.21.15.18:0/97670379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57040035f0 con 0x7f5714072f10 2024-09-13T17:01:49.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.415+0000 7f570b400640 1 -- 172.21.15.18:0/97670379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57040044e0 con 0x7f5714072f10 2024-09-13T17:01:49.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.415+0000 7f5719400640 1 -- 172.21.15.18:0/97670379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57141a47f0 con 0x7f5714072f10 2024-09-13T17:01:49.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.416+0000 7f5719400640 1 -- 172.21.15.18:0/97670379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5714101e00 con 0x7f5714072f10 2024-09-13T17:01:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.418+0000 7f570b400640 1 -- 172.21.15.18:0/97670379 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5704003a60 con 0x7f5714072f10 2024-09-13T17:01:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.419+0000 7f570b400640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56f80a1110 0x7f56f80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.420+0000 7f570b400640 1 -- 172.21.15.18:0/97670379 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f5704014070 con 0x7f5714072f10 2024-09-13T17:01:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.420+0000 7f5711e00640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56f80a1110 0x7f56f80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.420+0000 7f5711e00640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56f80a1110 0x7f56f80a35d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f570002a9e0 tx=0x7f57000314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.423+0000 7f570b400640 1 -- 172.21.15.18:0/97670379 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5704096540 con 0x7f5714072f10 2024-09-13T17:01:49.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:49 smithi144 ceph-mon[35328]: pgmap v672: 129 pgs: 129 active+clean; 478 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 668 op/s 2024-09-13T17:01:49.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:49 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1342271093' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:01:49.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:49 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/12488908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:01:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.605+0000 7f5719400640 1 -- 172.21.15.18:0/97670379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5714111c60 con 0x7f5714072f10 2024-09-13T17:01:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.606+0000 7f570b400640 1 -- 172.21.15.18:0/97670379 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5704099b60 con 0x7f5714072f10 2024-09-13T17:01:49.607 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T17:01:49.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 -- 172.21.15.18:0/97670379 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56f80a1110 msgr2=0x7f56f80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56f80a1110 0x7f56f80a35d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f570002a9e0 tx=0x7f57000314a0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 -- 172.21.15.18:0/97670379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5714072f10 msgr2=0x7f571419c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5714072f10 0x7f571419c350 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f570400ea60 tx=0x7f570400ef20 comp rx=0 tx=0).stop 2024-09-13T17:01:49.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 -- 172.21.15.18:0/97670379 shutdown_connections 2024-09-13T17:01:49.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571410c340 0x7f57141a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57140744f0 0x7f571419c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f56f80a1110 0x7f56f80a35d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 --2- 172.21.15.18:0/97670379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5714072f10 0x7f571419c350 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 -- 172.21.15.18:0/97670379 >> 172.21.15.18:0/97670379 conn(0x7f57140fb4d0 msgr2=0x7f57140fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:49.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 -- 172.21.15.18:0/97670379 shutdown_connections 2024-09-13T17:01:49.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.608+0000 7f5719400640 1 -- 172.21.15.18:0/97670379 wait complete. 2024-09-13T17:01:49.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:49 smithi018 ceph-mon[30981]: pgmap v672: 129 pgs: 129 active+clean; 478 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 668 op/s 2024-09-13T17:01:49.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:49 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1342271093' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:01:49.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:49 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/12488908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:01:49.625 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:01:49.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:49 smithi094 ceph-mon[35259]: pgmap v672: 129 pgs: 129 active+clean; 478 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 668 op/s 2024-09-13T17:01:49.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:49 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1342271093' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:01:49.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:49 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/12488908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:01:49.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.784+0000 7f62ad800640 1 -- 172.21.15.18:0/3965890452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62a8072f10 msgr2=0x7f62a8073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.784+0000 7f62ad800640 1 --2- 172.21.15.18:0/3965890452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62a8072f10 0x7f62a8073370 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6290009860 tx=0x7f629002a340 comp rx=0 tx=0).stop 2024-09-13T17:01:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.784+0000 7f62ad800640 1 -- 172.21.15.18:0/3965890452 shutdown_connections 2024-09-13T17:01:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.784+0000 7f62ad800640 1 --2- 172.21.15.18:0/3965890452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62a8072f10 0x7f62a8073370 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.784+0000 7f62ad800640 1 --2- 172.21.15.18:0/3965890452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a8107be0 0x7f62a810a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.784+0000 7f62ad800640 1 --2- 172.21.15.18:0/3965890452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62a80744f0 0x7f62a8072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.784+0000 7f62ad800640 1 -- 172.21.15.18:0/3965890452 >> 172.21.15.18:0/3965890452 conn(0x7f62a80fb4d0 msgr2=0x7f62a80fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.784+0000 7f62ad800640 1 -- 172.21.15.18:0/3965890452 shutdown_connections 2024-09-13T17:01:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.784+0000 7f62ad800640 1 -- 172.21.15.18:0/3965890452 wait complete. 2024-09-13T17:01:49.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.785+0000 7f62ad800640 1 Processor -- start 2024-09-13T17:01:49.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.785+0000 7f62ad800640 1 -- start start 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.785+0000 7f62ad800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a8072f10 0x7f62a8197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.785+0000 7f62ad800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62a80744f0 0x7f62a81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.785+0000 7f62ad800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62a8107be0 0x7f62a819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.785+0000 7f62ad800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a819fa80 con 0x7f62a8107be0 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.785+0000 7f62ad800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a819fbf0 con 0x7f62a80744f0 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.785+0000 7f62ad800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a819fdb0 con 0x7f62a8072f10 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62a8107be0 0x7f62a819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a8072f10 0x7f62a8197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a8072f10 0x7f62a8197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:43992/0 (socket says 172.21.15.18:43992) 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a6a00640 1 -- 172.21.15.18:0/3235935728 learned_addr learned my addr 172.21.15.18:0/3235935728 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f629e000640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62a80744f0 0x7f62a81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a6a00640 1 -- 172.21.15.18:0/3235935728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62a80744f0 msgr2=0x7f62a81984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a6a00640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62a80744f0 0x7f62a81984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a6a00640 1 -- 172.21.15.18:0/3235935728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62a8107be0 msgr2=0x7f62a819f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a6a00640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62a8107be0 0x7f62a819f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a6a00640 1 -- 172.21.15.18:0/3235935728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6298009560 con 0x7f62a8072f10 2024-09-13T17:01:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a7400640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62a8107be0 0x7f62a819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:01:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.786+0000 7f62a6a00640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a8072f10 0x7f62a8197f90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f629800e9c0 tx=0x7f629800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.787+0000 7f629fe00640 1 -- 172.21.15.18:0/3235935728 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629800cde0 con 0x7f62a8072f10 2024-09-13T17:01:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.787+0000 7f629fe00640 1 -- 172.21.15.18:0/3235935728 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62980035f0 con 0x7f62a8072f10 2024-09-13T17:01:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.787+0000 7f629fe00640 1 -- 172.21.15.18:0/3235935728 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62980044e0 con 0x7f62a8072f10 2024-09-13T17:01:49.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.787+0000 7f62ad800640 1 -- 172.21.15.18:0/3235935728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6290009490 con 0x7f62a8072f10 2024-09-13T17:01:49.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.787+0000 7f62ad800640 1 -- 172.21.15.18:0/3235935728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a81a0390 con 0x7f62a8072f10 2024-09-13T17:01:49.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.788+0000 7f62ad800640 1 -- 172.21.15.18:0/3235935728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a8106960 con 0x7f62a8072f10 2024-09-13T17:01:49.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.790+0000 7f629fe00640 1 -- 172.21.15.18:0/3235935728 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6298003760 con 0x7f62a8072f10 2024-09-13T17:01:49.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.791+0000 7f629fe00640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f628c0a1110 0x7f628c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:49.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.791+0000 7f629fe00640 1 -- 172.21.15.18:0/3235935728 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f6298014070 con 0x7f62a8072f10 2024-09-13T17:01:49.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.792+0000 7f629e000640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f628c0a1110 0x7f628c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:49.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.792+0000 7f629e000640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f628c0a1110 0x7f628c0a35d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6290030410 tx=0x7f6290030580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:49.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.793+0000 7f629fe00640 1 -- 172.21.15.18:0/3235935728 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6298096560 con 0x7f62a8072f10 2024-09-13T17:01:49.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.975+0000 7f62ad800640 1 -- 172.21.15.18:0/3235935728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62a802c480 con 0x7f62a8072f10 2024-09-13T17:01:49.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.975+0000 7f629fe00640 1 -- 172.21.15.18:0/3235935728 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6298099b80 con 0x7f62a8072f10 2024-09-13T17:01:49.977 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-13T17:01:49.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 -- 172.21.15.18:0/3235935728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f628c0a1110 msgr2=0x7f628c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f628c0a1110 0x7f628c0a35d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6290030410 tx=0x7f6290030580 comp rx=0 tx=0).stop 2024-09-13T17:01:49.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 -- 172.21.15.18:0/3235935728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a8072f10 msgr2=0x7f62a8197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:49.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a8072f10 0x7f62a8197f90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f629800e9c0 tx=0x7f629800ee80 comp rx=0 tx=0).stop 2024-09-13T17:01:49.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 -- 172.21.15.18:0/3235935728 shutdown_connections 2024-09-13T17:01:49.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f628c0a1110 0x7f628c0a35d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62a8107be0 0x7f62a819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62a80744f0 0x7f62a81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 --2- 172.21.15.18:0/3235935728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a8072f10 0x7f62a8197f90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:49.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 -- 172.21.15.18:0/3235935728 >> 172.21.15.18:0/3235935728 conn(0x7f62a80fb4d0 msgr2=0x7f62a8103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:49.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 -- 172.21.15.18:0/3235935728 shutdown_connections 2024-09-13T17:01:49.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:49.978+0000 7f62ad800640 1 -- 172.21.15.18:0/3235935728 wait complete. 2024-09-13T17:01:49.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:01:50.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.156+0000 7f3f7c800640 1 -- 172.21.15.18:0/294786557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f74100f60 msgr2=0x7f3f741013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:50.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.156+0000 7f3f7c800640 1 --2- 172.21.15.18:0/294786557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f74100f60 0x7f3f741013e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009900 tx=0x7f3f6402a3f0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.156+0000 7f3f7c800640 1 -- 172.21.15.18:0/294786557 shutdown_connections 2024-09-13T17:01:50.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.156+0000 7f3f7c800640 1 --2- 172.21.15.18:0/294786557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f74101920 0x7f3f741081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.156+0000 7f3f7c800640 1 --2- 172.21.15.18:0/294786557 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f74100f60 0x7f3f741013e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.156+0000 7f3f7c800640 1 --2- 172.21.15.18:0/294786557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f740ffd70 0x7f3f74100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.156+0000 7f3f7c800640 1 -- 172.21.15.18:0/294786557 >> 172.21.15.18:0/294786557 conn(0x7f3f740fb4d0 msgr2=0x7f3f740fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:50.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.156+0000 7f3f7c800640 1 -- 172.21.15.18:0/294786557 shutdown_connections 2024-09-13T17:01:50.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.156+0000 7f3f7c800640 1 -- 172.21.15.18:0/294786557 wait complete. 2024-09-13T17:01:50.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.157+0000 7f3f7c800640 1 Processor -- start 2024-09-13T17:01:50.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.157+0000 7f3f7c800640 1 -- start start 2024-09-13T17:01:50.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.157+0000 7f3f7c800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f740ffd70 0x7f3f74197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:50.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.157+0000 7f3f7c800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f74100f60 0x7f3f741984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:50.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.157+0000 7f3f7c800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f74101920 0x7f3f7419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.157+0000 7f3f7c800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7419fa50 con 0x7f3f74100f60 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.157+0000 7f3f7c800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7419fbc0 con 0x7f3f740ffd70 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.157+0000 7f3f7c800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7419fd80 con 0x7f3f74101920 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.157+0000 7f3f79400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f74100f60 0x7f3f741984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f79e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f740ffd70 0x7f3f74197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f7a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f74101920 0x7f3f7419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f79e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f740ffd70 0x7f3f74197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:55562/0 (socket says 172.21.15.18:55562) 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f79e00640 1 -- 172.21.15.18:0/4014804183 learned_addr learned my addr 172.21.15.18:0/4014804183 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f79e00640 1 -- 172.21.15.18:0/4014804183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f74101920 msgr2=0x7f3f7419f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f79e00640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f74101920 0x7f3f7419f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f79e00640 1 -- 172.21.15.18:0/4014804183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f74100f60 msgr2=0x7f3f741984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f79e00640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f74100f60 0x7f3f741984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f79e00640 1 -- 172.21.15.18:0/4014804183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f64009560 con 0x7f3f740ffd70 2024-09-13T17:01:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f79e00640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f740ffd70 0x7f3f74197f60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800e9c0 tx=0x7f3f6800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.158+0000 7f3f6ea00640 1 -- 172.21.15.18:0/4014804183 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680096e0 con 0x7f3f740ffd70 2024-09-13T17:01:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.159+0000 7f3f6ea00640 1 -- 172.21.15.18:0/4014804183 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f680044f0 con 0x7f3f740ffd70 2024-09-13T17:01:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.159+0000 7f3f7c800640 1 -- 172.21.15.18:0/4014804183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f741a0060 con 0x7f3f740ffd70 2024-09-13T17:01:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.159+0000 7f3f6ea00640 1 -- 172.21.15.18:0/4014804183 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68010430 con 0x7f3f740ffd70 2024-09-13T17:01:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.159+0000 7f3f7c800640 1 -- 172.21.15.18:0/4014804183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f741a04f0 con 0x7f3f740ffd70 2024-09-13T17:01:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.160+0000 7f3f7c800640 1 -- 172.21.15.18:0/4014804183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7410b630 con 0x7f3f740ffd70 2024-09-13T17:01:50.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.162+0000 7f3f6ea00640 1 -- 172.21.15.18:0/4014804183 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3f680035f0 con 0x7f3f740ffd70 2024-09-13T17:01:50.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.163+0000 7f3f6ea00640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f5c0a1090 0x7f3f5c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:50.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.163+0000 7f3f6ea00640 1 -- 172.21.15.18:0/4014804183 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f3f68014070 con 0x7f3f740ffd70 2024-09-13T17:01:50.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.163+0000 7f3f79400640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f5c0a1090 0x7f3f5c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:50.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.164+0000 7f3f79400640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f5c0a1090 0x7f3f5c0a3550 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3f6402a9e0 tx=0x7f3f640314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:50.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.165+0000 7f3f6ea00640 1 -- 172.21.15.18:0/4014804183 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3f680964a0 con 0x7f3f740ffd70 2024-09-13T17:01:50.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.349+0000 7f3f7c800640 1 -- 172.21.15.18:0/4014804183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3f741a0950 con 0x7f3f740ffd70 2024-09-13T17:01:50.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.349+0000 7f3f6ea00640 1 -- 172.21.15.18:0/4014804183 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3f68099ac0 con 0x7f3f740ffd70 2024-09-13T17:01:50.351 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T17:01:50.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.351+0000 7f3f7c800640 1 -- 172.21.15.18:0/4014804183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f5c0a1090 msgr2=0x7f3f5c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:50.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.351+0000 7f3f7c800640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f5c0a1090 0x7f3f5c0a3550 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3f6402a9e0 tx=0x7f3f640314a0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.351+0000 7f3f7c800640 1 -- 172.21.15.18:0/4014804183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f740ffd70 msgr2=0x7f3f74197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:50.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.351+0000 7f3f7c800640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f740ffd70 0x7f3f74197f60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800e9c0 tx=0x7f3f6800ee80 comp rx=0 tx=0).stop 2024-09-13T17:01:50.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.352+0000 7f3f7c800640 1 -- 172.21.15.18:0/4014804183 shutdown_connections 2024-09-13T17:01:50.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.352+0000 7f3f7c800640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f5c0a1090 0x7f3f5c0a3550 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.352+0000 7f3f7c800640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f74100f60 0x7f3f741984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.352+0000 7f3f7c800640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f74101920 0x7f3f7419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.352+0000 7f3f7c800640 1 --2- 172.21.15.18:0/4014804183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f740ffd70 0x7f3f74197f60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.352+0000 7f3f7c800640 1 -- 172.21.15.18:0/4014804183 >> 172.21.15.18:0/4014804183 conn(0x7f3f740fb4d0 msgr2=0x7f3f741067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:50.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.352+0000 7f3f7c800640 1 -- 172.21.15.18:0/4014804183 shutdown_connections 2024-09-13T17:01:50.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.352+0000 7f3f7c800640 1 -- 172.21.15.18:0/4014804183 wait complete. 2024-09-13T17:01:50.370 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-13T17:01:50.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:50 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/97670379' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:01:50.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:50 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3235935728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:01:50.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.526+0000 7f180b200640 1 -- 172.21.15.18:0/820468981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f180c103960 msgr2=0x7f180c10a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:50.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.526+0000 7f180b200640 1 --2- 172.21.15.18:0/820468981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f180c103960 0x7f180c10a1f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1804009ca0 tx=0x7f180402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.526+0000 7f180b200640 1 -- 172.21.15.18:0/820468981 shutdown_connections 2024-09-13T17:01:50.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.526+0000 7f180b200640 1 --2- 172.21.15.18:0/820468981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f180c103960 0x7f180c10a1f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.526+0000 7f180b200640 1 --2- 172.21.15.18:0/820468981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f180c102fa0 0x7f180c103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.526+0000 7f180b200640 1 --2- 172.21.15.18:0/820468981 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f180c101db0 0x7f180c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.526+0000 7f180b200640 1 -- 172.21.15.18:0/820468981 >> 172.21.15.18:0/820468981 conn(0x7f180c0fd530 msgr2=0x7f180c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:50.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.526+0000 7f180b200640 1 -- 172.21.15.18:0/820468981 shutdown_connections 2024-09-13T17:01:50.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.526+0000 7f180b200640 1 -- 172.21.15.18:0/820468981 wait complete. 2024-09-13T17:01:50.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f180b200640 1 Processor -- start 2024-09-13T17:01:50.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f180b200640 1 -- start start 2024-09-13T17:01:50.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f180b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f180c101db0 0x7f180c197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:50.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f180b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f180c102fa0 0x7f180c1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:50.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f180b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f180c103960 0x7f180c19f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:50.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f180b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c19f810 con 0x7f180c102fa0 2024-09-13T17:01:50.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f180b200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c19f980 con 0x7f180c101db0 2024-09-13T17:01:50.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f180b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c19fb40 con 0x7f180c103960 2024-09-13T17:01:50.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f1803e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f180c102fa0 0x7f180c1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:50.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f1809e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f180c101db0 0x7f180c197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:50.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f1809e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f180c101db0 0x7f180c197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:55582/0 (socket says 172.21.15.18:55582) 2024-09-13T17:01:50.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.527+0000 7f1809e00640 1 -- 172.21.15.18:0/345876054 learned_addr learned my addr 172.21.15.18:0/345876054 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:01:50.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f180a800640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f180c103960 0x7f180c19f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:50.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f1803e00640 1 -- 172.21.15.18:0/345876054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f180c103960 msgr2=0x7f180c19f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:50.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f1803e00640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f180c103960 0x7f180c19f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f1803e00640 1 -- 172.21.15.18:0/345876054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f180c101db0 msgr2=0x7f180c197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:50.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f1803e00640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f180c101db0 0x7f180c197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:50.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f1803e00640 1 -- 172.21.15.18:0/345876054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc009490 con 0x7f180c102fa0 2024-09-13T17:01:50.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f180a800640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f180c103960 0x7f180c19f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:01:50.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f1809e00640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f180c101db0 0x7f180c197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:01:50.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f1803e00640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f180c102fa0 0x7f180c1982c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f17f400e9f0 tx=0x7f17f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:50.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f1802a00640 1 -- 172.21.15.18:0/345876054 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400ccc0 con 0x7f180c102fa0 2024-09-13T17:01:50.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f1802a00640 1 -- 172.21.15.18:0/345876054 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17f400ce20 con 0x7f180c102fa0 2024-09-13T17:01:50.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.528+0000 7f180b200640 1 -- 172.21.15.18:0/345876054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1804009900 con 0x7f180c102fa0 2024-09-13T17:01:50.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.529+0000 7f1802a00640 1 -- 172.21.15.18:0/345876054 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4018780 con 0x7f180c102fa0 2024-09-13T17:01:50.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.529+0000 7f180b200640 1 -- 172.21.15.18:0/345876054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c1a01a0 con 0x7f180c102fa0 2024-09-13T17:01:50.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.530+0000 7f180b200640 1 -- 172.21.15.18:0/345876054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c10d6a0 con 0x7f180c102fa0 2024-09-13T17:01:50.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.531+0000 7f1802a00640 1 -- 172.21.15.18:0/345876054 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f17f4010430 con 0x7f180c102fa0 2024-09-13T17:01:50.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.533+0000 7f1802a00640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f17f00a1090 0x7f17f00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:50.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.533+0000 7f1802a00640 1 -- 172.21.15.18:0/345876054 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f17f4014070 con 0x7f180c102fa0 2024-09-13T17:01:50.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.534+0000 7f1809e00640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f17f00a1090 0x7f17f00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:50.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.534+0000 7f1809e00640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f17f00a1090 0x7f17f00a3550 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f180c199200 tx=0x7f17fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:50.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.537+0000 7f1802a00640 1 -- 172.21.15.18:0/345876054 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f17f4052e20 con 0x7f180c102fa0 2024-09-13T17:01:50.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:50 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/97670379' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:01:50.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:50 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3235935728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:01:50.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:50 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/97670379' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:01:50.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:50 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3235935728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:01:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.771+0000 7f180b200640 1 -- 172.21.15.18:0/345876054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f180c10d8b0 con 0x7f180c102fa0 2024-09-13T17:01:50.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.781+0000 7f1802a00640 1 -- 172.21.15.18:0/345876054 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733406 (secure 0 0 0) 0x7f17f4099ed0 con 0x7f180c102fa0 2024-09-13T17:01:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T17:01:50.794 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T17:01:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 18, 2024-09-13T17:01:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: "active_gid": 14150, 2024-09-13T17:01:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: "active_name": "x", 2024-09-13T17:01:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addrs": { 2024-09-13T17:01:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-13T17:01:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 687548857 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 687548857 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addr": "172.21.15.18:6801/687548857", 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: "active_change": "2024-09-13T16:42:11.669611+0000", 2024-09-13T17:01:50.795 INFO:teuthology.orchestra.run.smithi018.stdout: "active_mgr_features": 4540138322906710015, 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "available": true, 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "standbys": [ 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 24112, 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "z", 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540138322906710015, 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:50.796 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.798 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:50.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.801 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.802 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.803 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.804 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.805 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.806 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-13T17:01:50.807 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.808 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.809 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.810 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:50.811 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.812 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-13T17:01:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-13T17:01:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:50.815 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.815 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-13T17:01:50.815 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:50.815 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-13T17:01:50.815 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.815 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T17:01:50.815 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.815 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.815 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T17:01:50.816 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.817 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.818 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-13T17:01:50.819 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.820 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.822 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.823 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.824 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-13T17:01:50.825 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-13T17:01:50.826 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap" 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.827 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T17:01:50.828 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.829 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.830 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-13T17:01:50.832 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.833 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.835 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.836 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.837 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.838 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.839 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T17:01:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T17:01:50.841 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.842 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.843 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.844 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.845 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.846 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.847 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.848 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.849 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.850 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.851 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.852 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.853 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.854 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.855 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.856 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T17:01:50.857 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T17:01:50.858 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T17:01:50.859 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.860 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.861 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.865 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.866 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.867 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.868 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.869 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.870 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.871 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T17:01:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.874 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.876 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T17:01:50.877 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-13T17:01:50.878 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-13T17:01:50.879 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.880 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.881 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.882 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.883 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.884 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.887 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.888 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.891 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.892 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:50.894 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-13T17:01:50.900 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.902 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.903 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.905 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.907 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.908 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.911 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T17:01:50.912 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T17:01:50.913 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.914 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.915 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T17:01:50.916 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T17:01:50.916 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.916 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.916 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.916 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.916 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.916 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.916 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.916 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.916 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.917 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.918 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.919 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-13T17:01:50.920 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.921 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.922 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.923 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.924 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.925 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.926 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.927 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.929 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.930 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.931 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.932 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.934 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.935 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.937 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.939 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.941 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.942 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.943 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.945 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T17:01:50.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-13T17:01:50.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.948 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-13T17:01:50.950 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-13T17:01:50.951 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.952 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.953 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.954 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.956 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.957 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.958 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.959 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-13T17:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.962 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.963 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-13T17:01:50.965 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.966 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.967 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.969 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:50.971 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.972 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.976 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.977 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.979 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.980 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:50.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.982 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.983 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.984 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.985 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.988 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.990 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.991 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.992 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-13T17:01:50.993 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:50.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:50.997 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:50.998 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.001 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:51.002 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-13T17:01:51.005 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.006 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.007 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.009 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.010 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.011 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.012 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.013 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.014 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.016 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.016 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.016 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.016 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.016 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.016 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.016 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.017 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.018 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.019 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.020 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.021 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.022 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.025 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.026 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T17:01:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-13T17:01:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-13T17:01:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T17:01:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-13T17:01:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-13T17:01:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-13T17:01:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-13T17:01:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-13T17:01:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-13T17:01:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-13T17:01:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-13T17:01:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-13T17:01:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-13T17:01:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-13T17:01:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-13T17:01:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-13T17:01:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-13T17:01:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-13T17:01:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-13T17:01:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-13T17:01:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.202 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.205 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.206 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.207 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.208 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.210 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.212 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.214 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.217 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.217 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-13T17:01:51.217 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.217 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.217 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.217 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.217 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.220 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.220 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-13T17:01:51.220 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-13T17:01:51.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.220 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.221 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.222 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.223 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.224 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.225 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.227 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-13T17:01:51.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-13T17:01:51.229 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 24116, 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "y", 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540138322906710015, 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:51.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.233 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.234 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.237 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.241 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.242 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-13T17:01:51.247 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.248 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:51.249 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.250 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.251 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.253 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.254 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.255 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.256 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.257 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.258 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.259 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.260 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap" 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-13T17:01:51.263 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.264 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.266 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.268 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.272 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-13T17:01:51.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-13T17:01:51.274 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.275 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.276 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.277 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.278 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:51.279 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T17:01:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T17:01:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T17:01:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-13T17:01:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-13T17:01:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-13T17:01:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-13T17:01:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-13T17:01:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-13T17:01:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-13T17:01:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-13T17:01:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-13T17:01:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-13T17:01:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T17:01:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T17:01:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T17:01:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T17:01:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T17:01:51.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.374 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.375 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.376 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.377 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T17:01:51.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T17:01:51.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.380 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.381 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.383 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.384 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.385 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.386 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.387 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.388 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.389 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.391 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.392 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.393 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-13T17:01:51.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-13T17:01:51.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-13T17:01:51.398 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.399 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.400 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.401 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-13T17:01:51.403 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.404 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.405 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.406 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.407 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.408 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.409 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.411 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.412 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.413 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.415 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.416 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.417 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.418 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.420 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.421 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-13T17:01:51.422 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.423 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.425 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-13T17:01:51.428 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:51.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.431 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.432 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.433 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.434 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.435 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.436 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.437 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.438 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.439 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.440 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.441 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.442 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.443 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.445 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.446 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.447 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.449 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.450 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.451 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.453 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-13T17:01:51.454 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.455 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.456 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.457 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.458 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.459 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.461 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.462 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.464 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.465 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.466 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.467 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.468 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-13T17:01:51.469 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.470 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.471 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.472 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.473 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.474 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.475 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.476 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.477 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.480 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.481 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.482 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.483 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.484 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.485 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.487 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.488 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.489 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.490 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.491 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.492 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.493 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.494 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.495 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.496 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.496 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.496 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.496 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.496 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.496 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.496 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.497 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.497 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.497 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.497 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.497 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.497 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.497 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.497 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.497 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.498 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.499 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.501 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.504 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.505 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.507 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.508 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.509 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.511 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.513 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.515 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.516 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.517 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.518 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.519 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-13T17:01:51.520 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.521 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.524 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.525 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.526 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.527 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.528 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.529 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.530 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.531 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.532 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.533 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.535 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.536 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.537 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.538 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-13T17:01:51.542 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-13T17:01:51.543 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.545 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.547 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.548 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-13T17:01:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.561 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.563 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-13T17:01:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.566 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.567 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.569 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.572 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.574 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.575 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.576 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.578 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.579 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.581 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.582 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.583 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.584 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.585 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-13T17:01:51.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-13T17:01:51.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-13T17:01:51.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-13T17:01:51.589 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.594 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.595 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.596 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.597 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.598 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.599 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.600 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.601 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-13T17:01:51.603 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.604 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.605 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.606 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.607 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.608 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.609 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.610 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.611 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.615 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-13T17:01:51.616 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.617 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.618 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.620 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.621 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-13T17:01:51.622 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T17:01:51.623 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.624 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.625 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.626 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.627 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-13T17:01:51.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.629 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.629 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.629 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.629 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.629 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.629 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.630 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T17:01:51.631 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.632 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.637 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.638 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.639 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.640 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.641 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.643 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-13T17:01:51.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.646 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.647 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.649 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.650 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.651 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.653 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.655 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.656 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-13T17:01:51.657 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:51.658 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.659 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-13T17:01:51.660 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.661 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.662 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.663 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.664 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.666 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.667 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.668 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.669 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.670 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.671 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: "modules": [ 2024-09-13T17:01:51.672 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "dashboard", 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "iostat", 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "nfs", 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "restful" 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:51.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.675 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.676 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.677 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.678 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.680 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.680 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-13T17:01:51.680 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-13T17:01:51.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.680 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.680 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.680 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.680 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.681 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.681 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-13T17:01:51.681 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.681 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.681 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.681 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-13T17:01:51.681 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-13T17:01:51.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.681 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.682 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.682 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-13T17:01:51.682 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.682 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.682 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.682 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-13T17:01:51.682 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.682 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.682 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.684 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.684 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-13T17:01:51.684 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-13T17:01:51.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.684 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.684 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.685 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.685 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.685 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.685 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-13T17:01:51.685 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.685 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.686 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-13T17:01:51.687 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.688 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.689 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-13T17:01:51.690 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.691 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.695 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T17:01:51.696 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T17:01:51.697 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T17:01:51.698 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.700 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.702 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.703 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T17:01:51.704 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-13T17:01:51.705 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap" 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.706 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.707 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.708 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.709 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.710 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.711 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.713 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T17:01:51.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.715 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.716 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.717 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T17:01:51.717 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.717 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.717 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.717 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-13T17:01:51.717 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-13T17:01:51.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.717 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.717 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-13T17:01:51.718 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.719 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.720 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-13T17:01:51.720 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-13T17:01:51.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.720 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.720 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.720 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.720 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.720 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.721 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T17:01:51.721 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.721 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.721 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.721 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-13T17:01:51.721 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-13T17:01:51.721 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.721 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.721 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-13T17:01:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.723 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T17:01:51.725 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.726 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.727 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-13T17:01:51.729 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.730 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.731 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.732 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-13T17:01:51.732 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-13T17:01:51.732 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.732 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.732 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.732 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T17:01:51.732 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.732 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.732 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T17:01:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-13T17:01:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-13T17:01:51.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.735 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.735 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T17:01:51.735 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.735 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.735 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.735 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-13T17:01:51.735 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.735 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.736 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.736 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-13T17:01:51.736 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-13T17:01:51.736 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.736 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.736 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.736 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T17:01:51.736 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.736 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.737 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.739 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-13T17:01:51.740 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.741 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.742 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.744 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-13T17:01:51.744 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-13T17:01:51.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.744 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.744 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-13T17:01:51.744 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.744 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.744 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.744 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-13T17:01:51.745 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.745 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.745 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-13T17:01:51.745 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-13T17:01:51.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.745 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.745 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.745 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-13T17:01:51.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.748 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-13T17:01:51.748 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-13T17:01:51.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.748 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.748 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:51.748 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.748 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.748 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.748 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.750 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.751 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.752 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.752 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.752 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.752 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.752 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.752 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.752 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.752 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.752 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.753 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.756 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.757 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.757 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.757 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.757 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.757 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.757 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.757 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.757 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.757 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.758 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.759 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.760 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.761 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.762 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.764 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.765 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-13T17:01:51.766 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.767 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.768 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.769 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.770 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.771 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.772 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.773 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.774 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.776 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-13T17:01:51.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-13T17:01:51.778 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.779 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.780 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.781 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.783 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.784 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.785 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.787 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.789 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.790 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.791 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.792 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.793 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.794 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.795 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.796 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.797 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.799 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.801 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T17:01:51.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.803 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.809 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.810 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.812 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.814 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.815 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.816 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.817 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.818 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.819 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.820 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.821 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.822 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.823 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.826 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.827 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T17:01:51.828 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T17:01:51.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T17:01:51.830 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.831 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.832 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.833 INFO:teuthology.orchestra.run.smithi018.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.834 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.835 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T17:01:51.836 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-13T17:01:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-13T17:01:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.841 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.842 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.843 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.844 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.846 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.847 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.848 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.849 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.851 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.851 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.851 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.851 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.851 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-13T17:01:51.851 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-13T17:01:51.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.851 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.852 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-13T17:01:51.852 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.852 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.852 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.852 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.852 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.852 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.852 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.853 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.854 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.854 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.854 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-13T17:01:51.854 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-13T17:01:51.854 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.854 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.854 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.854 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-13T17:01:51.854 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.855 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.856 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.858 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.859 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.860 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.861 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.863 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.865 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.866 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.868 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T17:01:51.869 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T17:01:51.870 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T17:01:51.872 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.873 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.874 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.875 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.876 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.877 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.878 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.879 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.881 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.882 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.883 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.887 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.888 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.889 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.891 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.893 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.894 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:51.895 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.896 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-13T17:01:51.897 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.898 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.899 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.900 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.901 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.902 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.903 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.905 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.907 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.908 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.909 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-13T17:01:51.910 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-13T17:01:51.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.912 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.913 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.914 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.915 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.916 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.917 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.919 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.921 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.922 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.926 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-13T17:01:51.927 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-13T17:01:51.928 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.932 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.933 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.934 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.936 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.937 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.938 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.939 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.940 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.941 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.942 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.944 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.951 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.952 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.953 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.955 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.956 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.957 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.958 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.960 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.961 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.964 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.965 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.966 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.967 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.969 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.971 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.972 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.973 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-13T17:01:51.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-13T17:01:51.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.977 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.978 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.979 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.980 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.982 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.984 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.985 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.986 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.988 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:51.989 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:51.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-13T17:01:51.991 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.992 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.996 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.997 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-13T17:01:51.998 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-13T17:01:51.999 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.000 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.001 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.002 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.003 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.004 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.005 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.006 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.007 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.008 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.009 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.010 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.012 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.013 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.014 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.016 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.017 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.020 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.021 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.022 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.034 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.034 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.036 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.036 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.036 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.037 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.038 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.041 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.043 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.045 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.047 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.048 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.049 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.050 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.051 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.052 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.053 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.055 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.056 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.057 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.058 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.059 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.060 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.061 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.062 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.063 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.064 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.066 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.071 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.072 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.073 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.074 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-13T17:01:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-13T17:01:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-13T17:01:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "services": { 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "dashboard": "https://172.21.15.18:8443/" 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "always_on_modules": { 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "octopus": [ 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-13T17:01:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "pacific": [ 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-13T17:01:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "quincy": [ 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-13T17:01:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "reef": [ 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-13T17:01:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "last_failure_osd_epoch": 3, 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "active_clients": [ 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-13T17:01:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1733204451 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "libcephsqlite", 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 684823669 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2679332757 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-13T17:01:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-13T17:01:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-13T17:01:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-13T17:01:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2278832128 2024-09-13T17:01:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-13T17:01:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-13T17:01:52.137 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T17:01:52.138 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:51 smithi094 ceph-mon[35259]: pgmap v673: 129 pgs: 129 active+clean; 472 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 572 op/s 2024-09-13T17:01:52.139 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:51 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/4014804183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:01:52.139 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:51 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/345876054' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T17:01:52.139 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:51 smithi144 ceph-mon[35328]: pgmap v673: 129 pgs: 129 active+clean; 472 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 572 op/s 2024-09-13T17:01:52.139 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:51 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/4014804183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:01:52.139 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:51 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/345876054' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T17:01:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 -- 172.21.15.18:0/345876054 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f17f00a1090 msgr2=0x7f17f00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f17f00a1090 0x7f17f00a3550 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f180c199200 tx=0x7f17fc005f90 comp rx=0 tx=0).stop 2024-09-13T17:01:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 -- 172.21.15.18:0/345876054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f180c102fa0 msgr2=0x7f180c1982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f180c102fa0 0x7f180c1982c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f17f400e9f0 tx=0x7f17f400eeb0 comp rx=0 tx=0).stop 2024-09-13T17:01:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 -- 172.21.15.18:0/345876054 shutdown_connections 2024-09-13T17:01:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f17f00a1090 0x7f17f00a3550 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f180c102fa0 0x7f180c1982c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f180c103960 0x7f180c19f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 --2- 172.21.15.18:0/345876054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f180c101db0 0x7f180c197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:52.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 -- 172.21.15.18:0/345876054 >> 172.21.15.18:0/345876054 conn(0x7f180c0fd530 msgr2=0x7f180c0ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:52.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 -- 172.21.15.18:0/345876054 shutdown_connections 2024-09-13T17:01:52.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:01:50.789+0000 7f180b200640 1 -- 172.21.15.18:0/345876054 wait complete. 2024-09-13T17:01:52.196 DEBUG:tasks.check_counter:Getting stats from a 2024-09-13T17:01:52.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-13T17:01:52.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:51 smithi018 ceph-mon[30981]: pgmap v673: 129 pgs: 129 active+clean; 472 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 572 op/s 2024-09-13T17:01:52.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:51 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4014804183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:01:52.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:51 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/345876054' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T17:01:52.607 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:01:53.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:53 smithi144 ceph-mon[35328]: pgmap v674: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 908 KiB/s wr, 560 op/s 2024-09-13T17:01:53.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:53 smithi094 ceph-mon[35259]: pgmap v674: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 908 KiB/s wr, 560 op/s 2024-09-13T17:01:53.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:53 smithi018 ceph-mon[30981]: pgmap v674: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 908 KiB/s wr, 560 op/s 2024-09-13T17:01:55.522 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:55 smithi144 ceph-mon[35328]: pgmap v675: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 907 KiB/s wr, 463 op/s 2024-09-13T17:01:55.528 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:55 smithi018 ceph-mon[30981]: pgmap v675: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 907 KiB/s wr, 463 op/s 2024-09-13T17:01:55.529 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T17:01:55.529 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:01:55.529 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 4, 2024-09-13T17:01:55.529 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 4, 2024-09-13T17:01:55.529 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 2944, 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 448, 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.006541091, 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000080736, 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003307344, 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3, 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.005943229, 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001981076 2024-09-13T17:01:55.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1, 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 154, 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 160, 2024-09-13T17:01:55.531 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 103184, 2024-09-13T17:01:55.532 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 3, 2024-09-13T17:01:55.532 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-13T17:01:55.532 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.017502450, 2024-09-13T17:01:55.532 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.014245756, 2024-09-13T17:01:55.532 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.001381743, 2024-09-13T17:01:55.532 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:01:55.532 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:01:55.532 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 152, 2024-09-13T17:01:55.532 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.021372489, 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000140608 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 103184 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:01:55.533 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 206, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 203, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 468656, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 115616, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.052354435, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.024545320, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.029250695, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 202, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.052709878, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000260939 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 468656, 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 115616 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-13T17:01:55.535 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:01:55.536 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-13T17:01:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:01:55.538 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:01:55.538 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:01:55.538 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-13T17:01:55.538 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-13T17:01:55.538 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-13T17:01:55.538 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:01:55.538 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:01:55.538 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:01:55.538 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148967, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 29, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:01:55.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-13T17:01:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 207, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 439535, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 207, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 207, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 439535, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:01:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:55.542 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:55.542 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T17:01:55.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:55 smithi094 ceph-mon[35259]: pgmap v675: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 907 KiB/s wr, 463 op/s 2024-09-13T17:01:56.328 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-13T17:01:56.328 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-13T17:01:56.328 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-13T17:01:56.328 DEBUG:tasks.check_counter:Getting stats from d 2024-09-13T17:01:56.329 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-13T17:01:56.655 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:01:57.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:57 smithi144 ceph-mon[35328]: pgmap v676: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 893 KiB/s wr, 363 op/s 2024-09-13T17:01:57.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:57 smithi094 ceph-mon[35259]: pgmap v676: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 893 KiB/s wr, 363 op/s 2024-09-13T17:01:57.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:57 smithi018 ceph-mon[30981]: pgmap v676: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 893 KiB/s wr, 363 op/s 2024-09-13T17:01:58.845 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 217, 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 212, 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 473568, 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 119776, 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.053680387, 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.023664636, 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.028556772, 2024-09-13T17:01:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 212, 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.054692252, 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000257982 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 473568, 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 119776 2024-09-13T17:01:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1, 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 159, 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 160, 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 104064, 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 3, 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.020023282, 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.016795721, 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.001418664, 2024-09-13T17:01:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 157, 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.016819334, 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000107129 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T17:01:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 104064 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.000803122, 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000673434, 2024-09-13T17:01:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:01:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:01:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:01:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:01:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:01:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:01:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:01:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:01:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:01:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-13T17:01:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:01:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:01:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:01:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-13T17:01:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-13T17:01:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-13T17:01:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:01:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:01:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:01:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:01:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148984, 2024-09-13T17:01:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:01:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-13T17:01:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 214, 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 440509, 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 214, 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 214, 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 440509, 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:01:58.859 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T17:01:59.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:01:59 smithi144 ceph-mon[35328]: pgmap v677: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 441 KiB/s wr, 247 op/s 2024-09-13T17:01:59.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:01:59 smithi094 ceph-mon[35259]: pgmap v677: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 441 KiB/s wr, 247 op/s 2024-09-13T17:01:59.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:01:59 smithi018 ceph-mon[30981]: pgmap v677: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 441 KiB/s wr, 247 op/s 2024-09-13T17:01:59.746 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-13T17:01:59.746 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-13T17:01:59.746 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-13T17:01:59.746 DEBUG:tasks.check_counter:Getting stats from g 2024-09-13T17:01:59.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-13T17:02:00.069 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:02:01.416 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:01 smithi018 ceph-mon[30981]: pgmap v678: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 92 op/s 2024-09-13T17:02:01.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:01 smithi094 ceph-mon[35259]: pgmap v678: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 92 op/s 2024-09-13T17:02:01.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:01 smithi144 ceph-mon[35328]: pgmap v678: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 92 op/s 2024-09-13T17:02:02.162 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T17:02:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:02:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 40939, 2024-09-13T17:02:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 53159, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 22106430, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 141367988, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 8, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 7.043525737, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 2.674839464, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 2.863875167, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 1.852834871, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 53158, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 16.326236718, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000307126 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 56381, 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.027030469, 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000479 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 540256, 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 123456 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 37092, 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 43857, 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 24725105, 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 153369616, 2024-09-13T17:02:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 14, 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 8, 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 7.162609729, 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 2.597431072, 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 2.416310701, 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 2.293527908, 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 43856, 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 16.402244183, 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000374002 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 45251, 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.037484939, 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000828 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 4032, 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 343408 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 219005, 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 399792, 2024-09-13T17:02:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 74568742, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 329594938, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 9, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 6, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 80.767115436, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 67.064171009, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 53.252443792, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 2.943329875, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 399790, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 189.174676337, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000473185 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 268486, 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.201805208, 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000751 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-09-13T17:02:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 5968, 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 171.921428967, 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.028807209 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 41734, 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 17.660260721, 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000423162 2024-09-13T17:02:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 123817, 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 114745, 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 114745, 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 2087.843570682, 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.018195508 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 9058, 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 132, 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-09-13T17:02:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 1069, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 113, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 2, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 283, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 184, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 84, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 15, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 18, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 64582, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 0, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 0, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 4, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 183472, 2024-09-13T17:02:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 159422, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 8943, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 532, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 44, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 371, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 24020, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 1, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 193, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 50663, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 331, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 33249, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-09-13T17:02:02.172 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 0, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 4, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 234, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 0, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 0, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T17:02:02.173 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 0, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 314, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 24426, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 61236, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 1, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 56437, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 28764, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 1712, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 61012 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 0, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 3, 2024-09-13T17:02:02.174 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 2, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 540, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 1126, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 5, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 25075, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 25070, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-09-13T17:02:02.175 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 193, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 115, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 154366, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 55911, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 55911, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 98455, 2024-09-13T17:02:02.176 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 5041, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 199, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 71, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 71, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 135, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 7, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 146802843, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 382532840, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 0, 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 4328, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 1193.032687132, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.275654502 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 0 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 32, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 54564, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 54532, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 65, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 2169, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 2104, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 283, 2024-09-13T17:02:02.178 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 119125, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 118842, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 0, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 55777, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 55777, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 115888, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 198932 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 138510, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 3036, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 123817, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 301, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 5864, 2024-09-13T17:02:02.179 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 32236, 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 361.640721075, 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.011218535 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1464, 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 249.371266590, 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.170335564 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.180 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.181 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-09-13T17:02:02.181 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.181 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.181 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.181 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-09-13T17:02:02.181 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 18853, 2024-09-13T17:02:02.181 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 656.394972184, 2024-09-13T17:02:02.181 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.034816473 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-09-13T17:02:02.182 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.183 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-09-13T17:02:02.184 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.184 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.184 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 209, 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 12.276315792, 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.058738353 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-09-13T17:02:02.185 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 9112, 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 126.282316987, 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.013858902 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 871, 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 3.570576452, 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.004099398 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.186 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 32234, 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 623.521401296, 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.019343593 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 139, 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 20.646722051, 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.148537568 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.188 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1, 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.145562985, 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.145562985 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.190 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 19626, 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 33.993715270, 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001732075 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.191 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 1, 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 2, 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 1, 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 1, 2024-09-13T17:02:02.192 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 18337, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 18337, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 1719, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:02:02.193 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-13T17:02:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-13T17:02:02.195 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:02:02.196 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:02:02.196 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:02:02.196 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:02:02.196 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 303460, 2024-09-13T17:02:02.196 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 128, 2024-09-13T17:02:02.196 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 264, 2024-09-13T17:02:02.196 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 3, 2024-09-13T17:02:02.196 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-13T17:02:02.196 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 9048, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 170, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 379647, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 4687, 2024-09-13T17:02:02.197 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 60220, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 404850055, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 27, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 60220, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 60220, 2024-09-13T17:02:02.198 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 1895.454212615, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.031475493 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 60220, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 64030 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 60220, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 1079, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 59141, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 41, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 1480, 2024-09-13T17:02:02.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 730, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 5063, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 377, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 113, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 50936, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 2, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 2236, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-09-13T17:02:02.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 1, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-09-13T17:02:02.201 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 94, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-09-13T17:02:02.202 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 5, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 12, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 12, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 2321, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 481, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 249 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 1, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-09-13T17:02:02.203 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: "osd-slow-ops": { 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 5 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 24, 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 9, 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 50790, 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 25070, 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-09-13T17:02:02.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 297032, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 97717594, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 297032, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 297032, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 97717594, 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-13T17:02:02.205 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:02.206 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 60220, 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 407572713, 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 60220, 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 407572713, 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-09-13T17:02:02.207 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 60220, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 60220, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 60220, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 60220, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 25070, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 2732342, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 25070, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 735, 2024-09-13T17:02:02.209 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 2732342, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x55d7d43fc500": { 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 154366, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 378338536, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 154366, 2024-09-13T17:02:02.210 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-13T17:02:02.211 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-13T17:02:02.211 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 4328, 2024-09-13T17:02:02.211 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 378338536, 2024-09-13T17:02:02.211 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-13T17:02:02.211 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:02.211 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:02.211 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:02.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:02.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:02.211 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T17:02:03.024 INFO:tasks.check_counter:Daemon mds.g mds.exported=193 2024-09-13T17:02:03.024 INFO:tasks.check_counter:Daemon mds.g mds.imported=331 2024-09-13T17:02:03.024 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=113 2024-09-13T17:02:03.025 DEBUG:tasks.check_counter:Getting stats from j 2024-09-13T17:02:03.025 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-13T17:02:03.348 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:02:03.526 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:03 smithi018 ceph-mon[30981]: pgmap v679: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 52 op/s 2024-09-13T17:02:03.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:03 smithi094 ceph-mon[35259]: pgmap v679: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 52 op/s 2024-09-13T17:02:03.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:03 smithi144 ceph-mon[35328]: pgmap v679: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 52 op/s 2024-09-13T17:02:05.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:05 smithi018 ceph-mon[30981]: pgmap v680: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-13T17:02:05.533 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T17:02:05.533 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:02:05.533 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 216, 2024-09-13T17:02:05.533 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 213, 2024-09-13T17:02:05.533 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 471440, 2024-09-13T17:02:05.533 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 121104, 2024-09-13T17:02:05.533 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.064637090, 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.036333173, 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.027028697, 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 212, 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.036036043, 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000169981 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:05.534 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 471440, 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 121104 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1, 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 161, 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 160, 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 104416, 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 3, 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-13T17:02:05.535 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.018777127, 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.015499434, 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.001338700, 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 159, 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.015425364, 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000097014 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:05.536 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 104416 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 4, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 4, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 2944, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 448, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.003547883, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000043840, 2024-09-13T17:02:05.537 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003489844, 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3, 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.006267383, 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.002089127 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-13T17:02:05.538 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:02:05.539 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:02:05.540 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:02:05.541 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148984, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-13T17:02:05.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-13T17:02:05.543 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 217, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 440899, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 217, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 217, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 440899, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-13T17:02:05.544 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-13T17:02:05.545 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-13T17:02:05.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:05.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-13T17:02:05.545 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T17:02:05.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:05 smithi094 ceph-mon[35259]: pgmap v680: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-13T17:02:05.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:05 smithi144 ceph-mon[35328]: pgmap v680: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-13T17:02:06.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:06 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:02:06.533 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-13T17:02:06.533 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-13T17:02:06.533 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-13T17:02:06.533 DEBUG:tasks.check_counter:Getting stats from b 2024-09-13T17:02:06.534 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-13T17:02:06.626 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:06 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:02:06.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:06 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:02:06.806 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:02:07.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:07 smithi094 ceph-mon[35259]: pgmap v681: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-13T17:02:07.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:07 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:02:07.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:07 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:02:07.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:07 smithi094 ceph-mon[35259]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T17:02:07.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:07 smithi018 ceph-mon[30981]: pgmap v681: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-13T17:02:07.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:07 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:02:07.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:07 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:02:07.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:07 smithi018 ceph-mon[30981]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T17:02:07.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:07 smithi144 ceph-mon[35328]: pgmap v681: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-13T17:02:07.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:07 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:02:07.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:07 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:02:07.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:07 smithi144 ceph-mon[35328]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T17:02:08.615 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-13T17:02:08.615 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:02:08.615 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 78427, 2024-09-13T17:02:08.615 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 66191, 2024-09-13T17:02:08.615 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 43098703, 2024-09-13T17:02:08.615 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 187145827, 2024-09-13T17:02:08.615 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 77, 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 3, 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 5.105395890, 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 1.741231222, 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 1.899056021, 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 1.757388611, 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 66191, 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 49.792200071, 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000752250 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 55196, 2024-09-13T17:02:08.616 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.007354522, 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000133 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 64535, 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 65961, 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 31386530, 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 118549990, 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 7, 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 5, 2024-09-13T17:02:08.617 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 4.322617324, 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 1.458246608, 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 1.350350548, 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 1.557900792, 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 65962, 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 39.674396783, 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000601473 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 44347, 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.008538662, 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000192 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.618 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 552528, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 126704 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 229709, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 344612, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 76078115, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 210628814, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 18, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 8, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 11.575508668, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 5.057880185, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 7.494540450, 2024-09-13T17:02:08.619 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 1.954825580, 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 344607, 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 98.809637854, 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000286731 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 181323, 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.049707637, 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000274 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 53376, 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 387696 2024-09-13T17:02:08.620 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.621 INFO:teuthology.orchestra.run.smithi094.stdout: "cct": { 2024-09-13T17:02:08.621 INFO:teuthology.orchestra.run.smithi094.stdout: "total_workers": 1, 2024-09-13T17:02:08.621 INFO:teuthology.orchestra.run.smithi094.stdout: "unhealthy_workers": 0 2024-09-13T17:02:08.621 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.621 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-MDSRank": { 2024-09-13T17:02:08.621 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-09-13T17:02:08.621 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 7327, 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 56.835635422, 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.007757013 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-PurgeQueue": { 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 40634, 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 6.372058230, 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000156815 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:08.622 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": { 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "request": 90068, 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "reply": 88833, 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "reply_latency": { 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 88833, 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 794.610299369, 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.008944990 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_reply": 0, 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "forward": 1220, 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_complete": 42, 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_keys": 0, 2024-09-13T17:02:08.623 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_commit": 5135, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_split": 74, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_merge": 0, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes": 24, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_top": 5, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_bottom": 9, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pin_tail": 10, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pinned": 16, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_expired": 38329, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_with_caps": 2, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": 2, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "subtrees": 3, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse": 144013, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_hit": 123314, 2024-09-13T17:02:08.624 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_forward": 990, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_discover": 609, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_dir_fetch": 0, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_remote_ino": 0, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_lock": 403, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "load_cent": 72, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "q": 0, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "exported": 186, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "exported_inodes": 25484, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "imported": 269, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "imported_inodes": 36301, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_dir_fetch": 0, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_backtrace_fetch": 0, 2024-09-13T17:02:08.625 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_peer_discover": 0, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rfiles": 4, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rbytes": 234, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rsnaps": 0, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_set_tag": 0, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_inodes": 0, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_file_inodes": 0, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_inode_file_caps": 169, 2024-09-13T17:02:08.626 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_revoke": 17361, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_grant": 40415, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_trunc": 5, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps": 43018, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps_dirty": 19772, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_cap_release": 757, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "process_request_cap_release": 45503 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_cache": { 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update": 3, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update_receipt": 3, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_try_discover": 2, 2024-09-13T17:02:08.627 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_send_discover": 935, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_handle_discover": 638, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays": 1, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_delayed": 0, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_created": 22241, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_enqueued": 22240, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_reintegrated": 0, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_migrated": 0, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_processing": 0, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_started": 0, 2024-09-13T17:02:08.628 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_completed": 0, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_exportdir": 188, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_flush": 0, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragmentdir": 76, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragstats": 0, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_inodestats": 0 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_log": { 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "evadd": 106182, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "evex": 106085, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "evtrm": 106085, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "ev": 97, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "evexg": 0, 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi094.stdout: "evexd": 1398, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "segadd": 157, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "segex": 156, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "segtrm": 156, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "seg": 3, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "segexg": 0, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "segexd": 2, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "expos": 246743477, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "wrpos": 246926789, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "rdpos": 0, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "jlat": { 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 2507, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 223.607985513, 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.089193452 2024-09-13T17:02:08.630 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "replayed": 0 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_mem": { 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "ino": 27, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "ino+": 38674, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "ino-": 38647, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "dir": 25, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "dir+": 1674, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "dir-": 1649, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "dn": 24, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "dn+": 87549, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "dn-": 87525, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "cap": 2, 2024-09-13T17:02:08.631 INFO:teuthology.orchestra.run.smithi094.stdout: "cap+": 40238, 2024-09-13T17:02:08.632 INFO:teuthology.orchestra.run.smithi094.stdout: "cap-": 40236, 2024-09-13T17:02:08.632 INFO:teuthology.orchestra.run.smithi094.stdout: "rss": 139640, 2024-09-13T17:02:08.632 INFO:teuthology.orchestra.run.smithi094.stdout: "heap": 207124 2024-09-13T17:02:08.632 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.632 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_server": { 2024-09-13T17:02:08.632 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_client_request": 99240, 2024-09-13T17:02:08.632 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_server_request": 2421, 2024-09-13T17:02:08.632 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_request": 90068, 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_session": 321, 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_peer_request": 4171, 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "req_create_latency": { 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 16085, 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 46.620561751, 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.002898387 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getattr_latency": { 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1322, 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 23.762087422, 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.017974347 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getfilelock_latency": { 2024-09-13T17:02:08.633 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "req_link_latency": { 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookup_latency": { 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 31208, 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 420.977472143, 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.013489408 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.634 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookuphash_latency": { 2024-09-13T17:02:08.636 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.636 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupino_latency": { 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1, 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000291001, 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000291001 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupname_latency": { 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupparent_latency": { 2024-09-13T17:02:08.637 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupsnap_latency": { 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lssnap_latency": { 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mkdir_latency": { 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 95, 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 20.288495846, 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.213563114 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mknod_latency": { 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mksnap_latency": { 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.639 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: "req_open_latency": { 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 5171, 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 8.569097647, 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.001657145 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: "req_readdir_latency": { 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 848, 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 1.624416786, 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.001915585 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rename_latency": { 2024-09-13T17:02:08.640 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 15733, 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 227.720794313, 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.014474085 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "req_renamesnap_latency": { 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "req_snapdiff_latency": { 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.641 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmdir_latency": { 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 132, 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 21.724531201, 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.164579781 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmsnap_latency": { 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmxattr_latency": { 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setattr_latency": { 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 7, 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.023754277, 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.003393468 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setdirlayout_latency": { 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setfilelock_latency": { 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.643 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setlayout_latency": { 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setxattr_latency": { 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 8, 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.020687914, 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.002585989 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.644 INFO:teuthology.orchestra.run.smithi094.stdout: "req_symlink_latency": { 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 3, 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.002076668, 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000692222 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "req_unlink_latency": { 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 18220, 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 23.276032400, 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.001277499 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getvxattr_latency": { 2024-09-13T17:02:08.645 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_sessions": { 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "session_count": 1, 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "session_add": 3, 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "session_remove": 2, 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_open": 1, 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_stale": 0, 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "total_load": 13300, 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "average_load": 13300, 2024-09-13T17:02:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: "avg_session_uptime": 596, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "mdthresh_evicted": 0 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "mempool": { 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_bytes": 360, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_items": 360, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:02:08.647 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_items": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_items": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:02:08.648 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_items": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_items": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_bytes": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_items": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:02:08.649 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_bytes": 296825, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_items": 105, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_bytes": 176, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_items": 2, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_bytes": 0, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_items": 0, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_items": 0, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_items": 0, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_bytes": 9048, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_items": 170, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_bytes": 0, 2024-09-13T17:02:08.650 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_items": 0, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_bytes": 114503, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_items": 839, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_bytes": 0, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_items": 0, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_bytes": 0, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_items": 0 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "objecter": { 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "op_active": 0, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "op_laggy": 0, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send": 129187, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send_bytes": 323468247, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "op_resend": 37, 2024-09-13T17:02:08.651 INFO:teuthology.orchestra.run.smithi094.stdout: "op_reply": 129187, 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "op_latency": { 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 129187, 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 101041.370699838, 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.782132650 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "op_inflight": 0, 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "oplen_avg": { 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 129187, 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 251921 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "op": 129187, 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "op_r": 687, 2024-09-13T17:02:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: "op_w": 128500, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "op_rmw": 0, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "op_pg": 0, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_stat": 4397, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_create": 73881, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_read": 568, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_write": 3076, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writefull": 433, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writesame": 0, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_append": 0, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_zero": 0, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_truncate": 74, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_delete": 45732, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_mapext": 0, 2024-09-13T17:02:08.653 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_sparse_read": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_clonerange": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_getxattr": 3, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_setxattr": 111702, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_rmxattr": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_call": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_watch": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_notify": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_other": 5, 2024-09-13T17:02:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_active": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_send": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_resend": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_ping": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_active": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_send": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_resend": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_active": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_send": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_resend": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_active": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_send": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_resend": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "command_active": 0, 2024-09-13T17:02:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: "command_send": 0, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "command_resend": 0, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "map_epoch": 94, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "map_full": 0, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "map_inc": 10, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_sessions": 12, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_open": 12, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_close": 0, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_laggy": 0, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_wr": 9663, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_rd": 161, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_del": 2226 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.656 INFO:teuthology.orchestra.run.smithi094.stdout: "oft": { 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_objs": 1, 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_updates": 0, 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_removes": 0 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "osd-slow-ops": { 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_ops_count": 0 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "purge_queue": { 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops": 0, 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops_high_water": 24, 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing": 0, 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_high_water": 9, 2024-09-13T17:02:08.657 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed_ops": 45106, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed": 22240, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_item_in_journal": 0 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 372667, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 119949807, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 372667, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-09-13T17:02:08.658 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 372667, 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 119949807, 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_bytes": { 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-09-13T17:02:08.659 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 129187, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 325888736, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 129187, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 325888736, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_ops": { 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 1024, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 129187, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 129187, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 129187, 2024-09-13T17:02:08.661 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 129187, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 22240, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 2423848, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 22240, 2024-09-13T17:02:08.662 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 569, 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 2423848, 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle-0x561b832b0500": { 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-09-13T17:02:08.663 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 106182, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 242732485, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 106182, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 2507, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 242732485, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:08.664 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:08.665 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:08.665 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-13T17:02:09.414 INFO:tasks.check_counter:Daemon mds.b mds.exported=186 2024-09-13T17:02:09.415 INFO:tasks.check_counter:Daemon mds.b mds.imported=269 2024-09-13T17:02:09.415 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=74 2024-09-13T17:02:09.415 DEBUG:tasks.check_counter:Getting stats from e 2024-09-13T17:02:09.415 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-13T17:02:09.611 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:02:09.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:09 smithi094 ceph-mon[35259]: pgmap v682: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-13T17:02:09.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:09 smithi018 ceph-mon[30981]: pgmap v682: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-13T17:02:09.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:09 smithi144 ceph-mon[35328]: pgmap v682: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-13T17:02:11.366 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 220, 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 215, 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 474384, 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 121552, 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 4, 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 0, 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.030430135, 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.012433762, 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.021714206, 2024-09-13T17:02:11.367 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 215, 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.015898741, 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000073947 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 474384, 2024-09-13T17:02:11.368 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 121552 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 1, 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 161, 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 160, 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 104416, 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 3, 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 2, 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.007889813, 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.005945942, 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.000518950, 2024-09-13T17:02:11.369 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 159, 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.008698280, 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000054706 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 104416 2024-09-13T17:02:11.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 0, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 2, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 0, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 0, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 2, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 1, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.000210902, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.000128633, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:11.371 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: "cct": { 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: "total_workers": 0, 2024-09-13T17:02:11.372 INFO:teuthology.orchestra.run.smithi094.stdout: "unhealthy_workers": 0 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "mempool": { 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_items": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:02:11.373 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_items": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_items": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:02:11.374 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_items": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_items": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_bytes": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_items": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:02:11.375 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_bytes": 148945, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_items": 29, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_items": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_bytes": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_items": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_items": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_items": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_bytes": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_items": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:02:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_bytes": 0, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_items": 0, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_bytes": 928, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_items": 2, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_bytes": 0, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_items": 0, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_bytes": 0, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_items": 0 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 217, 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 440899, 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 217, 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 217, 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 440899, 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:11.379 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-13T17:02:11.379 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:11 smithi094 ceph-mon[35259]: pgmap v683: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:02:11.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:11 smithi018 ceph-mon[30981]: pgmap v683: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:02:11.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:11 smithi144 ceph-mon[35328]: pgmap v683: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:02:12.211 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-13T17:02:12.211 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-13T17:02:12.211 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-09-13T17:02:12.212 DEBUG:tasks.check_counter:Getting stats from h 2024-09-13T17:02:12.212 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-13T17:02:12.412 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:02:13.562 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:13 smithi094 ceph-mon[35259]: pgmap v684: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:02:13.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:13 smithi018 ceph-mon[30981]: pgmap v684: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:02:13.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:13 smithi144 ceph-mon[35328]: pgmap v684: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:02:14.183 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 195767, 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 295270, 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 66958536, 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 204526879, 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 14, 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 6, 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 8.402406082, 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 4.186154939, 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 8.689403885, 2024-09-13T17:02:14.184 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.436789699, 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 295270, 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 19.063575268, 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000064563 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 165040, 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.046727829, 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000283 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 542560, 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 128304 2024-09-13T17:02:14.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.186 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:02:14.186 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 14776, 2024-09-13T17:02:14.186 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 14937, 2024-09-13T17:02:14.186 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 3851537, 2024-09-13T17:02:14.186 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 88925453, 2024-09-13T17:02:14.186 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 9, 2024-09-13T17:02:14.186 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 7, 2024-09-13T17:02:14.186 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 1.411646908, 2024-09-13T17:02:14.186 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.547588434, 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.263985259, 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.506203060, 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 14933, 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 1.898971663, 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000127166 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.187 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T17:02:14.188 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 346096 2024-09-13T17:02:14.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.188 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:02:14.188 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 64523, 2024-09-13T17:02:14.188 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 56465, 2024-09-13T17:02:14.188 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 46790226, 2024-09-13T17:02:14.188 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 96917664, 2024-09-13T17:02:14.188 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 8, 2024-09-13T17:02:14.189 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 6, 2024-09-13T17:02:14.189 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 3.618982234, 2024-09-13T17:02:14.189 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 1.622962240, 2024-09-13T17:02:14.189 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 2.119902717, 2024-09-13T17:02:14.189 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.410235447, 2024-09-13T17:02:14.189 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:14.189 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 56465, 2024-09-13T17:02:14.189 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 3.021959667, 2024-09-13T17:02:14.189 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000053519 2024-09-13T17:02:14.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.190 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:14.190 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 90240, 2024-09-13T17:02:14.190 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.013197433, 2024-09-13T17:02:14.190 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000146 2024-09-13T17:02:14.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.190 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: "cct": { 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: "total_workers": 1, 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: "unhealthy_workers": 0 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-MDSRank": { 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 5063, 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 45.696003959, 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.009025479 2024-09-13T17:02:14.191 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:14.192 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.192 INFO:teuthology.orchestra.run.smithi094.stdout: "finisher-PurgeQueue": { 2024-09-13T17:02:14.192 INFO:teuthology.orchestra.run.smithi094.stdout: "queue_len": 0, 2024-09-13T17:02:14.192 INFO:teuthology.orchestra.run.smithi094.stdout: "complete_latency": { 2024-09-13T17:02:14.192 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 31134, 2024-09-13T17:02:14.192 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 5.225436351, 2024-09-13T17:02:14.192 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000167836 2024-09-13T17:02:14.193 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:14.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.193 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": { 2024-09-13T17:02:14.193 INFO:teuthology.orchestra.run.smithi094.stdout: "request": 75645, 2024-09-13T17:02:14.193 INFO:teuthology.orchestra.run.smithi094.stdout: "reply": 74714, 2024-09-13T17:02:14.193 INFO:teuthology.orchestra.run.smithi094.stdout: "reply_latency": { 2024-09-13T17:02:14.193 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 74714, 2024-09-13T17:02:14.194 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 629.137647664, 2024-09-13T17:02:14.194 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.008420612 2024-09-13T17:02:14.194 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.194 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_reply": 0, 2024-09-13T17:02:14.194 INFO:teuthology.orchestra.run.smithi094.stdout: "forward": 929, 2024-09-13T17:02:14.194 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_complete": 21, 2024-09-13T17:02:14.194 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_fetch_keys": 0, 2024-09-13T17:02:14.194 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_commit": 747, 2024-09-13T17:02:14.195 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_split": 82, 2024-09-13T17:02:14.195 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_merge": 0, 2024-09-13T17:02:14.195 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes": 30, 2024-09-13T17:02:14.195 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_top": 10, 2024-09-13T17:02:14.195 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_bottom": 10, 2024-09-13T17:02:14.196 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pin_tail": 10, 2024-09-13T17:02:14.196 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_pinned": 14, 2024-09-13T17:02:14.196 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_expired": 41251, 2024-09-13T17:02:14.196 INFO:teuthology.orchestra.run.smithi094.stdout: "inodes_with_caps": 2, 2024-09-13T17:02:14.196 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": 2, 2024-09-13T17:02:14.196 INFO:teuthology.orchestra.run.smithi094.stdout: "subtrees": 4, 2024-09-13T17:02:14.196 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse": 121181, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_hit": 105765, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_forward": 683, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_discover": 680, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_dir_fetch": 17, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_remote_ino": 0, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "traverse_lock": 424, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "load_cent": 0, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "q": 0, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "exported": 333, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "exported_inodes": 30543, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "imported": 112, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "imported_inodes": 37140, 2024-09-13T17:02:14.197 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_dir_fetch": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_backtrace_fetch": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "openino_peer_discover": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rfiles": 4, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rbytes": 234, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "root_rsnaps": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_set_tag": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_inodes": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T17:02:14.198 INFO:teuthology.orchestra.run.smithi094.stdout: "scrub_file_inodes": 0, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_inode_file_caps": 124, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_revoke": 17304, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_grant": 34848, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_trunc": 1, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps": 48175, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_caps_dirty": 19501, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_cap_release": 773, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "process_request_cap_release": 42669 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_cache": { 2024-09-13T17:02:14.199 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update": 1, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_update_receipt": 6, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_try_discover": 4, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_send_discover": 755, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "dir_handle_discover": 762, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays": 0, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_delayed": 0, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_created": 17003, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_enqueued": 17003, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_reintegrated": 0, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "strays_migrated": 0, 2024-09-13T17:02:14.200 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_processing": 0, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_started": 0, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "recovery_completed": 0, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_exportdir": 334, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_flush": 0, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragmentdir": 84, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_fragstats": 0, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "ireq_inodestats": 0 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_log": { 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "evadd": 104278, 2024-09-13T17:02:14.201 INFO:teuthology.orchestra.run.smithi094.stdout: "evex": 0, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "evtrm": 0, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "ev": 104278, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "evexg": 0, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "evexd": 0, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "segadd": 128, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "segex": 0, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "segtrm": 0, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "seg": 128, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "segexg": 0, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "segexd": 0, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "expos": 4194304, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "wrpos": 237094570, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "rdpos": 0, 2024-09-13T17:02:14.202 INFO:teuthology.orchestra.run.smithi094.stdout: "jlat": { 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 2040, 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 177.295570783, 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.086909593 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "replayed": 0 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_mem": { 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "ino": 35, 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "ino+": 35052, 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "ino-": 35017, 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "dir": 34, 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "dir+": 1512, 2024-09-13T17:02:14.203 INFO:teuthology.orchestra.run.smithi094.stdout: "dir-": 1478, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "dn": 30, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "dn+": 79914, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "dn-": 79884, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "cap": 2, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "cap+": 34692, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "cap-": 34690, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "rss": 134280, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "heap": 198932 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_server": { 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_client_request": 83653, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "dispatch_server_request": 2990, 2024-09-13T17:02:14.204 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_request": 75645, 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_client_session": 467, 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: "handle_peer_request": 4489, 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: "req_create_latency": { 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 15633, 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 53.826801235, 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.003443152 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getattr_latency": { 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 30, 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 1.129188648, 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.037639621 2024-09-13T17:02:14.205 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getfilelock_latency": { 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "req_link_latency": { 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookup_latency": { 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 23676, 2024-09-13T17:02:14.206 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 365.702562653, 2024-09-13T17:02:14.207 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.015446129 2024-09-13T17:02:14.207 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.207 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookuphash_latency": { 2024-09-13T17:02:14.207 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.207 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.207 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.207 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.207 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupino_latency": { 2024-09-13T17:02:14.207 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1, 2024-09-13T17:02:14.207 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000120317, 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000120317 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupname_latency": { 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupparent_latency": { 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.208 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lookupsnap_latency": { 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: "req_lssnap_latency": { 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mkdir_latency": { 2024-09-13T17:02:14.209 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 68, 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 2.608456006, 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.038359647 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mknod_latency": { 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "req_mksnap_latency": { 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.210 INFO:teuthology.orchestra.run.smithi094.stdout: "req_open_latency": { 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 5896, 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 15.311969349, 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.002597009 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: "req_readdir_latency": { 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 585, 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 1.000790730, 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.001710753 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rename_latency": { 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 15609, 2024-09-13T17:02:14.211 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 161.151648064, 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.010324277 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: "req_renamesnap_latency": { 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: "req_snapdiff_latency": { 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.212 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmdir_latency": { 2024-09-13T17:02:14.213 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 95, 2024-09-13T17:02:14.213 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 10.918534618, 2024-09-13T17:02:14.213 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.114931943 2024-09-13T17:02:14.213 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.213 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmsnap_latency": { 2024-09-13T17:02:14.213 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.214 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.214 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.214 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.214 INFO:teuthology.orchestra.run.smithi094.stdout: "req_rmxattr_latency": { 2024-09-13T17:02:14.214 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setattr_latency": { 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 1, 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.016434775, 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.016434775 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setdirlayout_latency": { 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.215 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setfilelock_latency": { 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setlayout_latency": { 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.216 INFO:teuthology.orchestra.run.smithi094.stdout: "req_setxattr_latency": { 2024-09-13T17:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout: "req_symlink_latency": { 2024-09-13T17:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout: "req_unlink_latency": { 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 13120, 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 17.471141269, 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.001331641 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: "req_getvxattr_latency": { 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.218 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_sessions": { 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "session_count": 1, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "session_add": 2, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "session_remove": 1, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_open": 1, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "sessions_stale": 0, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "total_load": 14110, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "average_load": 14110, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "avg_session_uptime": 598, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "mdthresh_evicted": 0 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "mempool": { 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_items": 0, 2024-09-13T17:02:14.219 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:02:14.220 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_items": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_items": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_items": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:02:14.221 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_items": 0, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_bytes": 0, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_items": 0, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_bytes": 296575, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_items": 130, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_bytes": 704, 2024-09-13T17:02:14.222 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_items": 8, 2024-09-13T17:02:14.223 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_bytes": 0, 2024-09-13T17:02:14.223 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_items": 0, 2024-09-13T17:02:14.223 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:02:14.223 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_items": 0, 2024-09-13T17:02:14.223 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:02:14.223 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_items": 0, 2024-09-13T17:02:14.223 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_bytes": 9048, 2024-09-13T17:02:14.223 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_items": 170, 2024-09-13T17:02:14.224 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:02:14.224 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:02:14.224 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_bytes": 0, 2024-09-13T17:02:14.224 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_items": 0, 2024-09-13T17:02:14.224 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_bytes": 143109, 2024-09-13T17:02:14.224 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_items": 612, 2024-09-13T17:02:14.225 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_bytes": 0, 2024-09-13T17:02:14.225 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_items": 0, 2024-09-13T17:02:14.225 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_bytes": 0, 2024-09-13T17:02:14.225 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_items": 0 2024-09-13T17:02:14.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.225 INFO:teuthology.orchestra.run.smithi094.stdout: "objecter": { 2024-09-13T17:02:14.226 INFO:teuthology.orchestra.run.smithi094.stdout: "op_active": 0, 2024-09-13T17:02:14.226 INFO:teuthology.orchestra.run.smithi094.stdout: "op_laggy": 0, 2024-09-13T17:02:14.226 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send": 38727, 2024-09-13T17:02:14.226 INFO:teuthology.orchestra.run.smithi094.stdout: "op_send_bytes": 250671869, 2024-09-13T17:02:14.226 INFO:teuthology.orchestra.run.smithi094.stdout: "op_resend": 27, 2024-09-13T17:02:14.226 INFO:teuthology.orchestra.run.smithi094.stdout: "op_reply": 38727, 2024-09-13T17:02:14.226 INFO:teuthology.orchestra.run.smithi094.stdout: "op_latency": { 2024-09-13T17:02:14.227 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 38727, 2024-09-13T17:02:14.227 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 914.323238324, 2024-09-13T17:02:14.227 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.023609451 2024-09-13T17:02:14.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.227 INFO:teuthology.orchestra.run.smithi094.stdout: "op_inflight": 0, 2024-09-13T17:02:14.227 INFO:teuthology.orchestra.run.smithi094.stdout: "oplen_avg": { 2024-09-13T17:02:14.228 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 38727, 2024-09-13T17:02:14.228 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 39748 2024-09-13T17:02:14.228 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.228 INFO:teuthology.orchestra.run.smithi094.stdout: "op": 38727, 2024-09-13T17:02:14.228 INFO:teuthology.orchestra.run.smithi094.stdout: "op_r": 512, 2024-09-13T17:02:14.228 INFO:teuthology.orchestra.run.smithi094.stdout: "op_w": 38215, 2024-09-13T17:02:14.229 INFO:teuthology.orchestra.run.smithi094.stdout: "op_rmw": 0, 2024-09-13T17:02:14.229 INFO:teuthology.orchestra.run.smithi094.stdout: "op_pg": 0, 2024-09-13T17:02:14.229 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_stat": 0, 2024-09-13T17:02:14.229 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_create": 10, 2024-09-13T17:02:14.229 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_read": 461, 2024-09-13T17:02:14.229 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_write": 2503, 2024-09-13T17:02:14.230 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writefull": 247, 2024-09-13T17:02:14.230 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_writesame": 0, 2024-09-13T17:02:14.230 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_append": 0, 2024-09-13T17:02:14.230 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_zero": 0, 2024-09-13T17:02:14.230 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_truncate": 82, 2024-09-13T17:02:14.230 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_delete": 34538, 2024-09-13T17:02:14.231 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_mapext": 0, 2024-09-13T17:02:14.231 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_sparse_read": 0, 2024-09-13T17:02:14.231 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_clonerange": 0, 2024-09-13T17:02:14.231 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_getxattr": 0, 2024-09-13T17:02:14.231 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_setxattr": 20, 2024-09-13T17:02:14.231 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:02:14.232 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_rmxattr": 0, 2024-09-13T17:02:14.232 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:02:14.232 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_call": 0, 2024-09-13T17:02:14.232 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_watch": 0, 2024-09-13T17:02:14.232 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_notify": 0, 2024-09-13T17:02:14.232 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:02:14.233 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls": 0, 2024-09-13T17:02:14.233 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:02:14.233 INFO:teuthology.orchestra.run.smithi094.stdout: "osdop_other": 1, 2024-09-13T17:02:14.233 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_active": 0, 2024-09-13T17:02:14.233 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_send": 0, 2024-09-13T17:02:14.233 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_resend": 0, 2024-09-13T17:02:14.234 INFO:teuthology.orchestra.run.smithi094.stdout: "linger_ping": 0, 2024-09-13T17:02:14.234 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_active": 0, 2024-09-13T17:02:14.234 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_send": 0, 2024-09-13T17:02:14.234 INFO:teuthology.orchestra.run.smithi094.stdout: "poolop_resend": 0, 2024-09-13T17:02:14.234 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_active": 0, 2024-09-13T17:02:14.235 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_send": 0, 2024-09-13T17:02:14.235 INFO:teuthology.orchestra.run.smithi094.stdout: "poolstat_resend": 0, 2024-09-13T17:02:14.235 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_active": 0, 2024-09-13T17:02:14.235 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_send": 0, 2024-09-13T17:02:14.235 INFO:teuthology.orchestra.run.smithi094.stdout: "statfs_resend": 0, 2024-09-13T17:02:14.235 INFO:teuthology.orchestra.run.smithi094.stdout: "command_active": 0, 2024-09-13T17:02:14.235 INFO:teuthology.orchestra.run.smithi094.stdout: "command_send": 0, 2024-09-13T17:02:14.236 INFO:teuthology.orchestra.run.smithi094.stdout: "command_resend": 0, 2024-09-13T17:02:14.236 INFO:teuthology.orchestra.run.smithi094.stdout: "map_epoch": 94, 2024-09-13T17:02:14.236 INFO:teuthology.orchestra.run.smithi094.stdout: "map_full": 0, 2024-09-13T17:02:14.236 INFO:teuthology.orchestra.run.smithi094.stdout: "map_inc": 5, 2024-09-13T17:02:14.236 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_sessions": 12, 2024-09-13T17:02:14.236 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_open": 12, 2024-09-13T17:02:14.237 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_session_close": 0, 2024-09-13T17:02:14.237 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_laggy": 0, 2024-09-13T17:02:14.237 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_wr": 1651, 2024-09-13T17:02:14.237 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_rd": 72, 2024-09-13T17:02:14.237 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_del": 163 2024-09-13T17:02:14.237 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.238 INFO:teuthology.orchestra.run.smithi094.stdout: "oft": { 2024-09-13T17:02:14.238 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_objs": 1, 2024-09-13T17:02:14.238 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:02:14.238 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_updates": 0, 2024-09-13T17:02:14.239 INFO:teuthology.orchestra.run.smithi094.stdout: "omap_total_removes": 0 2024-09-13T17:02:14.239 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.239 INFO:teuthology.orchestra.run.smithi094.stdout: "osd-slow-ops": { 2024-09-13T17:02:14.239 INFO:teuthology.orchestra.run.smithi094.stdout: "slow_ops_count": 1 2024-09-13T17:02:14.239 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.239 INFO:teuthology.orchestra.run.smithi094.stdout: "purge_queue": { 2024-09-13T17:02:14.240 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops": 0, 2024-09-13T17:02:14.240 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_ops_high_water": 24, 2024-09-13T17:02:14.240 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing": 0, 2024-09-13T17:02:14.240 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executing_high_water": 9, 2024-09-13T17:02:14.240 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed_ops": 34471, 2024-09-13T17:02:14.240 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_executed": 17003, 2024-09-13T17:02:14.240 INFO:teuthology.orchestra.run.smithi094.stdout: "pq_item_in_journal": 0 2024-09-13T17:02:14.241 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.241 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:02:14.241 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:14.241 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-09-13T17:02:14.242 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:14.242 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 275062, 2024-09-13T17:02:14.242 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 95773001, 2024-09-13T17:02:14.242 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:14.242 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 275062, 2024-09-13T17:02:14.242 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-09-13T17:02:14.242 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 275062, 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 95773001, 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_bytes": { 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:14.243 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 38727, 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 252523613, 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 38727, 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 252523613, 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:14.244 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.245 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-objecter_ops": { 2024-09-13T17:02:14.245 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:14.245 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 1024, 2024-09-13T17:02:14.245 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:14.245 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 0, 2024-09-13T17:02:14.245 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 0, 2024-09-13T17:02:14.245 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:14.245 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:14.245 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 38727, 2024-09-13T17:02:14.245 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 38727, 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 38727, 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 38727, 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 17003, 2024-09-13T17:02:14.246 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 1853127, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 17003, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 463, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 1853127, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-write_buf_throttle-0x5596f1a2a500": { 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:14.247 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 3758096384, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 104278, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 232900266, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 104278, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 2040, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 232900266, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:14.248 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:14.249 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:14.249 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:14.249 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-13T17:02:15.038 INFO:tasks.check_counter:Daemon mds.h mds.exported=333 2024-09-13T17:02:15.038 INFO:tasks.check_counter:Daemon mds.h mds.imported=112 2024-09-13T17:02:15.038 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=82 2024-09-13T17:02:15.038 DEBUG:tasks.check_counter:Getting stats from k 2024-09-13T17:02:15.038 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-13T17:02:15.237 INFO:teuthology.orchestra.run.smithi094.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:02:15.643 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:15 smithi094 ceph-mon[35259]: pgmap v685: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:02:15.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:15 smithi018 ceph-mon[30981]: pgmap v685: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:02:15.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:15 smithi144 ceph-mon[35328]: pgmap v685: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:02:16.951 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-13T17:02:16.951 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:02:16.951 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 0, 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 2, 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 0, 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 0, 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 4, 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 0, 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.000916359, 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.000114526, 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:16.952 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.953 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 5, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 166, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 3104, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 105392, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 3, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 2, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.010281084, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.006204920, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.002591826, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 165, 2024-09-13T17:02:16.954 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.011992649, 2024-09-13T17:02:16.955 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000072682 2024-09-13T17:02:16.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.955 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:16.955 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:16.955 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:16.955 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:16.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.955 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-13T17:02:16.955 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 105392 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 219, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 216, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 472256, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 122880, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 2, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 1, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.028530219, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.012984820, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.020433543, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:16.956 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 215, 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.011922078, 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000055451 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 472256, 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 122880 2024-09-13T17:02:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "cct": { 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "total_workers": 0, 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "unhealthy_workers": 0 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "mempool": { 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_items": 0, 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:02:16.958 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_items": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_items": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:02:16.959 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_items": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_items": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_bytes": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_items": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:02:16.960 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_bytes": 148923, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_items": 29, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_items": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_bytes": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_items": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_items": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_items": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_bytes": 0, 2024-09-13T17:02:16.961 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_items": 0, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_bytes": 0, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_items": 0, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_bytes": 928, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_items": 2, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_bytes": 0, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_items": 0, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_bytes": 0, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_items": 0 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:02:16.962 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 220, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 441289, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 220, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 220, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 441289, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-09-13T17:02:16.963 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-09-13T17:02:16.964 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:16.964 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-13T17:02:16.964 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-13T17:02:17.640 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:17 smithi094 ceph-mon[35259]: pgmap v686: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:02:17.662 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-13T17:02:17.662 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-13T17:02:17.662 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-13T17:02:17.662 DEBUG:tasks.check_counter:Getting stats from c 2024-09-13T17:02:17.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-13T17:02:17.690 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:17 smithi144 ceph-mon[35328]: pgmap v686: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:02:17.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:17 smithi018 ceph-mon[30981]: pgmap v686: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:02:17.872 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:02:19.557 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:19 smithi144 ceph-mon[35328]: pgmap v687: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:02:19.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:19 smithi094 ceph-mon[35259]: pgmap v687: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:02:19.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:19 smithi018 ceph-mon[30981]: pgmap v687: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:02:19.801 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-13T17:02:19.801 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:02:19.801 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1791, 2024-09-13T17:02:19.801 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1793, 2024-09-13T17:02:19.801 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 156562270, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 557008, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 8, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.227080903, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.046994746, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.118563751, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.048415096, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1791, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.065081007, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000036337 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 401, 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 560, 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 100773842, 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 473282, 2024-09-13T17:02:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 7, 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 6, 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.098758128, 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.014967571, 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.069701435, 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.009665398, 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 559, 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.028194206, 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000050436 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 350064 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 731, 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 717, 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 122296680, 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 276450, 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 5, 2024-09-13T17:02:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.133461962, 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.023077168, 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.099944476, 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.012475316, 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 716, 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.028410828, 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000039679 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 529792, 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 122816 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-13T17:02:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4368, 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.114709962, 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000026261 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-13T17:02:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 26421, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 2219, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 24202, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 23251, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 1, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2024-09-13T17:02:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-13T17:02:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-13T17:02:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-13T17:02:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:02:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-13T17:02:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 154366, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 135, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 146802843, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 382532840, 2024-09-13T17:02:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 382531702, 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 154366 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 18, 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 54099, 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 54081, 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 50, 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 2193, 2024-09-13T17:02:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 2143, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 26421, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 113107, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 86686, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 87708, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 207124 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-13T17:02:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-13T17:02:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-13T17:02:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-13T17:02:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-13T17:02:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-13T17:02:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-13T17:02:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 2, 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2024-09-13T17:02:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 1970, 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:02:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:02:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-13T17:02:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 239616, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 83, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:02:19.835 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 9048, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 170, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 18709618, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 110157, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-13T17:02:19.836 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 2681, 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 21, 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 3, 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 2681, 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2681, 2024-09-13T17:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 49.189095293, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.018347294 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2681, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 2682 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 2681, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 2681, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 1543, 2024-09-13T17:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2024-09-13T17:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 1136, 2024-09-13T17:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2024-09-13T17:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2024-09-13T17:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-13T17:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-13T17:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-13T17:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-13T17:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2024-09-13T17:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 1, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-13T17:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-13T17:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 94, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 5, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 11, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 11, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2024-09-13T17:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-13T17:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 2919, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 379355004, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 2919, 2024-09-13T17:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2919, 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 379355004, 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2681, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 378359202, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2681, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 378359202, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2681, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 2681, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2681, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 2681, 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-13T17:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x557980c30820": { 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-13T17:02:20.603 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-13T17:02:20.604 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-13T17:02:20.604 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-13T17:02:20.604 DEBUG:tasks.check_counter:Getting stats from f 2024-09-13T17:02:20.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-13T17:02:20.846 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:02:21.521 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:21 smithi144 ceph-mon[35328]: pgmap v688: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:02:21.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:21 smithi094 ceph-mon[35259]: pgmap v688: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:02:21.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:21 smithi018 ceph-mon[30981]: pgmap v688: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-13T17:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 510, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 496, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 59327248, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 208287, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 7, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.077693944, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.019672147, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.055120522, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.005757900, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 495, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.031996238, 2024-09-13T17:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000064638 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 530336, 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 124000 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 727, 2024-09-13T17:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 889, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 82175043, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 575583, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 5, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.112737296, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.023051300, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.061111746, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.021549032, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 887, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.042437990, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000047844 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 349792 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1525, 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1525, 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 92730946, 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 473537, 2024-09-13T17:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 5, 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.184526866, 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.041172115, 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.086373272, 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.044978149, 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1524, 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.063727837, 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000041816 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-13T17:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T17:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-13T17:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-13T17:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-13T17:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4109, 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.101505087, 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000024703 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-13T17:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 17013, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 17013, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 17013, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-13T17:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 1, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-13T17:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-13T17:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-13T17:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-13T17:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2024-09-13T17:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-13T17:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2024-09-13T17:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-13T17:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-13T17:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 104278, 2024-09-13T17:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-13T17:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-13T17:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2024-09-13T17:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-13T17:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 128, 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 237094570, 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 237092919, 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 104278 2024-09-13T17:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 13, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 36443, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 36430, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 11, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 1541, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 1530, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 17013, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 77876, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 60863, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-13T17:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 91620, 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 207124 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-13T17:02:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-13T17:02:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-13T17:02:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-13T17:02:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-13T17:02:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-13T17:02:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-13T17:02:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-13T17:02:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-13T17:02:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-13T17:02:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-13T17:02:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 2, 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2024-09-13T17:02:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 1973, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:02:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:02:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:02:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 232135, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 76, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 9048, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 170, 2024-09-13T17:02:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 12020120, 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 68180, 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-13T17:02:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 2518, 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 21, 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 3, 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 2518, 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2518, 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 49.093097442, 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.019496861 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-13T17:02:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2518, 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 2519 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 2518, 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 2518, 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 1497, 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 1019, 2024-09-13T17:02:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 1, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:02:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-13T17:02:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 94, 2024-09-13T17:02:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 5, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 10, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 10, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:02:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-13T17:02:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 2758, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 233969835, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 2758, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2758, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 233969835, 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2518, 2024-09-13T17:02:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 233000151, 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2518, 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 233000151, 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2518, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 2518, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2518, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 2518, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.595 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:22.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x55e8e8fea780": { 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-13T17:02:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-13T17:02:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-13T17:02:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-13T17:02:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:22.598 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-13T17:02:23.463 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-13T17:02:23.464 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-13T17:02:23.464 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-13T17:02:23.464 DEBUG:tasks.check_counter:Getting stats from i 2024-09-13T17:02:23.464 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-13T17:02:23.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:23 smithi094 ceph-mon[35259]: pgmap v689: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:02:23.662 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:02:23.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:23 smithi018 ceph-mon[30981]: pgmap v689: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:02:23.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:23 smithi144 ceph-mon[35328]: pgmap v689: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:02:25.422 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-13T17:02:25.422 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:02:25.422 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 158, 2024-09-13T17:02:25.422 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 157, 2024-09-13T17:02:25.422 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 8581786, 2024-09-13T17:02:25.422 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 61620, 2024-09-13T17:02:25.422 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 7, 2024-09-13T17:02:25.422 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2024-09-13T17:02:25.422 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.022241812, 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.005494942, 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.014687831, 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.002975885, 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 156, 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.012970588, 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000083144 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.423 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 168864, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 32688 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 366, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 406, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 28941597, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 268796, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 5, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.048861198, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.011268108, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.023984623, 2024-09-13T17:02:25.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.010453304, 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 405, 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.023344006, 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000057639 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 156464 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.425 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 319, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 321, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 54534866, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 99216, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 5, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.050361960, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.006473956, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.034667389, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.007221189, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 319, 2024-09-13T17:02:25.426 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.021766081, 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000068232 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-13T17:02:25.427 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1233, 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.212320853, 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000172198 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-13T17:02:25.428 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-13T17:02:25.429 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 17153, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 11956, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 5197, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 72, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-13T17:02:25.430 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 2, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-13T17:02:25.431 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 4, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 234, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T17:02:25.432 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-13T17:02:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-13T17:02:25.434 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 42677, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-13T17:02:25.435 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 2, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 246743477, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 246926789, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 246925138, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.436 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 42677 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 18, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 21883, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 21865, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 17, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 1027, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 1010, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 17153, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 45894, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 28741, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-13T17:02:25.437 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 71700, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 207124 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.438 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.439 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-13T17:02:25.440 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.441 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.441 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.441 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-13T17:02:25.444 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.445 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-13T17:02:25.446 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.446 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.446 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.446 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-13T17:02:25.446 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.446 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.446 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.447 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-13T17:02:25.447 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.447 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.447 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.447 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-13T17:02:25.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-13T17:02:25.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 1, 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 0, 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 0, 2024-09-13T17:02:25.454 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 1974, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:02:25.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:02:25.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-13T17:02:25.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 229654, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 69, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:02:25.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 9048, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 170, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 12133623, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 68427, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.459 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 773, 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 26, 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 4, 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 773, 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 773, 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.909964932, 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002470847 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-13T17:02:25.460 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 773, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 774 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 773, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 773, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 457, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 313, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2024-09-13T17:02:25.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 2, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-13T17:02:25.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-13T17:02:25.463 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 0, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 10, 2024-09-13T17:02:25.464 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 10, 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2024-09-13T17:02:25.465 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-13T17:02:25.466 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 839, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 91976474, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 839, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 839, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 91976474, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:25.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 773, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 91668400, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 773, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 91668400, 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:25.468 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 773, 2024-09-13T17:02:25.469 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 773, 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 773, 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 773, 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:25.470 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x55e993a9c500": { 2024-09-13T17:02:25.471 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:25.472 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:25.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:25.473 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-13T17:02:25.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:25 smithi144 ceph-mon[35328]: pgmap v690: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:02:25.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:25 smithi094 ceph-mon[35259]: pgmap v690: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:02:25.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:25 smithi018 ceph-mon[30981]: pgmap v690: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:02:26.263 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-13T17:02:26.264 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-13T17:02:26.264 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-13T17:02:26.264 DEBUG:tasks.check_counter:Getting stats from l 2024-09-13T17:02:26.264 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-13T17:02:26.464 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:02:27.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:27 smithi094 ceph-mon[35259]: pgmap v691: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:02:27.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:27 smithi144 ceph-mon[35328]: pgmap v691: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:02:27.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:27 smithi018 ceph-mon[30981]: pgmap v691: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:02:28.224 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-13T17:02:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:02:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 223, 2024-09-13T17:02:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 220, 2024-09-13T17:02:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 473344, 2024-09-13T17:02:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 125248, 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 0, 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.030572419, 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.013648623, 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.019990570, 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 219, 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.011391882, 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000052017 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 473344, 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 125248 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1, 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 167, 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 160, 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 105472, 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 3, 2024-09-13T17:02:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.008895177, 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.006793898, 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.000545006, 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 165, 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.008318604, 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000050415 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 105472 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 4, 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 4, 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 2944, 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 448, 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 2, 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 1, 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.002192576, 2024-09-13T17:02:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.000032063, 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.002155085, 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3, 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.003991880, 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.001330626 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 0, 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:02:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:02:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:02:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 148984, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 30, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 0, 2024-09-13T17:02:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 0, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 928, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 2, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-13T17:02:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 224, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 441809, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 224, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 224, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 441809, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-13T17:02:28.236 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-13T17:02:28.967 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-13T17:02:28.967 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-13T17:02:28.968 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-13T17:02:28.968 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T17:02:28.984 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T17:02:28.984 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T17:02:28.984 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:02:29.036 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T17:02:29.036 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:02:29.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:02:29.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.318+0000 7f186f200640 1 -- 172.21.15.18:0/2801110436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18680ffda0 msgr2=0x7f18681001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:29.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.318+0000 7f186f200640 1 --2- 172.21.15.18:0/2801110436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18680ffda0 0x7f18681001a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1858009860 tx=0x7f185802a340 comp rx=0 tx=0).stop 2024-09-13T17:02:29.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.318+0000 7f186f200640 1 -- 172.21.15.18:0/2801110436 shutdown_connections 2024-09-13T17:02:29.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.318+0000 7f186f200640 1 --2- 172.21.15.18:0/2801110436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1868100f90 0x7f1868101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.318+0000 7f186f200640 1 --2- 172.21.15.18:0/2801110436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868101950 0x7f18681081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.318+0000 7f186f200640 1 --2- 172.21.15.18:0/2801110436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18680ffda0 0x7f18681001a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.318+0000 7f186f200640 1 -- 172.21.15.18:0/2801110436 >> 172.21.15.18:0/2801110436 conn(0x7f18680fb520 msgr2=0x7f18680fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:29.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.318+0000 7f186f200640 1 -- 172.21.15.18:0/2801110436 shutdown_connections 2024-09-13T17:02:29.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.318+0000 7f186f200640 1 -- 172.21.15.18:0/2801110436 wait complete. 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.319+0000 7f186f200640 1 Processor -- start 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.319+0000 7f186f200640 1 -- start start 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.319+0000 7f186f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18680ffda0 0x7f1868198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.319+0000 7f186f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1868100f90 0x7f1868198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.319+0000 7f186f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868101950 0x7f186819f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.319+0000 7f186f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186819faf0 con 0x7f1868100f90 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.319+0000 7f186f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186819fc60 con 0x7f1868101950 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.319+0000 7f186f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186819fe20 con 0x7f18680ffda0 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f185fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1868100f90 0x7f1868198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f185fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1868100f90 0x7f1868198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34310/0 (socket says 172.21.15.18:34310) 2024-09-13T17:02:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f186d200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868101950 0x7f186819f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f1867e00640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18680ffda0 0x7f1868198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f185fe00640 1 -- 172.21.15.18:0/2118362399 learned_addr learned my addr 172.21.15.18:0/2118362399 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f185fe00640 1 -- 172.21.15.18:0/2118362399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18680ffda0 msgr2=0x7f1868198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f185fe00640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18680ffda0 0x7f1868198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f185fe00640 1 -- 172.21.15.18:0/2118362399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868101950 msgr2=0x7f186819f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f185fe00640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868101950 0x7f186819f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f185fe00640 1 -- 172.21.15.18:0/2118362399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850009560 con 0x7f1868100f90 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.320+0000 7f186d200640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868101950 0x7f186819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.321+0000 7f185fe00640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1868100f90 0x7f1868198540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f185000e9c0 tx=0x7f185000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.321+0000 7f1865600640 1 -- 172.21.15.18:0/2118362399 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185000cde0 con 0x7f1868100f90 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.321+0000 7f1865600640 1 -- 172.21.15.18:0/2118362399 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18500035f0 con 0x7f1868100f90 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.321+0000 7f186f200640 1 -- 172.21.15.18:0/2118362399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1858009490 con 0x7f1868100f90 2024-09-13T17:02:29.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.321+0000 7f1865600640 1 -- 172.21.15.18:0/2118362399 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18500044e0 con 0x7f1868100f90 2024-09-13T17:02:29.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.321+0000 7f186f200640 1 -- 172.21.15.18:0/2118362399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18681a0480 con 0x7f1868100f90 2024-09-13T17:02:29.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.322+0000 7f186f200640 1 -- 172.21.15.18:0/2118362399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186810b640 con 0x7f1868100f90 2024-09-13T17:02:29.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.324+0000 7f1865600640 1 -- 172.21.15.18:0/2118362399 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1850003760 con 0x7f1868100f90 2024-09-13T17:02:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.325+0000 7f1865600640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f184c0a1090 0x7f184c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.325+0000 7f1865600640 1 -- 172.21.15.18:0/2118362399 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f1850014070 con 0x7f1868100f90 2024-09-13T17:02:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.325+0000 7f1867e00640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f184c0a1090 0x7f184c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:29.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.326+0000 7f1867e00640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f184c0a1090 0x7f184c0a3550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f18580304b0 tx=0x7f1858030580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:29.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.329+0000 7f1865600640 1 -- 172.21.15.18:0/2118362399 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1850096520 con 0x7f1868100f90 2024-09-13T17:02:29.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:29 smithi018 ceph-mon[30981]: pgmap v692: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:02:29.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.510+0000 7f186f200640 1 -- 172.21.15.18:0/2118362399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f186810b7d0 con 0x7f1868100f90 2024-09-13T17:02:29.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.512+0000 7f1865600640 1 -- 172.21.15.18:0/2118362399 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24592 (secure 0 0 0) 0x7f1850099b40 con 0x7f1868100f90 2024-09-13T17:02:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T17:02:29.514 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":94,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:59:07.048861+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:02:29.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 -- 172.21.15.18:0/2118362399 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f184c0a1090 msgr2=0x7f184c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:29.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f184c0a1090 0x7f184c0a3550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f18580304b0 tx=0x7f1858030580 comp rx=0 tx=0).stop 2024-09-13T17:02:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 -- 172.21.15.18:0/2118362399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1868100f90 msgr2=0x7f1868198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1868100f90 0x7f1868198540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f185000e9c0 tx=0x7f185000ee80 comp rx=0 tx=0).stop 2024-09-13T17:02:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 -- 172.21.15.18:0/2118362399 shutdown_connections 2024-09-13T17:02:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f184c0a1090 0x7f184c0a3550 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1868100f90 0x7f1868198540 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868101950 0x7f186819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 --2- 172.21.15.18:0/2118362399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18680ffda0 0x7f1868198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 -- 172.21.15.18:0/2118362399 >> 172.21.15.18:0/2118362399 conn(0x7f18680fb520 msgr2=0x7f1868106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 -- 172.21.15.18:0/2118362399 shutdown_connections 2024-09-13T17:02:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.514+0000 7f186f200640 1 -- 172.21.15.18:0/2118362399 wait complete. 2024-09-13T17:02:29.533 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T16:44:44.290877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T16:49:26.572697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T16:49:27.624038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T16:49:30.629093+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:02:29.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:02:29.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:29 smithi094 ceph-mon[35259]: pgmap v692: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:02:29.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.693+0000 7febda600640 1 -- 172.21.15.18:0/1023213406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febd4102fa0 msgr2=0x7febd4103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:29.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.693+0000 7febda600640 1 --2- 172.21.15.18:0/1023213406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febd4102fa0 0x7febd4103420 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7febbc009900 tx=0x7febbc02a3e0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.693+0000 7febda600640 1 -- 172.21.15.18:0/1023213406 shutdown_connections 2024-09-13T17:02:29.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.693+0000 7febda600640 1 --2- 172.21.15.18:0/1023213406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febd4102fa0 0x7febd4103420 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.693+0000 7febda600640 1 --2- 172.21.15.18:0/1023213406 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd4103960 0x7febd410a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.693+0000 7febda600640 1 --2- 172.21.15.18:0/1023213406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febd4101e50 0x7febd4102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.693+0000 7febda600640 1 -- 172.21.15.18:0/1023213406 >> 172.21.15.18:0/1023213406 conn(0x7febd40fd5d0 msgr2=0x7febd40ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:29.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.693+0000 7febda600640 1 -- 172.21.15.18:0/1023213406 shutdown_connections 2024-09-13T17:02:29.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.693+0000 7febda600640 1 -- 172.21.15.18:0/1023213406 wait complete. 2024-09-13T17:02:29.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.694+0000 7febda600640 1 Processor -- start 2024-09-13T17:02:29.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.694+0000 7febda600640 1 -- start start 2024-09-13T17:02:29.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.694+0000 7febda600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febd4101e50 0x7febd4197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:29.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.694+0000 7febda600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febd4102fa0 0x7febd41983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:29.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.694+0000 7febda600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd4103960 0x7febd419f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.694+0000 7febda600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd419f920 con 0x7febd4102fa0 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.694+0000 7febda600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd419fa90 con 0x7febd4103960 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.694+0000 7febda600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd419fc50 con 0x7febd4101e50 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febcbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febd4102fa0 0x7febd41983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febcbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febd4102fa0 0x7febd41983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34332/0 (socket says 172.21.15.18:34332) 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febcbe00640 1 -- 172.21.15.18:0/2202609759 learned_addr learned my addr 172.21.15.18:0/2202609759 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febd9200640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febd4101e50 0x7febd4197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febd9c00640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd4103960 0x7febd419f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febcbe00640 1 -- 172.21.15.18:0/2202609759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febd4101e50 msgr2=0x7febd4197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febcbe00640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febd4101e50 0x7febd4197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febcbe00640 1 -- 172.21.15.18:0/2202609759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd4103960 msgr2=0x7febd419f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:29.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febcbe00640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd4103960 0x7febd419f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febcbe00640 1 -- 172.21.15.18:0/2202609759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc009560 con 0x7febd4102fa0 2024-09-13T17:02:29.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febd9c00640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd4103960 0x7febd419f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:02:29.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.695+0000 7febcbe00640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febd4102fa0 0x7febd41983c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7febbc0057c0 tx=0x7febbc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:29.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.696+0000 7febd2000640 1 -- 172.21.15.18:0/2202609759 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc004b50 con 0x7febd4102fa0 2024-09-13T17:02:29.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.696+0000 7febd2000640 1 -- 172.21.15.18:0/2202609759 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febbc004cb0 con 0x7febd4102fa0 2024-09-13T17:02:29.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.696+0000 7febd2000640 1 -- 172.21.15.18:0/2202609759 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc031ae0 con 0x7febd4102fa0 2024-09-13T17:02:29.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.696+0000 7febda600640 1 -- 172.21.15.18:0/2202609759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd419fed0 con 0x7febd4102fa0 2024-09-13T17:02:29.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.696+0000 7febda600640 1 -- 172.21.15.18:0/2202609759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd41a0240 con 0x7febd4102fa0 2024-09-13T17:02:29.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.697+0000 7febda600640 1 -- 172.21.15.18:0/2202609759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd41092f0 con 0x7febd4102fa0 2024-09-13T17:02:29.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.699+0000 7febd2000640 1 -- 172.21.15.18:0/2202609759 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7febbc003c40 con 0x7febd4102fa0 2024-09-13T17:02:29.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.700+0000 7febd2000640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7febb80a1110 0x7febb80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:29.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.700+0000 7febd2000640 1 -- 172.21.15.18:0/2202609759 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7febbc0edb70 con 0x7febd4102fa0 2024-09-13T17:02:29.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.700+0000 7febd9200640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7febb80a1110 0x7febb80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:29.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.701+0000 7febd9200640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7febb80a1110 0x7febb80a35d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7febc4009bd0 tx=0x7febc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:29.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.704+0000 7febd2000640 1 -- 172.21.15.18:0/2202609759 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7febbc0b6f40 con 0x7febd4102fa0 2024-09-13T17:02:29.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:29 smithi144 ceph-mon[35328]: pgmap v692: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:02:29.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.886+0000 7febda600640 1 -- 172.21.15.18:0/2202609759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febd402c480 con 0x7febd4102fa0 2024-09-13T17:02:29.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.887+0000 7febd2000640 1 -- 172.21.15.18:0/2202609759 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7febbc040020 con 0x7febd4102fa0 2024-09-13T17:02:29.889 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-13T17:02:29.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.889+0000 7febda600640 1 -- 172.21.15.18:0/2202609759 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7febb80a1110 msgr2=0x7febb80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:29.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.889+0000 7febda600640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7febb80a1110 0x7febb80a35d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7febc4009bd0 tx=0x7febc4005f90 comp rx=0 tx=0).stop 2024-09-13T17:02:29.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.889+0000 7febda600640 1 -- 172.21.15.18:0/2202609759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febd4102fa0 msgr2=0x7febd41983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:29.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.889+0000 7febda600640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febd4102fa0 0x7febd41983c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7febbc0057c0 tx=0x7febbc0055a0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.890+0000 7febda600640 1 -- 172.21.15.18:0/2202609759 shutdown_connections 2024-09-13T17:02:29.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.890+0000 7febda600640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7febb80a1110 0x7febb80a35d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.890+0000 7febda600640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febd4102fa0 0x7febd41983c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.890+0000 7febda600640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd4103960 0x7febd419f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.890+0000 7febda600640 1 --2- 172.21.15.18:0/2202609759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febd4101e50 0x7febd4197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.890+0000 7febda600640 1 -- 172.21.15.18:0/2202609759 >> 172.21.15.18:0/2202609759 conn(0x7febd40fd5d0 msgr2=0x7febd41064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.890+0000 7febda600640 1 -- 172.21.15.18:0/2202609759 shutdown_connections 2024-09-13T17:02:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:29.890+0000 7febda600640 1 -- 172.21.15.18:0/2202609759 wait complete. 2024-09-13T17:02:29.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:02:30.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.066+0000 7f34b2400640 1 -- 172.21.15.18:0/1073873929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34ac072e90 msgr2=0x7f34ac0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.066+0000 7f34b2400640 1 --2- 172.21.15.18:0/1073873929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34ac072e90 0x7f34ac0732f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3498009900 tx=0x7f349802a480 comp rx=0 tx=0).stop 2024-09-13T17:02:30.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.066+0000 7f34b2400640 1 -- 172.21.15.18:0/1073873929 shutdown_connections 2024-09-13T17:02:30.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.066+0000 7f34b2400640 1 --2- 172.21.15.18:0/1073873929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34ac072e90 0x7f34ac0732f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.066+0000 7f34b2400640 1 --2- 172.21.15.18:0/1073873929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34ac107b90 0x7f34ac10a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.066+0000 7f34b2400640 1 --2- 172.21.15.18:0/1073873929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34ac074470 0x7f34ac0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.066+0000 7f34b2400640 1 -- 172.21.15.18:0/1073873929 >> 172.21.15.18:0/1073873929 conn(0x7f34ac0fb440 msgr2=0x7f34ac0fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.066+0000 7f34b2400640 1 -- 172.21.15.18:0/1073873929 shutdown_connections 2024-09-13T17:02:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.067+0000 7f34b2400640 1 -- 172.21.15.18:0/1073873929 wait complete. 2024-09-13T17:02:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.067+0000 7f34b2400640 1 Processor -- start 2024-09-13T17:02:30.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34b2400640 1 -- start start 2024-09-13T17:02:30.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34b2400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34ac072e90 0x7f34ac197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34b2400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34ac074470 0x7f34ac1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34b2400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34ac107b90 0x7f34ac19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34b2400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac19fa40 con 0x7f34ac074470 2024-09-13T17:02:30.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34b2400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac19fbb0 con 0x7f34ac072e90 2024-09-13T17:02:30.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34b2400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac19fd70 con 0x7f34ac107b90 2024-09-13T17:02:30.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34ac074470 0x7f34ac1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34ac074470 0x7f34ac1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34356/0 (socket says 172.21.15.18:34356) 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34abe00640 1 -- 172.21.15.18:0/3452467795 learned_addr learned my addr 172.21.15.18:0/3452467795 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34b1000640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34ac072e90 0x7f34ac197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.068+0000 7f34b1a00640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34ac107b90 0x7f34ac19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34abe00640 1 -- 172.21.15.18:0/3452467795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34ac107b90 msgr2=0x7f34ac19f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34abe00640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34ac107b90 0x7f34ac19f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34abe00640 1 -- 172.21.15.18:0/3452467795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34ac072e90 msgr2=0x7f34ac197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34abe00640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34ac072e90 0x7f34ac197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34abe00640 1 -- 172.21.15.18:0/3452467795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4009840 con 0x7f34ac074470 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34b1000640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34ac072e90 0x7f34ac197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34abe00640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34ac074470 0x7f34ac1984e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3498031500 tx=0x7f3498003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34a9600640 1 -- 172.21.15.18:0/3452467795 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498005d50 con 0x7f34ac074470 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34a9600640 1 -- 172.21.15.18:0/3452467795 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3498003e00 con 0x7f34ac074470 2024-09-13T17:02:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34a9600640 1 -- 172.21.15.18:0/3452467795 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349803bb50 con 0x7f34ac074470 2024-09-13T17:02:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34b2400640 1 -- 172.21.15.18:0/3452467795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3498009560 con 0x7f34ac074470 2024-09-13T17:02:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.069+0000 7f34b2400640 1 -- 172.21.15.18:0/3452467795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac1a0280 con 0x7f34ac074470 2024-09-13T17:02:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.070+0000 7f34b2400640 1 -- 172.21.15.18:0/3452467795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac0732f0 con 0x7f34ac074470 2024-09-13T17:02:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.072+0000 7f34a9600640 1 -- 172.21.15.18:0/3452467795 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f349803bcb0 con 0x7f34ac074470 2024-09-13T17:02:30.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.073+0000 7f34a9600640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f34940a1110 0x7f34940a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.074+0000 7f34a9600640 1 -- 172.21.15.18:0/3452467795 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f34980ed860 con 0x7f34ac074470 2024-09-13T17:02:30.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.074+0000 7f34b1000640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f34940a1110 0x7f34940a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.075+0000 7f34b1000640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f34940a1110 0x7f34940a35d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009fc0 tx=0x7f34a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:30.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.076+0000 7f34a9600640 1 -- 172.21.15.18:0/3452467795 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f34980b6c30 con 0x7f34ac074470 2024-09-13T17:02:30.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.256+0000 7f34b2400640 1 -- 172.21.15.18:0/3452467795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34ac02c3e0 con 0x7f34ac074470 2024-09-13T17:02:30.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.256+0000 7f34a9600640 1 -- 172.21.15.18:0/3452467795 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3498035020 con 0x7f34ac074470 2024-09-13T17:02:30.258 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T17:02:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 -- 172.21.15.18:0/3452467795 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f34940a1110 msgr2=0x7f34940a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f34940a1110 0x7f34940a35d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009fc0 tx=0x7f34a0005f90 comp rx=0 tx=0).stop 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 -- 172.21.15.18:0/3452467795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34ac074470 msgr2=0x7f34ac1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34ac074470 0x7f34ac1984e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3498031500 tx=0x7f3498003c10 comp rx=0 tx=0).stop 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 -- 172.21.15.18:0/3452467795 shutdown_connections 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f34940a1110 0x7f34940a35d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34ac074470 0x7f34ac1984e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34ac107b90 0x7f34ac19f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 --2- 172.21.15.18:0/3452467795 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34ac072e90 0x7f34ac197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 -- 172.21.15.18:0/3452467795 >> 172.21.15.18:0/3452467795 conn(0x7f34ac0fb440 msgr2=0x7f34ac103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 -- 172.21.15.18:0/3452467795 shutdown_connections 2024-09-13T17:02:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.258+0000 7f34b2400640 1 -- 172.21.15.18:0/3452467795 wait complete. 2024-09-13T17:02:30.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:02:30.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.435+0000 7fb372800640 1 -- 172.21.15.18:0/330895161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb36c100f60 msgr2=0x7fb36c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.435+0000 7fb372800640 1 --2- 172.21.15.18:0/330895161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb36c100f60 0x7fb36c1013e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb358009900 tx=0x7fb35802a400 comp rx=0 tx=0).stop 2024-09-13T17:02:30.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.435+0000 7fb372800640 1 -- 172.21.15.18:0/330895161 shutdown_connections 2024-09-13T17:02:30.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.435+0000 7fb372800640 1 --2- 172.21.15.18:0/330895161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb36c101920 0x7fb36c1081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.435+0000 7fb372800640 1 --2- 172.21.15.18:0/330895161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb36c100f60 0x7fb36c1013e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.435+0000 7fb372800640 1 --2- 172.21.15.18:0/330895161 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb36c0ffd70 0x7fb36c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.435+0000 7fb372800640 1 -- 172.21.15.18:0/330895161 >> 172.21.15.18:0/330895161 conn(0x7fb36c0fb4d0 msgr2=0x7fb36c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:30.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.435+0000 7fb372800640 1 -- 172.21.15.18:0/330895161 shutdown_connections 2024-09-13T17:02:30.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.435+0000 7fb372800640 1 -- 172.21.15.18:0/330895161 wait complete. 2024-09-13T17:02:30.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.436+0000 7fb372800640 1 Processor -- start 2024-09-13T17:02:30.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.436+0000 7fb372800640 1 -- start start 2024-09-13T17:02:30.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb372800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb36c0ffd70 0x7fb36c074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb372800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb36c100f60 0x7fb36c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb372800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb36c101920 0x7fb36c072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb372800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c073540 con 0x7fb36c100f60 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb372800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0736b0 con 0x7fb36c101920 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb372800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c19fe00 con 0x7fb36c0ffd70 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb36aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb36c100f60 0x7fb36c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb36aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb36c100f60 0x7fb36c0728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34370/0 (socket says 172.21.15.18:34370) 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb36aa00640 1 -- 172.21.15.18:0/4117398768 learned_addr learned my addr 172.21.15.18:0/4117398768 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb36be00640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb36c101920 0x7fb36c072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb36b400640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb36c0ffd70 0x7fb36c074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb36aa00640 1 -- 172.21.15.18:0/4117398768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb36c0ffd70 msgr2=0x7fb36c074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb36aa00640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb36c0ffd70 0x7fb36c074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb36aa00640 1 -- 172.21.15.18:0/4117398768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb36c101920 msgr2=0x7fb36c072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb36aa00640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb36c101920 0x7fb36c072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.437+0000 7fb36aa00640 1 -- 172.21.15.18:0/4117398768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb364009840 con 0x7fb36c100f60 2024-09-13T17:02:30.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.438+0000 7fb36aa00640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb36c100f60 0x7fb36c0728a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb358006010 tx=0x7fb358005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:30.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.438+0000 7fb363e00640 1 -- 172.21.15.18:0/4117398768 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358004b50 con 0x7fb36c100f60 2024-09-13T17:02:30.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.438+0000 7fb363e00640 1 -- 172.21.15.18:0/4117398768 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb358004cb0 con 0x7fb36c100f60 2024-09-13T17:02:30.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.438+0000 7fb372800640 1 -- 172.21.15.18:0/4117398768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb358009560 con 0x7fb36c100f60 2024-09-13T17:02:30.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.438+0000 7fb363e00640 1 -- 172.21.15.18:0/4117398768 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358031920 con 0x7fb36c100f60 2024-09-13T17:02:30.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.438+0000 7fb372800640 1 -- 172.21.15.18:0/4117398768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c1a03c0 con 0x7fb36c100f60 2024-09-13T17:02:30.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.439+0000 7fb372800640 1 -- 172.21.15.18:0/4117398768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c1071f0 con 0x7fb36c100f60 2024-09-13T17:02:30.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.441+0000 7fb363e00640 1 -- 172.21.15.18:0/4117398768 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb358031a80 con 0x7fb36c100f60 2024-09-13T17:02:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.442+0000 7fb363e00640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb3500a1110 0x7fb3500a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.442+0000 7fb363e00640 1 -- 172.21.15.18:0/4117398768 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fb3580edb70 con 0x7fb36c100f60 2024-09-13T17:02:30.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.442+0000 7fb36b400640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb3500a1110 0x7fb3500a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.443+0000 7fb36b400640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb3500a1110 0x7fb3500a35d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb36c100dc0 tx=0x7fb35c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:30.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.446+0000 7fb363e00640 1 -- 172.21.15.18:0/4117398768 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb3580b6f40 con 0x7fb36c100f60 2024-09-13T17:02:30.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.627+0000 7fb372800640 1 -- 172.21.15.18:0/4117398768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb36c106c60 con 0x7fb36c100f60 2024-09-13T17:02:30.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.627+0000 7fb363e00640 1 -- 172.21.15.18:0/4117398768 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3580ba560 con 0x7fb36c100f60 2024-09-13T17:02:30.630 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-13T17:02:30.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 -- 172.21.15.18:0/4117398768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb3500a1110 msgr2=0x7fb3500a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb3500a1110 0x7fb3500a35d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb36c100dc0 tx=0x7fb35c005f90 comp rx=0 tx=0).stop 2024-09-13T17:02:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 -- 172.21.15.18:0/4117398768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb36c100f60 msgr2=0x7fb36c0728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb36c100f60 0x7fb36c0728a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb358006010 tx=0x7fb358005620 comp rx=0 tx=0).stop 2024-09-13T17:02:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 -- 172.21.15.18:0/4117398768 shutdown_connections 2024-09-13T17:02:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fb3500a1110 0x7fb3500a35d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb36c100f60 0x7fb36c0728a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb36c101920 0x7fb36c072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 --2- 172.21.15.18:0/4117398768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb36c0ffd70 0x7fb36c074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 -- 172.21.15.18:0/4117398768 >> 172.21.15.18:0/4117398768 conn(0x7fb36c0fb4d0 msgr2=0x7fb36c1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 -- 172.21.15.18:0/4117398768 shutdown_connections 2024-09-13T17:02:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.630+0000 7fb372800640 1 -- 172.21.15.18:0/4117398768 wait complete. 2024-09-13T17:02:30.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:30 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2118362399' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:30.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:30 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2202609759' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:02:30.646 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:30 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3452467795' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:02:30.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:02:30.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:30 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2118362399' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:30.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:30 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2202609759' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:02:30.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:30 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3452467795' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:02:30.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:30 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2118362399' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:30.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:30 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2202609759' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:02:30.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:30 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3452467795' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:02:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.805+0000 7f945ea00640 1 -- 172.21.15.18:0/606706464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9458100ee0 msgr2=0x7f9458101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.805+0000 7f945ea00640 1 --2- 172.21.15.18:0/606706464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9458100ee0 0x7f9458101360 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9444009900 tx=0x7f944402a410 comp rx=0 tx=0).stop 2024-09-13T17:02:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.805+0000 7f945ea00640 1 -- 172.21.15.18:0/606706464 shutdown_connections 2024-09-13T17:02:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.805+0000 7f945ea00640 1 --2- 172.21.15.18:0/606706464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9458100ee0 0x7f9458101360 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.805+0000 7f945ea00640 1 --2- 172.21.15.18:0/606706464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94581018a0 0x7f9458108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.805+0000 7f945ea00640 1 --2- 172.21.15.18:0/606706464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94580ffcf0 0x7f94581000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.805+0000 7f945ea00640 1 -- 172.21.15.18:0/606706464 >> 172.21.15.18:0/606706464 conn(0x7f94580fb450 msgr2=0x7f94580fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.806+0000 7f945ea00640 1 -- 172.21.15.18:0/606706464 shutdown_connections 2024-09-13T17:02:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.806+0000 7f945ea00640 1 -- 172.21.15.18:0/606706464 wait complete. 2024-09-13T17:02:30.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.806+0000 7f945ea00640 1 Processor -- start 2024-09-13T17:02:30.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945ea00640 1 -- start start 2024-09-13T17:02:30.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94580ffcf0 0x7f9458195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9458100ee0 0x7f9458196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945ea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94581018a0 0x7f945819d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945ea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945819d7e0 con 0x7f94580ffcf0 2024-09-13T17:02:30.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945ea00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945819d950 con 0x7f94581018a0 2024-09-13T17:02:30.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945819db10 con 0x7f9458100ee0 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94580ffcf0 0x7f9458195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94580ffcf0 0x7f9458195d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49154/0 (socket says 172.21.15.18:49154) 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945d600640 1 -- 172.21.15.18:0/1401181768 learned_addr learned my addr 172.21.15.18:0/1401181768 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945e000640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94581018a0 0x7f945819d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.807+0000 7f945cc00640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9458100ee0 0x7f9458196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f945d600640 1 -- 172.21.15.18:0/1401181768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9458100ee0 msgr2=0x7f9458196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f945d600640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9458100ee0 0x7f9458196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f945d600640 1 -- 172.21.15.18:0/1401181768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94581018a0 msgr2=0x7f945819d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f945d600640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94581018a0 0x7f945819d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f945d600640 1 -- 172.21.15.18:0/1401181768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9444009560 con 0x7f94580ffcf0 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f945d600640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94580ffcf0 0x7f9458195d00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f944c00e9c0 tx=0x7f944c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f9456000640 1 -- 172.21.15.18:0/1401181768 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c0096e0 con 0x7f94580ffcf0 2024-09-13T17:02:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f9456000640 1 -- 172.21.15.18:0/1401181768 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f944c0044f0 con 0x7f94580ffcf0 2024-09-13T17:02:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f9456000640 1 -- 172.21.15.18:0/1401181768 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c010430 con 0x7f94580ffcf0 2024-09-13T17:02:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f945ea00640 1 -- 172.21.15.18:0/1401181768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945819ddf0 con 0x7f94580ffcf0 2024-09-13T17:02:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.808+0000 7f945ea00640 1 -- 172.21.15.18:0/1401181768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945819e1c0 con 0x7f94580ffcf0 2024-09-13T17:02:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.809+0000 7f945ea00640 1 -- 172.21.15.18:0/1401181768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9458107170 con 0x7f94580ffcf0 2024-09-13T17:02:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.811+0000 7f9456000640 1 -- 172.21.15.18:0/1401181768 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f944c0035f0 con 0x7f94580ffcf0 2024-09-13T17:02:30.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.812+0000 7f9456000640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94400a1110 0x7f94400a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.812+0000 7f9456000640 1 -- 172.21.15.18:0/1401181768 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f944c014070 con 0x7f94580ffcf0 2024-09-13T17:02:30.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.813+0000 7f945cc00640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94400a1110 0x7f94400a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.813+0000 7f945cc00640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94400a1110 0x7f94400a35d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9444000c00 tx=0x7f9444005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:30.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.814+0000 7f9456000640 1 -- 172.21.15.18:0/1401181768 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f944c096420 con 0x7f94580ffcf0 2024-09-13T17:02:30.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.996+0000 7f945ea00640 1 -- 172.21.15.18:0/1401181768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f945810b7b0 con 0x7f94580ffcf0 2024-09-13T17:02:30.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.996+0000 7f9456000640 1 -- 172.21.15.18:0/1401181768 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f944c098350 con 0x7f94580ffcf0 2024-09-13T17:02:30.998 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 -- 172.21.15.18:0/1401181768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94400a1110 msgr2=0x7f94400a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94400a1110 0x7f94400a35d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9444000c00 tx=0x7f9444005760 comp rx=0 tx=0).stop 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 -- 172.21.15.18:0/1401181768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94580ffcf0 msgr2=0x7f9458195d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94580ffcf0 0x7f9458195d00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f944c00e9c0 tx=0x7f944c00ee80 comp rx=0 tx=0).stop 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 -- 172.21.15.18:0/1401181768 shutdown_connections 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94581018a0 0x7f945819d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9458100ee0 0x7f9458196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f94400a1110 0x7f94400a35d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 --2- 172.21.15.18:0/1401181768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94580ffcf0 0x7f9458195d00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 -- 172.21.15.18:0/1401181768 >> 172.21.15.18:0/1401181768 conn(0x7f94580fb450 msgr2=0x7f9458104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 -- 172.21.15.18:0/1401181768 shutdown_connections 2024-09-13T17:02:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:30.998+0000 7f945ea00640 1 -- 172.21.15.18:0/1401181768 wait complete. 2024-09-13T17:02:31.017 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:02:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.173+0000 7fc4d0000640 1 -- 172.21.15.18:0/2491520798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4c8103b40 msgr2=0x7fc4c810a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.173+0000 7fc4d0000640 1 --2- 172.21.15.18:0/2491520798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4c8103b40 0x7fc4c810a3d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009be0 tx=0x7fc4c002a6d0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.173+0000 7fc4d0000640 1 -- 172.21.15.18:0/2491520798 shutdown_connections 2024-09-13T17:02:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.173+0000 7fc4d0000640 1 --2- 172.21.15.18:0/2491520798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4c8103b40 0x7fc4c810a3d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.173+0000 7fc4d0000640 1 --2- 172.21.15.18:0/2491520798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4c8103180 0x7fc4c8103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.173+0000 7fc4d0000640 1 --2- 172.21.15.18:0/2491520798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4c8101f90 0x7fc4c8102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.173+0000 7fc4d0000640 1 -- 172.21.15.18:0/2491520798 >> 172.21.15.18:0/2491520798 conn(0x7fc4c80fd6d0 msgr2=0x7fc4c80ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.173+0000 7fc4d0000640 1 -- 172.21.15.18:0/2491520798 shutdown_connections 2024-09-13T17:02:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.173+0000 7fc4d0000640 1 -- 172.21.15.18:0/2491520798 wait complete. 2024-09-13T17:02:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.174+0000 7fc4d0000640 1 Processor -- start 2024-09-13T17:02:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.174+0000 7fc4d0000640 1 -- start start 2024-09-13T17:02:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.174+0000 7fc4d0000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4c8101f90 0x7fc4c8197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.174+0000 7fc4d0000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4c8103180 0x7fc4c8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.174+0000 7fc4d0000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4c8103b40 0x7fc4c819f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.174+0000 7fc4d0000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c819fac0 con 0x7fc4c8101f90 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.174+0000 7fc4d0000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c819fc30 con 0x7fc4c8103b40 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.174+0000 7fc4d0000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c819fdf0 con 0x7fc4c8103180 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.175+0000 7fc4cd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4c8101f90 0x7fc4c8197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.175+0000 7fc4ce000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4c8103b40 0x7fc4c819f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.175+0000 7fc4cd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4c8101f90 0x7fc4c8197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49168/0 (socket says 172.21.15.18:49168) 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.175+0000 7fc4cd600640 1 -- 172.21.15.18:0/2135321300 learned_addr learned my addr 172.21.15.18:0/2135321300 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.175+0000 7fc4ccc00640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4c8103180 0x7fc4c8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.175+0000 7fc4cd600640 1 -- 172.21.15.18:0/2135321300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4c8103180 msgr2=0x7fc4c8198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.175+0000 7fc4cd600640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4c8103180 0x7fc4c8198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.175+0000 7fc4cd600640 1 -- 172.21.15.18:0/2135321300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4c8103b40 msgr2=0x7fc4c819f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.175+0000 7fc4cd600640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4c8103b40 0x7fc4c819f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.175+0000 7fc4cd600640 1 -- 172.21.15.18:0/2135321300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc009560 con 0x7fc4c8101f90 2024-09-13T17:02:31.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.176+0000 7fc4cd600640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4c8101f90 0x7fc4c8197fd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00e9a0 tx=0x7fc4bc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:31.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.176+0000 7fc4c6000640 1 -- 172.21.15.18:0/2135321300 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00cd80 con 0x7fc4c8101f90 2024-09-13T17:02:31.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.176+0000 7fc4c6000640 1 -- 172.21.15.18:0/2135321300 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4bc0108f0 con 0x7fc4c8101f90 2024-09-13T17:02:31.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.176+0000 7fc4d0000640 1 -- 172.21.15.18:0/2135321300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b4009490 con 0x7fc4c8101f90 2024-09-13T17:02:31.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.176+0000 7fc4c6000640 1 -- 172.21.15.18:0/2135321300 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc018960 con 0x7fc4c8101f90 2024-09-13T17:02:31.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.176+0000 7fc4d0000640 1 -- 172.21.15.18:0/2135321300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c0009840 con 0x7fc4c8101f90 2024-09-13T17:02:31.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.177+0000 7fc4d0000640 1 -- 172.21.15.18:0/2135321300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c8109420 con 0x7fc4c8101f90 2024-09-13T17:02:31.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.179+0000 7fc4c6000640 1 -- 172.21.15.18:0/2135321300 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc4bc010a60 con 0x7fc4c8101f90 2024-09-13T17:02:31.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.180+0000 7fc4c6000640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc4b00a1090 0x7fc4b00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:31.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.180+0000 7fc4c6000640 1 -- 172.21.15.18:0/2135321300 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fc4bc014070 con 0x7fc4c8101f90 2024-09-13T17:02:31.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.180+0000 7fc4ccc00640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc4b00a1090 0x7fc4b00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:31.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.181+0000 7fc4ccc00640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc4b00a1090 0x7fc4b00a3550 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc4c81994e0 tx=0x7fc4b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:31.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.184+0000 7fc4c6000640 1 -- 172.21.15.18:0/2135321300 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc4bc096530 con 0x7fc4c8101f90 2024-09-13T17:02:31.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.392+0000 7fc4d0000640 1 -- 172.21.15.18:0/2135321300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4c810d830 con 0x7fc4c8101f90 2024-09-13T17:02:31.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.392+0000 7fc4c6000640 1 -- 172.21.15.18:0/2135321300 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v94) v1 ==== 81+0+588 (secure 0 0 0) 0x7fc4bc099b50 con 0x7fc4c8101f90 2024-09-13T17:02:31.394 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/920683112 2024-09-14T16:42:11.669513+0000 2024-09-13T17:02:31.395 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/920683112 2024-09-14T16:42:11.669513+0000 2024-09-13T17:02:31.395 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3837246804 2024-09-14T16:42:11.669513+0000 2024-09-13T17:02:31.395 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4227001658 2024-09-14T16:42:11.669513+0000 2024-09-13T17:02:31.395 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2737842128 2024-09-14T16:41:44.259356+0000 2024-09-13T17:02:31.395 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/295009687 2024-09-14T16:41:44.259356+0000 2024-09-13T17:02:31.395 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1872401951 2024-09-14T16:41:44.259356+0000 2024-09-13T17:02:31.395 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/1236399643 2024-09-14T16:41:44.259356+0000 2024-09-13T17:02:31.395 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/237199304 2024-09-14T16:42:11.669513+0000 2024-09-13T17:02:31.395 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/1236399643 2024-09-14T16:41:44.259356+0000 2024-09-13T17:02:31.395 INFO:teuthology.orchestra.run.smithi018.stderr:listed 10 entries 2024-09-13T17:02:31.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 -- 172.21.15.18:0/2135321300 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc4b00a1090 msgr2=0x7fc4b00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:31.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc4b00a1090 0x7fc4b00a3550 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc4c81994e0 tx=0x7fc4b4005f90 comp rx=0 tx=0).stop 2024-09-13T17:02:31.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 -- 172.21.15.18:0/2135321300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4c8101f90 msgr2=0x7fc4c8197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:31.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4c8101f90 0x7fc4c8197fd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00e9a0 tx=0x7fc4bc00ee60 comp rx=0 tx=0).stop 2024-09-13T17:02:31.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 -- 172.21.15.18:0/2135321300 shutdown_connections 2024-09-13T17:02:31.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4c8103b40 0x7fc4c819f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4c8103180 0x7fc4c8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fc4b00a1090 0x7fc4b00a3550 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 --2- 172.21.15.18:0/2135321300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4c8101f90 0x7fc4c8197fd0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:31.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 -- 172.21.15.18:0/2135321300 >> 172.21.15.18:0/2135321300 conn(0x7fc4c80fd6d0 msgr2=0x7fc4c81065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:31.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 -- 172.21.15.18:0/2135321300 shutdown_connections 2024-09-13T17:02:31.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:31.394+0000 7fc4d0000640 1 -- 172.21.15.18:0/2135321300 wait complete. 2024-09-13T17:02:31.412 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T17:02:31.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:02:31.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T17:02:31.541 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T17:02:31.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:02:31.542 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:02:31.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:02:31.635 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-13T17:02:31.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:31 smithi094 ceph-mon[35259]: pgmap v693: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:02:31.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:31 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/4117398768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:02:31.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:31 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1401181768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:02:31.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:31 smithi018 ceph-mon[30981]: pgmap v693: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:02:31.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:31 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4117398768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:02:31.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:31 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1401181768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:02:31.756 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:02:31.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:02:31.756 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:02:31.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:31 smithi144 ceph-mon[35328]: pgmap v693: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:02:31.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:31 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/4117398768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:02:31.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:31 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1401181768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:02:31.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:02:31.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-13T17:02:32.158 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T17:02:32.169 INFO:tasks.cephadm:Teardown begin 2024-09-13T17:02:32.169 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:02:32.169 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:02:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.328+0000 7fce41800640 1 -- 172.21.15.18:0/3437658538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce3c101fa0 msgr2=0x7fce3c1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.328+0000 7fce41800640 1 --2- 172.21.15.18:0/3437658538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce3c101fa0 0x7fce3c1023a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009900 tx=0x7fce2c02a400 comp rx=0 tx=0).stop 2024-09-13T17:02:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.328+0000 7fce41800640 1 -- 172.21.15.18:0/3437658538 shutdown_connections 2024-09-13T17:02:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.328+0000 7fce41800640 1 --2- 172.21.15.18:0/3437658538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce3c103190 0x7fce3c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.328+0000 7fce41800640 1 --2- 172.21.15.18:0/3437658538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c103b50 0x7fce3c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.328+0000 7fce41800640 1 --2- 172.21.15.18:0/3437658538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce3c101fa0 0x7fce3c1023a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.328+0000 7fce41800640 1 -- 172.21.15.18:0/3437658538 >> 172.21.15.18:0/3437658538 conn(0x7fce3c0fd700 msgr2=0x7fce3c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.328+0000 7fce41800640 1 -- 172.21.15.18:0/3437658538 shutdown_connections 2024-09-13T17:02:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.328+0000 7fce41800640 1 -- 172.21.15.18:0/3437658538 wait complete. 2024-09-13T17:02:32.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce41800640 1 Processor -- start 2024-09-13T17:02:32.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce41800640 1 -- start start 2024-09-13T17:02:32.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce41800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce3c101fa0 0x7fce3c197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce41800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c103190 0x7fce3c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce41800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce3c103b50 0x7fce3c19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce41800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c19fab0 con 0x7fce3c101fa0 2024-09-13T17:02:32.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce41800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c19fc20 con 0x7fce3c103b50 2024-09-13T17:02:32.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce41800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c19fde0 con 0x7fce3c103190 2024-09-13T17:02:32.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce3aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce3c101fa0 0x7fce3c197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce3aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce3c101fa0 0x7fce3c197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49184/0 (socket says 172.21.15.18:49184) 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce3aa00640 1 -- 172.21.15.18:0/4011321304 learned_addr learned my addr 172.21.15.18:0/4011321304 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce3b400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce3c103b50 0x7fce3c19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.329+0000 7fce32000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c103190 0x7fce3c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.330+0000 7fce3b400640 1 -- 172.21.15.18:0/4011321304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c103190 msgr2=0x7fce3c198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.330+0000 7fce3b400640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c103190 0x7fce3c198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.330+0000 7fce3b400640 1 -- 172.21.15.18:0/4011321304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce3c101fa0 msgr2=0x7fce3c197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.330+0000 7fce3b400640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce3c101fa0 0x7fce3c197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.330+0000 7fce3b400640 1 -- 172.21.15.18:0/4011321304 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c009560 con 0x7fce3c103b50 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.330+0000 7fce3b400640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce3c103b50 0x7fce3c19f570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce34009fd0 tx=0x7fce3400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.330+0000 7fce33e00640 1 -- 172.21.15.18:0/4011321304 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3400ce20 con 0x7fce3c103b50 2024-09-13T17:02:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.330+0000 7fce33e00640 1 -- 172.21.15.18:0/4011321304 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce34005020 con 0x7fce3c103b50 2024-09-13T17:02:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.330+0000 7fce41800640 1 -- 172.21.15.18:0/4011321304 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c1a00c0 con 0x7fce3c103b50 2024-09-13T17:02:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.330+0000 7fce33e00640 1 -- 172.21.15.18:0/4011321304 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34010670 con 0x7fce3c103b50 2024-09-13T17:02:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.331+0000 7fce41800640 1 -- 172.21.15.18:0/4011321304 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3c1a0580 con 0x7fce3c103b50 2024-09-13T17:02:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.332+0000 7fce41800640 1 -- 172.21.15.18:0/4011321304 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3c1094d0 con 0x7fce3c103b50 2024-09-13T17:02:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.333+0000 7fce33e00640 1 -- 172.21.15.18:0/4011321304 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fce34005450 con 0x7fce3c103b50 2024-09-13T17:02:32.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.335+0000 7fce33e00640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fce200a1090 0x7fce200a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.335+0000 7fce33e00640 1 -- 172.21.15.18:0/4011321304 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fce34014070 con 0x7fce3c103b50 2024-09-13T17:02:32.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.335+0000 7fce3aa00640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fce200a1090 0x7fce200a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.336+0000 7fce3aa00640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fce200a1090 0x7fce200a3550 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fce2c000c00 tx=0x7fce2c005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:32.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.337+0000 7fce33e00640 1 -- 172.21.15.18:0/4011321304 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fce340967a0 con 0x7fce3c103b50 2024-09-13T17:02:32.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.557+0000 7fce41800640 1 -- 172.21.15.18:0/4011321304 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce3c10d890 con 0x7fce3c103b50 2024-09-13T17:02:32.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.558+0000 7fce33e00640 1 -- 172.21.15.18:0/4011321304 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+10861 (secure 0 0 0) 0x7fce34099dc0 con 0x7fce3c103b50 2024-09-13T17:02:32.560 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T17:02:32.560 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:49:28.080578+0000","modified":"2024-09-13T16:59:07.293931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24590,"mds_1":24566,"mds_2":24539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24539":{"gid":24539,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25708":{"gid":25708,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/870471473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":870471473},{"type":"v1","addr":"172.21.15.144:6839","nonce":870471473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:02:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 35 2024-09-13T17:02:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 -- 172.21.15.18:0/4011321304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fce200a1090 msgr2=0x7fce200a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fce200a1090 0x7fce200a3550 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fce2c000c00 tx=0x7fce2c005780 comp rx=0 tx=0).stop 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 -- 172.21.15.18:0/4011321304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce3c103b50 msgr2=0x7fce3c19f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce3c103b50 0x7fce3c19f570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce34009fd0 tx=0x7fce3400ef10 comp rx=0 tx=0).stop 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 -- 172.21.15.18:0/4011321304 shutdown_connections 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce3c103b50 0x7fce3c19f570 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c103190 0x7fce3c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fce200a1090 0x7fce200a3550 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 --2- 172.21.15.18:0/4011321304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce3c101fa0 0x7fce3c197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 -- 172.21.15.18:0/4011321304 >> 172.21.15.18:0/4011321304 conn(0x7fce3c0fd700 msgr2=0x7fce3c1066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 -- 172.21.15.18:0/4011321304 shutdown_connections 2024-09-13T17:02:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.560+0000 7fce41800640 1 -- 172.21.15.18:0/4011321304 wait complete. 2024-09-13T17:02:32.580 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:02:32.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:32 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2135321300' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:02:32.661 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:32 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2135321300' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:02:32.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.735+0000 7f274e800640 1 -- 172.21.15.18:0/3975531174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27480ffda0 msgr2=0x7f27481001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.735+0000 7f274e800640 1 --2- 172.21.15.18:0/3975531174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27480ffda0 0x7f27481001a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2738009900 tx=0x7f273802a3f0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.735+0000 7f274e800640 1 -- 172.21.15.18:0/3975531174 shutdown_connections 2024-09-13T17:02:32.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.735+0000 7f274e800640 1 --2- 172.21.15.18:0/3975531174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2748101950 0x7f27481081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.735+0000 7f274e800640 1 --2- 172.21.15.18:0/3975531174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2748100f90 0x7f2748101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.735+0000 7f274e800640 1 --2- 172.21.15.18:0/3975531174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27480ffda0 0x7f27481001a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.735+0000 7f274e800640 1 -- 172.21.15.18:0/3975531174 >> 172.21.15.18:0/3975531174 conn(0x7f27480fb520 msgr2=0x7f27480fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:32.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.736+0000 7f274e800640 1 -- 172.21.15.18:0/3975531174 shutdown_connections 2024-09-13T17:02:32.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.736+0000 7f274e800640 1 -- 172.21.15.18:0/3975531174 wait complete. 2024-09-13T17:02:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f274e800640 1 Processor -- start 2024-09-13T17:02:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f274e800640 1 -- start start 2024-09-13T17:02:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f274e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27480ffda0 0x7f2748198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f274e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2748100f90 0x7f2748198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f274e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2748101950 0x7f274819f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f274e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274819fb30 con 0x7f2748100f90 2024-09-13T17:02:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f274e800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274819fca0 con 0x7f27480ffda0 2024-09-13T17:02:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f274e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274819fe60 con 0x7f2748101950 2024-09-13T17:02:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f2747400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27480ffda0 0x7f2748198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f273fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2748100f90 0x7f2748198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f273fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2748100f90 0x7f2748198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49208/0 (socket says 172.21.15.18:49208) 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f273fe00640 1 -- 172.21.15.18:0/2619148606 learned_addr learned my addr 172.21.15.18:0/2619148606 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f2747400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27480ffda0 0x7f2748198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:45970/0 (socket says 172.21.15.18:45970) 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.737+0000 7f2747e00640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2748101950 0x7f274819f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f273fe00640 1 -- 172.21.15.18:0/2619148606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2748101950 msgr2=0x7f274819f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f273fe00640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2748101950 0x7f274819f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f273fe00640 1 -- 172.21.15.18:0/2619148606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27480ffda0 msgr2=0x7f2748198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f273fe00640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27480ffda0 0x7f2748198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f273fe00640 1 -- 172.21.15.18:0/2619148606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738009560 con 0x7f2748100f90 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f2747e00640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2748101950 0x7f274819f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f273fe00640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2748100f90 0x7f2748198580 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f273000e9f0 tx=0x7f273000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f2744c00640 1 -- 172.21.15.18:0/2619148606 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730009700 con 0x7f2748100f90 2024-09-13T17:02:32.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f2744c00640 1 -- 172.21.15.18:0/2619148606 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f273000cd80 con 0x7f2748100f90 2024-09-13T17:02:32.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f2744c00640 1 -- 172.21.15.18:0/2619148606 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730018860 con 0x7f2748100f90 2024-09-13T17:02:32.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f274e800640 1 -- 172.21.15.18:0/2619148606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27481a0140 con 0x7f2748100f90 2024-09-13T17:02:32.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.738+0000 7f274e800640 1 -- 172.21.15.18:0/2619148606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27481a0600 con 0x7f2748100f90 2024-09-13T17:02:32.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.739+0000 7f274e800640 1 -- 172.21.15.18:0/2619148606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274810b6b0 con 0x7f2748100f90 2024-09-13T17:02:32.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.742+0000 7f2744c00640 1 -- 172.21.15.18:0/2619148606 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f27300189c0 con 0x7f2748100f90 2024-09-13T17:02:32.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.743+0000 7f2744c00640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f272c0a1110 0x7f272c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.743+0000 7f2744c00640 1 -- 172.21.15.18:0/2619148606 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f2730014070 con 0x7f2748100f90 2024-09-13T17:02:32.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.743+0000 7f2747400640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f272c0a1110 0x7f272c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.744+0000 7f2747400640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f272c0a1110 0x7f272c0a35d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2738031500 tx=0x7f2738005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:32.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.747+0000 7f2744c00640 1 -- 172.21.15.18:0/2619148606 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2730052e20 con 0x7f2748100f90 2024-09-13T17:02:32.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:32 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2135321300' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:02:32.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.964+0000 7f274e800640 1 -- 172.21.15.18:0/2619148606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f274810b8c0 con 0x7f2748100f90 2024-09-13T17:02:32.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.965+0000 7f2744c00640 1 -- 172.21.15.18:0/2619148606 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+10861 (secure 0 0 0) 0x7f2730096410 con 0x7f2748100f90 2024-09-13T17:02:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T17:02:32.968 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14460,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1281964026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1281964026},{"type":"v1","addr":"172.21.15.18:6835","nonce":1281964026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/2164016233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":2164016233},{"type":"v1","addr":"172.21.15.18:6837","nonce":2164016233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2193765786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2193765786},{"type":"v1","addr":"172.21.15.18:6841","nonce":2193765786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/813398687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":813398687},{"type":"v1","addr":"172.21.15.144:6833","nonce":813398687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24464,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/3502575605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3502575605},{"type":"v1","addr":"172.21.15.94:6833","nonce":3502575605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3926764648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3926764648},{"type":"v1","addr":"172.21.15.94:6835","nonce":3926764648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T16:49:28.080578+0000","modified":"2024-09-13T16:59:07.293931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24590,"mds_1":24566,"mds_2":24539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/81449437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":81449437},{"type":"v1","addr":"172.21.15.144:6835","nonce":81449437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/443543812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":443543812},{"type":"v1","addr":"172.21.15.144:6837","nonce":443543812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24539":{"gid":24539,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.94:6837/2839586927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":2839586927},{"type":"v1","addr":"172.21.15.94:6837","nonce":2839586927}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.18:6839/152668011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":152668011},{"type":"v1","addr":"172.21.15.18:6839","nonce":152668011}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.94:6839/1508206800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":1508206800},{"type":"v1","addr":"172.21.15.94:6839","nonce":1508206800}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25708":{"gid":25708,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/870471473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":870471473},{"type":"v1","addr":"172.21.15.144:6839","nonce":870471473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:02:32.968 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 35 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.967+0000 7f274e800640 1 -- 172.21.15.18:0/2619148606 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f272c0a1110 msgr2=0x7f272c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.967+0000 7f274e800640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f272c0a1110 0x7f272c0a35d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2738031500 tx=0x7f2738005780 comp rx=0 tx=0).stop 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.967+0000 7f274e800640 1 -- 172.21.15.18:0/2619148606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2748100f90 msgr2=0x7f2748198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.967+0000 7f274e800640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2748100f90 0x7f2748198580 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f273000e9f0 tx=0x7f273000eeb0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.967+0000 7f274e800640 1 -- 172.21.15.18:0/2619148606 shutdown_connections 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.967+0000 7f274e800640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f272c0a1110 0x7f272c0a35d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.967+0000 7f274e800640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2748100f90 0x7f2748198580 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.967+0000 7f274e800640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2748101950 0x7f274819f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.967+0000 7f274e800640 1 --2- 172.21.15.18:0/2619148606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27480ffda0 0x7f2748198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.967+0000 7f274e800640 1 -- 172.21.15.18:0/2619148606 >> 172.21.15.18:0/2619148606 conn(0x7f27480fb520 msgr2=0x7f2748106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.968+0000 7f274e800640 1 -- 172.21.15.18:0/2619148606 shutdown_connections 2024-09-13T17:02:32.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:32.968+0000 7f274e800640 1 -- 172.21.15.18:0/2619148606 wait complete. 2024-09-13T17:02:32.986 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:02:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.141+0000 7f834bc00640 1 -- 172.21.15.18:0/2141054058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8344100f90 msgr2=0x7f8344101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.141+0000 7f834bc00640 1 --2- 172.21.15.18:0/2141054058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8344100f90 0x7f8344101410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8330009900 tx=0x7f833002a3f0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.141+0000 7f834bc00640 1 -- 172.21.15.18:0/2141054058 shutdown_connections 2024-09-13T17:02:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.141+0000 7f834bc00640 1 --2- 172.21.15.18:0/2141054058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8344101950 0x7f83441081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.141+0000 7f834bc00640 1 --2- 172.21.15.18:0/2141054058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8344100f90 0x7f8344101410 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.141+0000 7f834bc00640 1 --2- 172.21.15.18:0/2141054058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83440ffda0 0x7f83441001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.141+0000 7f834bc00640 1 -- 172.21.15.18:0/2141054058 >> 172.21.15.18:0/2141054058 conn(0x7f83440fb520 msgr2=0x7f83440fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.141+0000 7f834bc00640 1 -- 172.21.15.18:0/2141054058 shutdown_connections 2024-09-13T17:02:33.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.141+0000 7f834bc00640 1 -- 172.21.15.18:0/2141054058 wait complete. 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.142+0000 7f834bc00640 1 Processor -- start 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f834bc00640 1 -- start start 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f834bc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83440ffda0 0x7f8344197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f834bc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8344100f90 0x7f83441984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f834bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8344101950 0x7f834419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f834bc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834419fa80 con 0x7f8344100f90 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f834bc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834419fbf0 con 0x7f83440ffda0 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f834bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834419fdb0 con 0x7f8344101950 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f8343e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8344100f90 0x7f83441984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f8349200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83440ffda0 0x7f8344197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f8343e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8344100f90 0x7f83441984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49220/0 (socket says 172.21.15.18:49220) 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f8343e00640 1 -- 172.21.15.18:0/3765824859 learned_addr learned my addr 172.21.15.18:0/3765824859 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.143+0000 7f8349c00640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8344101950 0x7f834419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f8343e00640 1 -- 172.21.15.18:0/3765824859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8344101950 msgr2=0x7f834419f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f8343e00640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8344101950 0x7f834419f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f8343e00640 1 -- 172.21.15.18:0/3765824859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83440ffda0 msgr2=0x7f8344197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f8343e00640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83440ffda0 0x7f8344197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f8343e00640 1 -- 172.21.15.18:0/3765824859 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330009560 con 0x7f8344100f90 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f8343e00640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8344100f90 0x7f83441984d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8330009a20 tx=0x7f8330005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f8341600640 1 -- 172.21.15.18:0/3765824859 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330004c10 con 0x7f8344100f90 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f8341600640 1 -- 172.21.15.18:0/3765824859 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8330004d70 con 0x7f8344100f90 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f834bc00640 1 -- 172.21.15.18:0/3765824859 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83441a0030 con 0x7f8344100f90 2024-09-13T17:02:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f8341600640 1 -- 172.21.15.18:0/3765824859 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330031ae0 con 0x7f8344100f90 2024-09-13T17:02:33.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.144+0000 7f834bc00640 1 -- 172.21.15.18:0/3765824859 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83441a04e0 con 0x7f8344100f90 2024-09-13T17:02:33.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.145+0000 7f834bc00640 1 -- 172.21.15.18:0/3765824859 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834410b660 con 0x7f8344100f90 2024-09-13T17:02:33.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.149+0000 7f8341600640 1 -- 172.21.15.18:0/3765824859 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8330031c40 con 0x7f8344100f90 2024-09-13T17:02:33.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.150+0000 7f8341600640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f832c0a1090 0x7f832c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.150+0000 7f8341600640 1 -- 172.21.15.18:0/3765824859 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7f83300edf40 con 0x7f8344100f90 2024-09-13T17:02:33.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.150+0000 7f8349200640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f832c0a1090 0x7f832c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.151+0000 7f8349200640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f832c0a1090 0x7f832c0a3550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8344100df0 tx=0x7f8338005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:33.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.152+0000 7f8341600640 1 -- 172.21.15.18:0/3765824859 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83300b7400 con 0x7f8344100f90 2024-09-13T17:02:33.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.339+0000 7f834bc00640 1 -- 172.21.15.18:0/3765824859 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83441a07c0 con 0x7f8344100f90 2024-09-13T17:02:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.341+0000 7f8341600640 1 -- 172.21.15.18:0/3765824859 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24592 (secure 0 0 0) 0x7f8330040090 con 0x7f8344100f90 2024-09-13T17:02:33.343 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T17:02:33.344 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":94,"fsid":"d8ff35a0-71ee-11ef-bceb-c7b262605968","created":"2024-09-13T16:41:18.754202+0000","modified":"2024-09-13T16:59:07.048861+0000","last_up_change":"2024-09-13T16:48:34.201681+0000","last_in_change":"2024-09-13T16:48:14.268184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T16:44:44.290877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T16:49:26.572697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T16:49:27.624038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T16:49:30.629093+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d42fca5-9912-4f5c-9e13-13e879484040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6803","nonce":2385031914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6805","nonce":2385031914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6809","nonce":2385031914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2385031914},{"type":"v1","addr":"172.21.15.18:6807","nonce":2385031914}]},"public_addr":"172.21.15.18:6803/2385031914","cluster_addr":"172.21.15.18:6805/2385031914","heartbeat_back_addr":"172.21.15.18:6809/2385031914","heartbeat_front_addr":"172.21.15.18:6807/2385031914","state":["exists","up"]},{"osd":1,"uuid":"7347881e-6e90-45e4-8c22-a2dc8d8b7ec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6801","nonce":3875618914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6803","nonce":3875618914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6807","nonce":3875618914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3875618914},{"type":"v1","addr":"172.21.15.94:6805","nonce":3875618914}]},"public_addr":"172.21.15.94:6801/3875618914","cluster_addr":"172.21.15.94:6803/3875618914","heartbeat_back_addr":"172.21.15.94:6807/3875618914","heartbeat_front_addr":"172.21.15.94:6805/3875618914","state":["exists","up"]},{"osd":2,"uuid":"eee31be9-0cee-459c-9552-e6addad9da7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6801","nonce":2547295971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6803","nonce":2547295971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6807","nonce":2547295971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2547295971},{"type":"v1","addr":"172.21.15.144:6805","nonce":2547295971}]},"public_addr":"172.21.15.144:6801/2547295971","cluster_addr":"172.21.15.144:6803/2547295971","heartbeat_back_addr":"172.21.15.144:6807/2547295971","heartbeat_front_addr":"172.21.15.144:6805/2547295971","state":["exists","up"]},{"osd":3,"uuid":"97cbcd7e-845f-42fb-94eb-31432947a878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6811","nonce":4196858312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6813","nonce":4196858312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6817","nonce":4196858312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":4196858312},{"type":"v1","addr":"172.21.15.18:6815","nonce":4196858312}]},"public_addr":"172.21.15.18:6811/4196858312","cluster_addr":"172.21.15.18:6813/4196858312","heartbeat_back_addr":"172.21.15.18:6817/4196858312","heartbeat_front_addr":"172.21.15.18:6815/4196858312","state":["exists","up"]},{"osd":4,"uuid":"2b8a6a63-ece3-4271-92f5-a301abae658c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6809","nonce":2294580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6811","nonce":2294580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6815","nonce":2294580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2294580},{"type":"v1","addr":"172.21.15.94:6813","nonce":2294580}]},"public_addr":"172.21.15.94:6809/2294580","cluster_addr":"172.21.15.94:6811/2294580","heartbeat_back_addr":"172.21.15.94:6815/2294580","heartbeat_front_addr":"172.21.15.94:6813/2294580","state":["exists","up"]},{"osd":5,"uuid":"3f93581d-1da2-4ff7-a4ae-81991f10c2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6809","nonce":890873206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6811","nonce":890873206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6815","nonce":890873206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":890873206},{"type":"v1","addr":"172.21.15.144:6813","nonce":890873206}]},"public_addr":"172.21.15.144:6809/890873206","cluster_addr":"172.21.15.144:6811/890873206","heartbeat_back_addr":"172.21.15.144:6815/890873206","heartbeat_front_addr":"172.21.15.144:6813/890873206","state":["exists","up"]},{"osd":6,"uuid":"c20ed6ea-c9fa-4693-9f2d-085ce33538f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6819","nonce":1300118017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6821","nonce":1300118017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6825","nonce":1300118017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1300118017},{"type":"v1","addr":"172.21.15.18:6823","nonce":1300118017}]},"public_addr":"172.21.15.18:6819/1300118017","cluster_addr":"172.21.15.18:6821/1300118017","heartbeat_back_addr":"172.21.15.18:6825/1300118017","heartbeat_front_addr":"172.21.15.18:6823/1300118017","state":["exists","up"]},{"osd":7,"uuid":"e5f3039b-06ae-4447-bf57-464bfda06871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6817","nonce":976410580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6819","nonce":976410580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6823","nonce":976410580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":976410580},{"type":"v1","addr":"172.21.15.94:6821","nonce":976410580}]},"public_addr":"172.21.15.94:6817/976410580","cluster_addr":"172.21.15.94:6819/976410580","heartbeat_back_addr":"172.21.15.94:6823/976410580","heartbeat_front_addr":"172.21.15.94:6821/976410580","state":["exists","up"]},{"osd":8,"uuid":"125a9e98-8193-4f8e-a548-c15d5127629c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6817","nonce":4258945385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6819","nonce":4258945385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6823","nonce":4258945385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":4258945385},{"type":"v1","addr":"172.21.15.144:6821","nonce":4258945385}]},"public_addr":"172.21.15.144:6817/4258945385","cluster_addr":"172.21.15.144:6819/4258945385","heartbeat_back_addr":"172.21.15.144:6823/4258945385","heartbeat_front_addr":"172.21.15.144:6821/4258945385","state":["exists","up"]},{"osd":9,"uuid":"7b40b786-9a18-4702-9db8-be1fa45b58d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6827","nonce":2756311466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6829","nonce":2756311466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6833","nonce":2756311466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2756311466},{"type":"v1","addr":"172.21.15.18:6831","nonce":2756311466}]},"public_addr":"172.21.15.18:6827/2756311466","cluster_addr":"172.21.15.18:6829/2756311466","heartbeat_back_addr":"172.21.15.18:6833/2756311466","heartbeat_front_addr":"172.21.15.18:6831/2756311466","state":["exists","up"]},{"osd":10,"uuid":"bb72e047-4488-48a5-801c-24e24423bbc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6825","nonce":896296327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6827","nonce":896296327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6831","nonce":896296327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":896296327},{"type":"v1","addr":"172.21.15.94:6829","nonce":896296327}]},"public_addr":"172.21.15.94:6825/896296327","cluster_addr":"172.21.15.94:6827/896296327","heartbeat_back_addr":"172.21.15.94:6831/896296327","heartbeat_front_addr":"172.21.15.94:6829/896296327","state":["exists","up"]},{"osd":11,"uuid":"d65a22d5-6e7a-4000-a463-59ed1f22518c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6825","nonce":3936121056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6827","nonce":3936121056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6831","nonce":3936121056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3936121056},{"type":"v1","addr":"172.21.15.144:6829","nonce":3936121056}]},"public_addr":"172.21.15.144:6825/3936121056","cluster_addr":"172.21.15.144:6827/3936121056","heartbeat_back_addr":"172.21.15.144:6831/3936121056","heartbeat_front_addr":"172.21.15.144:6829/3936121056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:43:57.128143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:19.965666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:44:41.396284+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:09.643777+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:33.396937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:45:56.350824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:25.261938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:46:49.520601+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:12.473778+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:47:42.782650+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:07.737943+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:48:31.476983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6801/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/920683112":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/3837246804":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/4227001658":"2024-09-14T16:42:11.669513+0000","172.21.15.18:0/2737842128":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/295009687":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/1872401951":"2024-09-14T16:41:44.259356+0000","172.21.15.18:6801/1236399643":"2024-09-14T16:41:44.259356+0000","172.21.15.18:0/237199304":"2024-09-14T16:42:11.669513+0000","172.21.15.18:6800/1236399643":"2024-09-14T16:41:44.259356+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:02:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 -- 172.21.15.18:0/3765824859 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f832c0a1090 msgr2=0x7f832c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f832c0a1090 0x7f832c0a3550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8344100df0 tx=0x7f8338005f90 comp rx=0 tx=0).stop 2024-09-13T17:02:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 -- 172.21.15.18:0/3765824859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8344100f90 msgr2=0x7f83441984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8344100f90 0x7f83441984d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8330009a20 tx=0x7f8330005620 comp rx=0 tx=0).stop 2024-09-13T17:02:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 -- 172.21.15.18:0/3765824859 shutdown_connections 2024-09-13T17:02:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f832c0a1090 0x7f832c0a3550 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8344100f90 0x7f83441984d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8344101950 0x7f834419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 --2- 172.21.15.18:0/3765824859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f83440ffda0 0x7f8344197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 -- 172.21.15.18:0/3765824859 >> 172.21.15.18:0/3765824859 conn(0x7f83440fb520 msgr2=0x7f8344106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 -- 172.21.15.18:0/3765824859 shutdown_connections 2024-09-13T17:02:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.343+0000 7f834bc00640 1 -- 172.21.15.18:0/3765824859 wait complete. 2024-09-13T17:02:33.362 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:02:33.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.518+0000 7fe080c00640 1 -- 172.21.15.18:0/1447771764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe07c102f10 msgr2=0x7fe07c105300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.518+0000 7fe080c00640 1 --2- 172.21.15.18:0/1447771764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe07c102f10 0x7fe07c105300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe068009900 tx=0x7fe06802a3f0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.518+0000 7fe080c00640 1 -- 172.21.15.18:0/1447771764 shutdown_connections 2024-09-13T17:02:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.518+0000 7fe080c00640 1 --2- 172.21.15.18:0/1447771764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe07c102f10 0x7fe07c105300 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.518+0000 7fe080c00640 1 --2- 172.21.15.18:0/1447771764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe07c105840 0x7fe07c107cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.518+0000 7fe080c00640 1 --2- 172.21.15.18:0/1447771764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe07c1005e0 0x7fe07c1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.518+0000 7fe080c00640 1 -- 172.21.15.18:0/1447771764 >> 172.21.15.18:0/1447771764 conn(0x7fe07c0fa1e0 msgr2=0x7fe07c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.518+0000 7fe080c00640 1 -- 172.21.15.18:0/1447771764 shutdown_connections 2024-09-13T17:02:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.518+0000 7fe080c00640 1 -- 172.21.15.18:0/1447771764 wait complete. 2024-09-13T17:02:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe080c00640 1 Processor -- start 2024-09-13T17:02:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe080c00640 1 -- start start 2024-09-13T17:02:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe080c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe07c1005e0 0x7fe07c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe080c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe07c102f10 0x7fe07c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe080c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe07c105840 0x7fe07c19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe080c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c19f900 con 0x7fe07c105840 2024-09-13T17:02:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe080c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c19fa70 con 0x7fe07c102f10 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe080c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c19fc30 con 0x7fe07c1005e0 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe07be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe07c105840 0x7fe07c19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe07aa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe07c102f10 0x7fe07c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe07be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe07c105840 0x7fe07c19f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49236/0 (socket says 172.21.15.18:49236) 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe07be00640 1 -- 172.21.15.18:0/253648895 learned_addr learned my addr 172.21.15.18:0/253648895 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.519+0000 7fe07b400640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe07c1005e0 0x7fe07c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe07aa00640 1 -- 172.21.15.18:0/253648895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe07c1005e0 msgr2=0x7fe07c197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe07aa00640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe07c1005e0 0x7fe07c197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe07aa00640 1 -- 172.21.15.18:0/253648895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe07c105840 msgr2=0x7fe07c19f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe07aa00640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe07c105840 0x7fe07c19f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe07aa00640 1 -- 172.21.15.18:0/253648895 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe068009560 con 0x7fe07c102f10 2024-09-13T17:02:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe07aa00640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe07c102f10 0x7fe07c198350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe068009230 tx=0x7fe068003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe073e00640 1 -- 172.21.15.18:0/253648895 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068003e00 con 0x7fe07c102f10 2024-09-13T17:02:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe073e00640 1 -- 172.21.15.18:0/253648895 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe068031c70 con 0x7fe07c102f10 2024-09-13T17:02:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe080c00640 1 -- 172.21.15.18:0/253648895 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c19feb0 con 0x7fe07c102f10 2024-09-13T17:02:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe073e00640 1 -- 172.21.15.18:0/253648895 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06803bd60 con 0x7fe07c102f10 2024-09-13T17:02:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.520+0000 7fe080c00640 1 -- 172.21.15.18:0/253648895 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c1a02d0 con 0x7fe07c102f10 2024-09-13T17:02:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.522+0000 7fe080c00640 1 -- 172.21.15.18:0/253648895 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c1073b0 con 0x7fe07c102f10 2024-09-13T17:02:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.523+0000 7fe073e00640 1 -- 172.21.15.18:0/253648895 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe06803b4f0 con 0x7fe07c102f10 2024-09-13T17:02:33.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.524+0000 7fe073e00640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe0600a1090 0x7fe0600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.525+0000 7fe073e00640 1 -- 172.21.15.18:0/253648895 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9136+0+0 (secure 0 0 0) 0x7fe0680ed4c0 con 0x7fe07c102f10 2024-09-13T17:02:33.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.525+0000 7fe07b400640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe0600a1090 0x7fe0600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.525+0000 7fe07b400640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe0600a1090 0x7fe0600a3550 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009bd0 tx=0x7fe06c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:33.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.528+0000 7fe073e00640 1 -- 172.21.15.18:0/253648895 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe0680b6940 con 0x7fe07c102f10 2024-09-13T17:02:33.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-mon[35259]: pgmap v694: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:02:33.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/4011321304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:02:33.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2619148606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:02:33.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3765824859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:33.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:33 smithi018 ceph-mon[30981]: pgmap v694: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:02:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/4011321304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:02:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2619148606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:02:33.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:33 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3765824859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:33.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.744+0000 7fe080c00640 1 -- 172.21.15.18:0/253648895 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe07c106e20 con 0x7fe07c102f10 2024-09-13T17:02:33.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.757+0000 7fe073e00640 1 -- 172.21.15.18:0/253648895 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe0680b9f60 con 0x7fe07c102f10 2024-09-13T17:02:33.760 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:02:33.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 -- 172.21.15.18:0/253648895 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe0600a1090 msgr2=0x7fe0600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe0600a1090 0x7fe0600a3550 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009bd0 tx=0x7fe06c005f90 comp rx=0 tx=0).stop 2024-09-13T17:02:33.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 -- 172.21.15.18:0/253648895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe07c102f10 msgr2=0x7fe07c198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe07c102f10 0x7fe07c198350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe068009230 tx=0x7fe068003c10 comp rx=0 tx=0).stop 2024-09-13T17:02:33.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 -- 172.21.15.18:0/253648895 shutdown_connections 2024-09-13T17:02:33.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7fe0600a1090 0x7fe0600a3550 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe07c105840 0x7fe07c19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe07c102f10 0x7fe07c198350 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 --2- 172.21.15.18:0/253648895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe07c1005e0 0x7fe07c197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 -- 172.21.15.18:0/253648895 >> 172.21.15.18:0/253648895 conn(0x7fe07c0fa1e0 msgr2=0x7fe07c0ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:33.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 -- 172.21.15.18:0/253648895 shutdown_connections 2024-09-13T17:02:33.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.760+0000 7fe080c00640 1 -- 172.21.15.18:0/253648895 wait complete. 2024-09-13T17:02:33.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-mon[35328]: pgmap v694: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:02:33.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/4011321304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:02:33.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2619148606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:02:33.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3765824859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:33.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:02:33.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.939+0000 7ffb2d400640 1 -- 172.21.15.18:0/1261618594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28103170 msgr2=0x7ffb281035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.939+0000 7ffb2d400640 1 --2- 172.21.15.18:0/1261618594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28103170 0x7ffb281035f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009860 tx=0x7ffb1002a340 comp rx=0 tx=0).stop 2024-09-13T17:02:33.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.939+0000 7ffb2d400640 1 -- 172.21.15.18:0/1261618594 shutdown_connections 2024-09-13T17:02:33.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.940+0000 7ffb2d400640 1 --2- 172.21.15.18:0/1261618594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb28103b30 0x7ffb2810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.940+0000 7ffb2d400640 1 --2- 172.21.15.18:0/1261618594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28103170 0x7ffb281035f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.940+0000 7ffb2d400640 1 --2- 172.21.15.18:0/1261618594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28101f80 0x7ffb28102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.940+0000 7ffb2d400640 1 -- 172.21.15.18:0/1261618594 >> 172.21.15.18:0/1261618594 conn(0x7ffb280fd700 msgr2=0x7ffb280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.940+0000 7ffb2d400640 1 -- 172.21.15.18:0/1261618594 shutdown_connections 2024-09-13T17:02:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.940+0000 7ffb2d400640 1 -- 172.21.15.18:0/1261618594 wait complete. 2024-09-13T17:02:33.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.940+0000 7ffb2d400640 1 Processor -- start 2024-09-13T17:02:33.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb2d400640 1 -- start start 2024-09-13T17:02:33.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb2d400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28101f80 0x7ffb28197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb2d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb28103170 0x7ffb28198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb2d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28103b30 0x7ffb2819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb2d400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2819fad0 con 0x7ffb28103170 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb2d400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2819fc40 con 0x7ffb28101f80 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb2d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2819fe00 con 0x7ffb28103b30 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb1de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb28103170 0x7ffb28198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb26800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28101f80 0x7ffb28197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb26800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28101f80 0x7ffb28197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.18:46070/0 (socket says 172.21.15.18:46070) 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb1de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb28103170 0x7ffb28198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49266/0 (socket says 172.21.15.18:49266) 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb26800640 1 -- 172.21.15.18:0/2018202658 learned_addr learned my addr 172.21.15.18:0/2018202658 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.941+0000 7ffb27200640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28103b30 0x7ffb2819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb26800640 1 -- 172.21.15.18:0/2018202658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28103b30 msgr2=0x7ffb2819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb26800640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28103b30 0x7ffb2819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb26800640 1 -- 172.21.15.18:0/2018202658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb28103170 msgr2=0x7ffb28198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:33.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb26800640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb28103170 0x7ffb28198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:33.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb26800640 1 -- 172.21.15.18:0/2018202658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb20009840 con 0x7ffb28101f80 2024-09-13T17:02:33.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb27200640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28103b30 0x7ffb2819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:02:33.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb26800640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28101f80 0x7ffb28197fe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800e9f0 tx=0x7ffb1800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:33.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb1fe00640 1 -- 172.21.15.18:0/2018202658 <== mon.2 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1800ccc0 con 0x7ffb28101f80 2024-09-13T17:02:33.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb1fe00640 1 -- 172.21.15.18:0/2018202658 <== mon.2 v2:172.21.15.94:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb1800ce20 con 0x7ffb28101f80 2024-09-13T17:02:33.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb1fe00640 1 -- 172.21.15.18:0/2018202658 <== mon.2 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18010430 con 0x7ffb28101f80 2024-09-13T17:02:33.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb2d400640 1 -- 172.21.15.18:0/2018202658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb10009490 con 0x7ffb28101f80 2024-09-13T17:02:33.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.942+0000 7ffb2d400640 1 -- 172.21.15.18:0/2018202658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb281a03e0 con 0x7ffb28101f80 2024-09-13T17:02:33.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.943+0000 7ffb2d400640 1 -- 172.21.15.18:0/2018202658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb28109430 con 0x7ffb28101f80 2024-09-13T17:02:33.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.945+0000 7ffb1fe00640 1 -- 172.21.15.18:0/2018202658 <== mon.2 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ffb18003f20 con 0x7ffb28101f80 2024-09-13T17:02:33.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.947+0000 7ffb1fe00640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffb0c0a1110 0x7ffb0c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:33.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.947+0000 7ffb1fe00640 1 -- 172.21.15.18:0/2018202658 <== mon.2 v2:172.21.15.94:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9394+0+0 (secure 0 0 0) 0x7ffb18014070 con 0x7ffb28101f80 2024-09-13T17:02:33.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.947+0000 7ffb1de00640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffb0c0a1110 0x7ffb0c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:33.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.947+0000 7ffb1de00640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffb0c0a1110 0x7ffb0c0a35d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffb10030410 tx=0x7ffb10030580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:33.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:33.948+0000 7ffb1fe00640 1 -- 172.21.15.18:0/2018202658 <== mon.2 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffb18096390 con 0x7ffb28101f80 2024-09-13T17:02:34.162 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h[65358]: ignoring --setuser ceph since I am not root 2024-09-13T17:02:34.162 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h[65358]: ignoring --setgroup ceph since I am not root 2024-09-13T17:02:34.162 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-mds[65362]: -- 172.21.15.94:0/130178033 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55eb859ded00 con 0x55eb859b3000 2024-09-13T17:02:34.162 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h[65358]: starting mds.h at 2024-09-13T17:02:34.163 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b[65662]: ignoring --setuser ceph since I am not root 2024-09-13T17:02:34.163 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b[65662]: ignoring --setgroup ceph since I am not root 2024-09-13T17:02:34.163 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-mds[65666]: -- 172.21.15.94:0/269044403 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5585d13dad00 con 0x5585d13af400 2024-09-13T17:02:34.163 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:02:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b[65662]: starting mds.b at 2024-09-13T17:02:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.167+0000 7ffb2d400640 1 -- 172.21.15.18:0/2018202658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffb2802c480 con 0x7ffb28101f80 2024-09-13T17:02:34.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a[30977]: 2024-09-13T17:02:33.746+0000 7fd432a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:02:34.210 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:02:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g[71871]: ignoring --setuser ceph since I am not root 2024-09-13T17:02:34.210 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:02:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g[71871]: ignoring --setgroup ceph since I am not root 2024-09-13T17:02:34.210 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:02:33 smithi018 ceph-mds[71899]: -- 172.21.15.18:0/619238759 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d5d79aad00 con 0x55d5d797e800 2024-09-13T17:02:34.210 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:02:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g[71871]: starting mds.g at 2024-09-13T17:02:34.272 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f[65383]: ignoring --setuser ceph since I am not root 2024-09-13T17:02:34.272 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f[65383]: ignoring --setgroup ceph since I am not root 2024-09-13T17:02:34.272 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-mds[65387]: -- 172.21.15.144:0/3760718524 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dca5450d00 con 0x55dca5424800 2024-09-13T17:02:34.272 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f[65383]: starting mds.f at 2024-09-13T17:02:34.272 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c[65686]: ignoring --setuser ceph since I am not root 2024-09-13T17:02:34.272 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c[65686]: ignoring --setgroup ceph since I am not root 2024-09-13T17:02:34.273 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-mds[65690]: -- 172.21.15.144:0/3196751998 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559f89912d00 con 0x559f898e7400 2024-09-13T17:02:34.273 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c[65686]: starting mds.c at 2024-09-13T17:02:34.275 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i[65987]: ignoring --setuser ceph since I am not root 2024-09-13T17:02:34.275 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i[65987]: ignoring --setgroup ceph since I am not root 2024-09-13T17:02:34.275 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-mds[65991]: -- 172.21.15.144:0/1739419541 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56288f340d00 con 0x56288f314800 2024-09-13T17:02:34.276 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:02:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i[65987]: starting mds.i at 2024-09-13T17:02:34.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:34 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/253648895' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T17:02:34.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:34 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T17:02:34.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:34 smithi094 ceph-mon[35259]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:02:34.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:34 smithi094 ceph-mon[35259]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:02:34.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:34 smithi094 ceph-mon[35259]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T17:02:34.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:34 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T17:02:34.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:34 smithi094 ceph-mon[35259]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T17:02:34.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:34 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2018202658' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:02:34.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:34 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:02:34.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:34 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/253648895' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T17:02:34.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:34 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T17:02:34.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:34 smithi018 ceph-mon[30981]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:02:34.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:34 smithi018 ceph-mon[30981]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:02:34.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:34 smithi018 ceph-mon[30981]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T17:02:34.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:34 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T17:02:34.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:34 smithi018 ceph-mon[30981]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T17:02:34.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:34 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2018202658' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:02:34.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:34 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:02:34.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.762+0000 7ffb1fe00640 1 -- 172.21.15.18:0/2018202658 <== mon.2 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffb180999b0 con 0x7ffb28101f80 2024-09-13T17:02:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.764+0000 7ffb2d400640 1 -- 172.21.15.18:0/2018202658 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffb0c0a1110 msgr2=0x7ffb0c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.764+0000 7ffb2d400640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffb0c0a1110 0x7ffb0c0a35d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffb10030410 tx=0x7ffb10030580 comp rx=0 tx=0).stop 2024-09-13T17:02:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.764+0000 7ffb2d400640 1 -- 172.21.15.18:0/2018202658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28101f80 msgr2=0x7ffb28197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.764+0000 7ffb2d400640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28101f80 0x7ffb28197fe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800e9f0 tx=0x7ffb1800eeb0 comp rx=0 tx=0).stop 2024-09-13T17:02:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.765+0000 7ffb2d400640 1 -- 172.21.15.18:0/2018202658 shutdown_connections 2024-09-13T17:02:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.765+0000 7ffb2d400640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7ffb0c0a1110 0x7ffb0c0a35d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.765+0000 7ffb2d400640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb28103170 0x7ffb28198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.765+0000 7ffb2d400640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28103b30 0x7ffb2819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:34.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.765+0000 7ffb2d400640 1 --2- 172.21.15.18:0/2018202658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb28101f80 0x7ffb28197fe0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:34.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.765+0000 7ffb2d400640 1 -- 172.21.15.18:0/2018202658 >> 172.21.15.18:0/2018202658 conn(0x7ffb280fd700 msgr2=0x7ffb28106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:34.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.765+0000 7ffb2d400640 1 -- 172.21.15.18:0/2018202658 shutdown_connections 2024-09-13T17:02:34.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.765+0000 7ffb2d400640 1 -- 172.21.15.18:0/2018202658 wait complete. 2024-09-13T17:02:34.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:34 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/253648895' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T17:02:34.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:34 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T17:02:34.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:34 smithi144 ceph-mon[35328]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:02:34.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:34 smithi144 ceph-mon[35328]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:02:34.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:34 smithi144 ceph-mon[35328]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T17:02:34.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:34 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T17:02:34.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:34 smithi144 ceph-mon[35328]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T17:02:34.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:34 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2018202658' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:02:34.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:34 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:02:34.785 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:02:34.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.945+0000 7f37eec00640 1 -- 172.21.15.18:0/946937199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e8101f80 msgr2=0x7f37e8102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:34.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.945+0000 7f37eec00640 1 --2- 172.21.15.18:0/946937199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e8101f80 0x7f37e8102380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009860 tx=0x7f37d802a340 comp rx=0 tx=0).stop 2024-09-13T17:02:34.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.945+0000 7f37eec00640 1 -- 172.21.15.18:0/946937199 shutdown_connections 2024-09-13T17:02:34.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.945+0000 7f37eec00640 1 --2- 172.21.15.18:0/946937199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e8103170 0x7f37e81035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:34.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.945+0000 7f37eec00640 1 --2- 172.21.15.18:0/946937199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37e8103b30 0x7f37e810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:34.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.945+0000 7f37eec00640 1 --2- 172.21.15.18:0/946937199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e8101f80 0x7f37e8102380 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:34.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.945+0000 7f37eec00640 1 -- 172.21.15.18:0/946937199 >> 172.21.15.18:0/946937199 conn(0x7f37e80fd700 msgr2=0x7f37e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:34.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.945+0000 7f37eec00640 1 -- 172.21.15.18:0/946937199 shutdown_connections 2024-09-13T17:02:34.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.945+0000 7f37eec00640 1 -- 172.21.15.18:0/946937199 wait complete. 2024-09-13T17:02:34.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.946+0000 7f37eec00640 1 Processor -- start 2024-09-13T17:02:34.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.946+0000 7f37eec00640 1 -- start start 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37eec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e8101f80 0x7f37e8197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37eec00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37e8103170 0x7f37e8198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37eec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e8103b30 0x7f37e819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37eec00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e819fa80 con 0x7f37e8103b30 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37eec00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e819fbf0 con 0x7f37e8103170 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37eec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e819fdb0 con 0x7f37e8101f80 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e8101f80 0x7f37e8197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e8101f80 0x7f37e8197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:51362/0 (socket says 172.21.15.18:51362) 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37ecc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e8103b30 0x7f37e819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37e7e00640 1 -- 172.21.15.18:0/2275516715 learned_addr learned my addr 172.21.15.18:0/2275516715 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37e7400640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37e8103170 0x7f37e8198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:34.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37e7e00640 1 -- 172.21.15.18:0/2275516715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37e8103170 msgr2=0x7f37e8198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:34.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37e7e00640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37e8103170 0x7f37e8198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:34.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37e7e00640 1 -- 172.21.15.18:0/2275516715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e8103b30 msgr2=0x7f37e819f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:34.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37e7e00640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e8103b30 0x7f37e819f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:34.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.947+0000 7f37e7e00640 1 -- 172.21.15.18:0/2275516715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4009560 con 0x7f37e8101f80 2024-09-13T17:02:34.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.948+0000 7f37e7e00640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e8101f80 0x7f37e8197fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f37d80304b0 tx=0x7f37d8032d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:34.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.948+0000 7f37e4c00640 1 -- 172.21.15.18:0/2275516715 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8004050 con 0x7f37e8101f80 2024-09-13T17:02:34.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.948+0000 7f37eec00640 1 -- 172.21.15.18:0/2275516715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d8009490 con 0x7f37e8101f80 2024-09-13T17:02:34.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.948+0000 7f37eec00640 1 -- 172.21.15.18:0/2275516715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e81a03a0 con 0x7f37e8101f80 2024-09-13T17:02:34.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.948+0000 7f37e4c00640 1 -- 172.21.15.18:0/2275516715 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37d8005070 con 0x7f37e8101f80 2024-09-13T17:02:34.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.948+0000 7f37e4c00640 1 -- 172.21.15.18:0/2275516715 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8004a50 con 0x7f37e8101f80 2024-09-13T17:02:34.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.949+0000 7f37eec00640 1 -- 172.21.15.18:0/2275516715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e8109520 con 0x7f37e8101f80 2024-09-13T17:02:34.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.951+0000 7f37e4c00640 1 -- 172.21.15.18:0/2275516715 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f37d804b070 con 0x7f37e8101f80 2024-09-13T17:02:34.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.953+0000 7f37e4c00640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f37cc0a1110 0x7f37cc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:34.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.953+0000 7f37e4c00640 1 -- 172.21.15.18:0/2275516715 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9394+0+0 (secure 0 0 0) 0x7f37d80ed260 con 0x7f37e8101f80 2024-09-13T17:02:34.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.953+0000 7f37e7400640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f37cc0a1110 0x7f37cc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:34.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.953+0000 7f37e7400640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f37cc0a1110 0x7f37cc0a35d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f37e81994a0 tx=0x7f37d4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:34.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:34.955+0000 7f37e4c00640 1 -- 172.21.15.18:0/2275516715 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f37d80b65e0 con 0x7f37e8101f80 2024-09-13T17:02:35.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.136+0000 7f37eec00640 1 -- 172.21.15.18:0/2275516715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37e810d820 con 0x7f37e8101f80 2024-09-13T17:02:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: pgmap v696: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-13T17:02:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:02:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:02:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: Cluster is now healthy 2024-09-13T17:02:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.144:6834/3098444912,v1:172.21.15.144:6835/3098444912] up:boot 2024-09-13T17:02:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.94:6836/3843252833,v1:172.21.15.94:6838/3843252833] up:boot 2024-09-13T17:02:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.94:6837/2700529714,v1:172.21.15.94:6839/2700529714] up:boot 2024-09-13T17:02:35.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.144:6837/2841214846,v1:172.21.15.144:6838/2841214846] up:boot 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.144:6836/1820919478,v1:172.21.15.144:6839/1820919478] up:boot 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: mds.? [v2:172.21.15.18:6838/2549016595,v1:172.21.15.18:6839/2549016595] up:boot 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: fsmap 12 up:standby 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/2275516715' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:35.461 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:35 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:35.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: pgmap v696: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-13T17:02:35.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:02:35.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:02:35.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: Cluster is now healthy 2024-09-13T17:02:35.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.144:6834/3098444912,v1:172.21.15.144:6835/3098444912] up:boot 2024-09-13T17:02:35.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.94:6836/3843252833,v1:172.21.15.94:6838/3843252833] up:boot 2024-09-13T17:02:35.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.94:6837/2700529714,v1:172.21.15.94:6839/2700529714] up:boot 2024-09-13T17:02:35.662 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.144:6837/2841214846,v1:172.21.15.144:6838/2841214846] up:boot 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.144:6836/1820919478,v1:172.21.15.144:6839/1820919478] up:boot 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: mds.? [v2:172.21.15.18:6838/2549016595,v1:172.21.15.18:6839/2549016595] up:boot 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: fsmap 12 up:standby 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/2275516715' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:35.663 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:35 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:35.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.765+0000 7f37e4c00640 1 -- 172.21.15.18:0/2275516715 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) v1 ==== 181+0+0 (secure 0 0 0) 0x7f37d80370d0 con 0x7f37e8101f80 2024-09-13T17:02:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:02:35.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: pgmap v696: 129 pgs: 129 active+clean; 458 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-13T17:02:35.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:02:35.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:02:35.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: Cluster is now healthy 2024-09-13T17:02:35.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.144:6834/3098444912,v1:172.21.15.144:6835/3098444912] up:boot 2024-09-13T17:02:35.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.94:6836/3843252833,v1:172.21.15.94:6838/3843252833] up:boot 2024-09-13T17:02:35.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.94:6837/2700529714,v1:172.21.15.94:6839/2700529714] up:boot 2024-09-13T17:02:35.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.144:6837/2841214846,v1:172.21.15.144:6838/2841214846] up:boot 2024-09-13T17:02:35.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.144:6836/1820919478,v1:172.21.15.144:6839/1820919478] up:boot 2024-09-13T17:02:35.772 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: mds.? [v2:172.21.15.18:6838/2549016595,v1:172.21.15.18:6839/2549016595] up:boot 2024-09-13T17:02:35.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:02:35.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: fsmap 12 up:standby 2024-09-13T17:02:35.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:02:35.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:02:35.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:02:35.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:02:35.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:02:35.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: from='mgr.14150 172.21.15.18:0/1054307180' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T17:02:35.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/2275516715' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:35.773 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:35 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.770+0000 7f37eec00640 1 -- 172.21.15.18:0/2275516715 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f37cc0a1110 msgr2=0x7f37cc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.770+0000 7f37eec00640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f37cc0a1110 0x7f37cc0a35d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f37e81994a0 tx=0x7f37d4009260 comp rx=0 tx=0).stop 2024-09-13T17:02:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.771+0000 7f37eec00640 1 -- 172.21.15.18:0/2275516715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e8101f80 msgr2=0x7f37e8197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.771+0000 7f37eec00640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e8101f80 0x7f37e8197fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f37d80304b0 tx=0x7f37d8032d20 comp rx=0 tx=0).stop 2024-09-13T17:02:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.772+0000 7f37eec00640 1 -- 172.21.15.18:0/2275516715 shutdown_connections 2024-09-13T17:02:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.772+0000 7f37eec00640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f37cc0a1110 0x7f37cc0a35d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.772+0000 7f37eec00640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e8103b30 0x7f37e819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.772+0000 7f37eec00640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37e8103170 0x7f37e8198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.772+0000 7f37eec00640 1 --2- 172.21.15.18:0/2275516715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e8101f80 0x7f37e8197fe0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.772+0000 7f37eec00640 1 -- 172.21.15.18:0/2275516715 >> 172.21.15.18:0/2275516715 conn(0x7f37e80fd700 msgr2=0x7f37e81066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.772+0000 7f37eec00640 1 -- 172.21.15.18:0/2275516715 shutdown_connections 2024-09-13T17:02:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.773+0000 7f37eec00640 1 -- 172.21.15.18:0/2275516715 wait complete. 2024-09-13T17:02:35.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:02:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.968+0000 7feec1e00640 1 -- 172.21.15.18:0/1759397519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feebc103080 msgr2=0x7feebc103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.968+0000 7feec1e00640 1 --2- 172.21.15.18:0/1759397519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feebc103080 0x7feebc103500 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7feea8009900 tx=0x7feea802a410 comp rx=0 tx=0).stop 2024-09-13T17:02:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.968+0000 7feec1e00640 1 -- 172.21.15.18:0/1759397519 shutdown_connections 2024-09-13T17:02:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.968+0000 7feec1e00640 1 --2- 172.21.15.18:0/1759397519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feebc103080 0x7feebc103500 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.968+0000 7feec1e00640 1 --2- 172.21.15.18:0/1759397519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feebc103a40 0x7feebc10a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.968+0000 7feec1e00640 1 --2- 172.21.15.18:0/1759397519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feebc101ea0 0x7feebc1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.968+0000 7feec1e00640 1 -- 172.21.15.18:0/1759397519 >> 172.21.15.18:0/1759397519 conn(0x7feebc0fd670 msgr2=0x7feebc0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.968+0000 7feec1e00640 1 -- 172.21.15.18:0/1759397519 shutdown_connections 2024-09-13T17:02:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.968+0000 7feec1e00640 1 -- 172.21.15.18:0/1759397519 wait complete. 2024-09-13T17:02:35.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.969+0000 7feec1e00640 1 Processor -- start 2024-09-13T17:02:35.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.969+0000 7feec1e00640 1 -- start start 2024-09-13T17:02:35.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.969+0000 7feec1e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feebc101ea0 0x7feebc197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.969+0000 7feec1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feebc103080 0x7feebc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.969+0000 7feec1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feebc103a40 0x7feebc19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.969+0000 7feec1e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc19f9c0 con 0x7feebc103a40 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.969+0000 7feec1e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc19fb30 con 0x7feebc101ea0 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.969+0000 7feec1e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc19fcf0 con 0x7feebc103080 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feebc103a40 0x7feebc19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec0a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feebc101ea0 0x7feebc197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feebc103a40 0x7feebc19f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49306/0 (socket says 172.21.15.18:49306) 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec1400640 1 -- 172.21.15.18:0/3392225090 learned_addr learned my addr 172.21.15.18:0/3392225090 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feebbe00640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feebc103080 0x7feebc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec1400640 1 -- 172.21.15.18:0/3392225090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feebc103080 msgr2=0x7feebc198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec1400640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feebc103080 0x7feebc198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec1400640 1 -- 172.21.15.18:0/3392225090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feebc101ea0 msgr2=0x7feebc197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec1400640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feebc101ea0 0x7feebc197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec1400640 1 -- 172.21.15.18:0/3392225090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8009560 con 0x7feebc103a40 2024-09-13T17:02:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec0a00640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feebc101ea0 0x7feebc197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:02:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.970+0000 7feec1400640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feebc103a40 0x7feebc19f480 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009fd0 tx=0x7feeb400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.971+0000 7feeb9600640 1 -- 172.21.15.18:0/3392225090 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb400bea0 con 0x7feebc103a40 2024-09-13T17:02:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.971+0000 7feeb9600640 1 -- 172.21.15.18:0/3392225090 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feeb4009940 con 0x7feebc103a40 2024-09-13T17:02:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.971+0000 7feeb9600640 1 -- 172.21.15.18:0/3392225090 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40106c0 con 0x7feebc103a40 2024-09-13T17:02:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.971+0000 7feec1e00640 1 -- 172.21.15.18:0/3392225090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc19ffd0 con 0x7feebc103a40 2024-09-13T17:02:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.971+0000 7feec1e00640 1 -- 172.21.15.18:0/3392225090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc1a0400 con 0x7feebc103a40 2024-09-13T17:02:35.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.972+0000 7feec1e00640 1 -- 172.21.15.18:0/3392225090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc1093a0 con 0x7feebc103a40 2024-09-13T17:02:35.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.974+0000 7feeb9600640 1 -- 172.21.15.18:0/3392225090 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7feeb40041b0 con 0x7feebc103a40 2024-09-13T17:02:35.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.975+0000 7feeb9600640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feea40a1110 0x7feea40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:35.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.975+0000 7feeb9600640 1 -- 172.21.15.18:0/3392225090 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8840+0+0 (secure 0 0 0) 0x7feeb40cc750 con 0x7feebc103a40 2024-09-13T17:02:35.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.975+0000 7feec0a00640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feea40a1110 0x7feea40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:35.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.976+0000 7feec0a00640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feea40a1110 0x7feea40a35d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feebc102bf0 tx=0x7feeb0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:35.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:35.979+0000 7feeb9600640 1 -- 172.21.15.18:0/3392225090 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feeb4095cd0 con 0x7feebc103a40 2024-09-13T17:02:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.162+0000 7feec1e00640 1 -- 172.21.15.18:0/3392225090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feebc108e10 con 0x7feebc103a40 2024-09-13T17:02:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.772+0000 7feeb9600640 1 -- 172.21.15.18:0/3392225090 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) v1 ==== 169+0+0 (secure 0 0 0) 0x7feeb40992f0 con 0x7feebc103a40 2024-09-13T17:02:36.775 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-13T17:02:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.778+0000 7feec1e00640 1 -- 172.21.15.18:0/3392225090 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feea40a1110 msgr2=0x7feea40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.778+0000 7feec1e00640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feea40a1110 0x7feea40a35d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feebc102bf0 tx=0x7feeb0005f90 comp rx=0 tx=0).stop 2024-09-13T17:02:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.778+0000 7feec1e00640 1 -- 172.21.15.18:0/3392225090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feebc103a40 msgr2=0x7feebc19f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.778+0000 7feec1e00640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feebc103a40 0x7feebc19f480 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009fd0 tx=0x7feeb400b260 comp rx=0 tx=0).stop 2024-09-13T17:02:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.779+0000 7feec1e00640 1 -- 172.21.15.18:0/3392225090 shutdown_connections 2024-09-13T17:02:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.779+0000 7feec1e00640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7feea40a1110 0x7feea40a35d0 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feebc102bf0 tx=0x7feeb0005f90 comp rx=0 tx=0).stop 2024-09-13T17:02:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.779+0000 7feec1e00640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feebc103a40 0x7feebc19f480 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.779+0000 7feec1e00640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feebc103080 0x7feebc198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.779+0000 7feec1e00640 1 --2- 172.21.15.18:0/3392225090 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feebc101ea0 0x7feebc197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.779+0000 7feec1e00640 1 -- 172.21.15.18:0/3392225090 >> 172.21.15.18:0/3392225090 conn(0x7feebc0fd670 msgr2=0x7feebc106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:36.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.781+0000 7feec1e00640 1 -- 172.21.15.18:0/3392225090 shutdown_connections 2024-09-13T17:02:36.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.781+0000 7feec1e00640 1 -- 172.21.15.18:0/3392225090 wait complete. 2024-09-13T17:02:36.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T17:02:36.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.990+0000 7f3fa2200640 1 -- 172.21.15.18:0/701429648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9c1030f0 msgr2=0x7f3f9c103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:36.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.990+0000 7f3fa2200640 1 --2- 172.21.15.18:0/701429648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9c1030f0 0x7f3f9c103570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009900 tx=0x7f3f8402a410 comp rx=0 tx=0).stop 2024-09-13T17:02:36.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.991+0000 7f3fa2200640 1 -- 172.21.15.18:0/701429648 shutdown_connections 2024-09-13T17:02:36.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.991+0000 7f3fa2200640 1 --2- 172.21.15.18:0/701429648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9c1030f0 0x7f3f9c103570 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.991+0000 7f3fa2200640 1 --2- 172.21.15.18:0/701429648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f9c103ab0 0x7f3f9c10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.991+0000 7f3fa2200640 1 --2- 172.21.15.18:0/701429648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f9c101f20 0x7f3f9c102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.991+0000 7f3fa2200640 1 -- 172.21.15.18:0/701429648 >> 172.21.15.18:0/701429648 conn(0x7f3f9c0fd6f0 msgr2=0x7f3f9c0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:36.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.992+0000 7f3fa2200640 1 -- 172.21.15.18:0/701429648 shutdown_connections 2024-09-13T17:02:36.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.992+0000 7f3fa2200640 1 -- 172.21.15.18:0/701429648 wait complete. 2024-09-13T17:02:36.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.994+0000 7f3fa2200640 1 Processor -- start 2024-09-13T17:02:36.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.994+0000 7f3fa2200640 1 -- start start 2024-09-13T17:02:36.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.994+0000 7f3fa2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f9c101f20 0x7f3f9c078260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:36.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.994+0000 7f3fa2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9c1030f0 0x7f3f9c0787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:36.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.995+0000 7f3fa2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f9c103ab0 0x7f3f9c074dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:36.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.995+0000 7f3fa2200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c075560 con 0x7f3f9c1030f0 2024-09-13T17:02:36.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.995+0000 7f3fa2200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0756d0 con 0x7f3f9c101f20 2024-09-13T17:02:36.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.995+0000 7f3fa2200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c075890 con 0x7f3f9c103ab0 2024-09-13T17:02:36.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.995+0000 7f3f9be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f9c103ab0 0x7f3f9c074dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:36.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.995+0000 7f3f9be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f9c103ab0 0x7f3f9c074dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.18:51386/0 (socket says 172.21.15.18:51386) 2024-09-13T17:02:36.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.995+0000 7f3f9be00640 1 -- 172.21.15.18:0/1327435939 learned_addr learned my addr 172.21.15.18:0/1327435939 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T17:02:36.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.995+0000 7f3f9b400640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f9c101f20 0x7f3f9c078260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:36.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.995+0000 7f3f93e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9c1030f0 0x7f3f9c0787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:36.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.996+0000 7f3f9be00640 1 -- 172.21.15.18:0/1327435939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f9c101f20 msgr2=0x7f3f9c078260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:36.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.996+0000 7f3f9be00640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f9c101f20 0x7f3f9c078260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.996+0000 7f3f9be00640 1 -- 172.21.15.18:0/1327435939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9c1030f0 msgr2=0x7f3f9c0787a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:36.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.996+0000 7f3f9be00640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9c1030f0 0x7f3f9c0787a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:37.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.996+0000 7f3f9be00640 1 -- 172.21.15.18:0/1327435939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84009560 con 0x7f3f9c103ab0 2024-09-13T17:02:37.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.996+0000 7f3f9be00640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f9c103ab0 0x7f3f9c074dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400eb10 tx=0x7f3f9400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:37.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.997+0000 7f3f98c00640 1 -- 172.21.15.18:0/1327435939 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94004b20 con 0x7f3f9c103ab0 2024-09-13T17:02:37.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.997+0000 7f3f98c00640 1 -- 172.21.15.18:0/1327435939 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f94004c80 con 0x7f3f9c103ab0 2024-09-13T17:02:37.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.997+0000 7f3f98c00640 1 -- 172.21.15.18:0/1327435939 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94010690 con 0x7f3f9c103ab0 2024-09-13T17:02:37.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.997+0000 7f3fa2200640 1 -- 172.21.15.18:0/1327435939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c1a44e0 con 0x7f3f9c103ab0 2024-09-13T17:02:37.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.997+0000 7f3fa2200640 1 -- 172.21.15.18:0/1327435939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c1a4970 con 0x7f3f9c103ab0 2024-09-13T17:02:37.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:36.998+0000 7f3fa2200640 1 -- 172.21.15.18:0/1327435939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c109440 con 0x7f3f9c103ab0 2024-09-13T17:02:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.003+0000 7f3f98c00640 1 -- 172.21.15.18:0/1327435939 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3f940107f0 con 0x7f3f9c103ab0 2024-09-13T17:02:37.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.005+0000 7f3f98c00640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f800a1190 0x7f3f800a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:37.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.005+0000 7f3f98c00640 1 -- 172.21.15.18:0/1327435939 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8252+0+0 (secure 0 0 0) 0x7f3f94014070 con 0x7f3f9c103ab0 2024-09-13T17:02:37.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.005+0000 7f3f9b400640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f800a1190 0x7f3f800a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:37.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.006+0000 7f3f98c00640 1 -- 172.21.15.18:0/1327435939 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3f940cd450 con 0x7f3f9c103ab0 2024-09-13T17:02:37.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.006+0000 7f3f9b400640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f800a1190 0x7f3f800a3650 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c101c40 tx=0x7f3f8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:37.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:36 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:02:37.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:36 smithi144 ceph-mon[35328]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T17:02:37.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:36 smithi144 ceph-mon[35328]: pgmap v698: 97 pgs: 97 active+clean; 577 KiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:02:37.022 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:36 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3392225090' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:37.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:36 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:02:37.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:36 smithi094 ceph-mon[35259]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T17:02:37.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:36 smithi094 ceph-mon[35259]: pgmap v698: 97 pgs: 97 active+clean; 577 KiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:02:37.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:36 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3392225090' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:37.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.191+0000 7f3fa2200640 1 -- 172.21.15.18:0/1327435939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3f9c102300 con 0x7f3f9c103ab0 2024-09-13T17:02:37.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:36 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:02:37.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:36 smithi018 ceph-mon[30981]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T17:02:37.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:36 smithi018 ceph-mon[30981]: pgmap v698: 97 pgs: 97 active+clean; 577 KiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:02:37.209 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:36 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3392225090' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:37.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.773+0000 7f3f98c00640 1 -- 172.21.15.18:0/1327435939 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v98) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3f940969e0 con 0x7f3f9c103ab0 2024-09-13T17:02:37.776 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' removed 2024-09-13T17:02:37.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.777+0000 7f3fa2200640 1 -- 172.21.15.18:0/1327435939 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f800a1190 msgr2=0x7f3f800a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:37.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.777+0000 7f3fa2200640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f800a1190 0x7f3f800a3650 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c101c40 tx=0x7f3f8c005f90 comp rx=0 tx=0).stop 2024-09-13T17:02:37.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.777+0000 7f3fa2200640 1 -- 172.21.15.18:0/1327435939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f9c103ab0 msgr2=0x7f3f9c074dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:37.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.777+0000 7f3fa2200640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f9c103ab0 0x7f3f9c074dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400eb10 tx=0x7f3f9400c2d0 comp rx=0 tx=0).stop 2024-09-13T17:02:37.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.777+0000 7f3fa2200640 1 -- 172.21.15.18:0/1327435939 shutdown_connections 2024-09-13T17:02:37.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.777+0000 7f3fa2200640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.18:6800/687548857,v1:172.21.15.18:6801/687548857] conn(0x7f3f800a1190 0x7f3f800a3650 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c101c40 tx=0x7f3f8c005f90 comp rx=0 tx=0).stop 2024-09-13T17:02:37.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.777+0000 7f3fa2200640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9c1030f0 0x7f3f9c0787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:37.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.777+0000 7f3fa2200640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f9c103ab0 0x7f3f9c074dd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:37.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.777+0000 7f3fa2200640 1 --2- 172.21.15.18:0/1327435939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f9c101f20 0x7f3f9c078260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:37.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.777+0000 7f3fa2200640 1 -- 172.21.15.18:0/1327435939 >> 172.21.15.18:0/1327435939 conn(0x7f3f9c0fd6f0 msgr2=0x7f3f9c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:37.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.779+0000 7f3fa2200640 1 -- 172.21.15.18:0/1327435939 shutdown_connections 2024-09-13T17:02:37.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T17:02:37.779+0000 7f3fa2200640 1 -- 172.21.15.18:0/1327435939 wait complete. 2024-09-13T17:02:37.810 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:02:37.874 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:02:37.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:02:37.947 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T17:02:37.948 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T17:02:37.983 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T17:02:38.004 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T17:02:38.020 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T17:02:38.021 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-13T17:02:38.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.a 2024-09-13T17:02:38.071 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:37 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/3392225090' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:02:38.071 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:37 smithi018 ceph-mon[30981]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T17:02:38.071 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:37 smithi018 ceph-mon[30981]: from='client.? 172.21.15.18:0/1327435939' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:38.071 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:37 smithi018 ceph-mon[30981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:37 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/3392225090' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:02:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:37 smithi094 ceph-mon[35259]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T17:02:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:37 smithi094 ceph-mon[35259]: from='client.? 172.21.15.18:0/1327435939' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:38.162 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:37 smithi094 ceph-mon[35259]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:38.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:37 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/3392225090' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:02:38.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:37 smithi144 ceph-mon[35328]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T17:02:38.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:37 smithi144 ceph-mon[35328]: from='client.? 172.21.15.18:0/1327435939' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:38.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:37 smithi144 ceph-mon[35328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:02:38.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:38 smithi018 systemd[1]: Stopping Ceph mon.a for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:02:38.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a[30977]: 2024-09-13T17:02:38.557+0000 7fd439800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:02:38.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a[30977]: 2024-09-13T17:02:38.557+0000 7fd439800640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T17:02:38.960 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:38 smithi018 podman[92214]: 2024-09-13 17:02:38.785495941 +0000 UTC m=+0.356531722 container died c24cf9be08e7bcf6005ae438f1ec5511125340a6bac1982c80134f412545839e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T17:02:39.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:39 smithi018 podman[92214]: 2024-09-13 17:02:39.280981649 +0000 UTC m=+0.852017430 container cleanup c24cf9be08e7bcf6005ae438f1ec5511125340a6bac1982c80134f412545839e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:02:39.460 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 13 17:02:39 smithi018 bash[92214]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-a 2024-09-13T17:02:39.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.a.service' 2024-09-13T17:02:39.896 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:02:39.896 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-13T17:02:39.897 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-13T17:02:39.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.b 2024-09-13T17:02:40.236 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:39 smithi094 systemd[1]: Stopping Ceph mon.b for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:02:40.620 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:40 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-b[35255]: 2024-09-13T17:02:40.233+0000 7f54ac480640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:02:40.620 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:40 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-b[35255]: 2024-09-13T17:02:40.233+0000 7f54ac480640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-13T17:02:40.620 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:40 smithi094 podman[69409]: 2024-09-13 17:02:40.295650269 +0000 UTC m=+0.186150520 container died 4f855e9daba1bd8b914b4b64afccee6053feefbb3fa8a71e25c7dba1cf36907b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T17:02:40.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:40 smithi094 podman[69409]: 2024-09-13 17:02:40.726913857 +0000 UTC m=+0.617414106 container cleanup 4f855e9daba1bd8b914b4b64afccee6053feefbb3fa8a71e25c7dba1cf36907b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T17:02:40.912 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:40 smithi094 bash[69409]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-b 2024-09-13T17:02:41.226 INFO:journalctl@ceph.mon.b.smithi094.stdout:Sep 13 17:02:40 smithi094 podman[69461]: 2024-09-13 17:02:40.970572566 +0000 UTC m=+0.667124752 container remove 4f855e9daba1bd8b914b4b64afccee6053feefbb3fa8a71e25c7dba1cf36907b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:02:41.243 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.b.service' 2024-09-13T17:02:41.297 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:02:41.298 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-13T17:02:41.298 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-13T17:02:41.298 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.c 2024-09-13T17:02:41.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:41 smithi144 systemd[1]: Stopping Ceph mon.c for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:02:42.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:41 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-c[35324]: 2024-09-13T17:02:41.801+0000 7f3c92b82640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:02:42.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:41 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-c[35324]: 2024-09-13T17:02:41.801+0000 7f3c92b82640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T17:02:42.272 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:41 smithi144 podman[71066]: 2024-09-13 17:02:41.995797398 +0000 UTC m=+0.487506487 container died da44f522e1a79e20be834a9aea278e68654803e09668a7a11a1e16e4fabe4597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T17:02:42.588 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:42 smithi144 podman[71066]: 2024-09-13 17:02:42.386183258 +0000 UTC m=+0.877892388 container cleanup da44f522e1a79e20be834a9aea278e68654803e09668a7a11a1e16e4fabe4597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-c, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T17:02:42.589 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 13 17:02:42 smithi144 bash[71066]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mon-c 2024-09-13T17:02:42.808 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mon.c.service' 2024-09-13T17:02:42.860 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:02:42.860 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-13T17:02:42.860 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-13T17:02:42.860 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.x 2024-09-13T17:02:43.209 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 17:02:42 smithi018 systemd[1]: Stopping Ceph mgr.x for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:02:43.710 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 17:02:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T17:02:43.314+0000 7f3573400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:02:43.710 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 17:02:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x[31205]: 2024-09-13T17:02:43.314+0000 7f3573400640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-13T17:02:43.710 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 17:02:43 smithi018 podman[92419]: 2024-09-13 17:02:43.398291817 +0000 UTC m=+0.250057328 container died 51593b5170330b9888f9de3027413f6411bc2030ed57b9210022d6460d3d991f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T17:02:44.209 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 17:02:43 smithi018 podman[92419]: 2024-09-13 17:02:43.945058643 +0000 UTC m=+0.796824146 container cleanup 51593b5170330b9888f9de3027413f6411bc2030ed57b9210022d6460d3d991f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD) 2024-09-13T17:02:44.210 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 17:02:43 smithi018 bash[92419]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x 2024-09-13T17:02:44.504 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 17:02:44 smithi018 podman[92433]: 2024-09-13 17:02:44.238950449 +0000 UTC m=+0.821946120 container remove 51593b5170330b9888f9de3027413f6411bc2030ed57b9210022d6460d3d991f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2) 2024-09-13T17:02:44.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-13T17:02:44.538 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 17:02:44 smithi018 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-13T17:02:44.538 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 17:02:44 smithi018 systemd[1]: Stopped Ceph mgr.x for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T17:02:44.539 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 13 17:02:44 smithi018 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.x.service: Consumed 53.399s CPU time. 2024-09-13T17:02:44.609 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:02:44.609 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-13T17:02:44.609 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-13T17:02:44.609 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.y 2024-09-13T17:02:44.912 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 17:02:44 smithi094 systemd[1]: Stopping Ceph mgr.y for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:02:45.288 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 17:02:44 smithi094 podman[69878]: 2024-09-13 17:02:44.957206254 +0000 UTC m=+0.137439525 container died a380fa1b64e8fcd6731636dd7b9fda797551ce7278bb648a6491e635f4d970f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-13T17:02:45.662 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 17:02:45 smithi094 podman[69878]: 2024-09-13 17:02:45.412085772 +0000 UTC m=+0.592319046 container cleanup a380fa1b64e8fcd6731636dd7b9fda797551ce7278bb648a6491e635f4d970f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T17:02:45.662 INFO:journalctl@ceph.mgr.y.smithi094.stdout:Sep 13 17:02:45 smithi094 bash[69878]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-y 2024-09-13T17:02:45.887 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-13T17:02:45.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:02:45.925 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-13T17:02:45.925 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-13T17:02:45.925 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.z 2024-09-13T17:02:46.254 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 17:02:45 smithi144 systemd[1]: Stopping Ceph mgr.z for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:02:46.521 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 17:02:46 smithi144 podman[71256]: 2024-09-13 17:02:46.253801259 +0000 UTC m=+0.138151693 container died 2ba1af3953b952bec8e09d92b6e97a4e6dea2fe250ea6d005e8643da3dfdb120 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T17:02:46.928 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 17:02:46 smithi144 podman[71256]: 2024-09-13 17:02:46.608310155 +0000 UTC m=+0.492660588 container cleanup 2ba1af3953b952bec8e09d92b6e97a4e6dea2fe250ea6d005e8643da3dfdb120 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T17:02:46.928 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 17:02:46 smithi144 bash[71256]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z 2024-09-13T17:02:47.178 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-13T17:02:47.200 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 17:02:46 smithi144 podman[71268]: 2024-09-13 17:02:46.926942098 +0000 UTC m=+0.669307382 container remove 2ba1af3953b952bec8e09d92b6e97a4e6dea2fe250ea6d005e8643da3dfdb120 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T17:02:47.200 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 17:02:46 smithi144 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-13T17:02:47.200 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 17:02:47 smithi144 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-13T17:02:47.200 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 17:02:47 smithi144 systemd[1]: Stopped Ceph mgr.z for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T17:02:47.200 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 13 17:02:47 smithi144 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mgr.z.service: Consumed 6.550s CPU time. 2024-09-13T17:02:47.213 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:02:47.213 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-13T17:02:47.214 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T17:02:47.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.0 2024-09-13T17:02:47.654 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:47 smithi018 systemd[1]: Stopping Ceph osd.0 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:02:47.959 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0[45141]: 2024-09-13T17:02:47.651+0000 7fe400e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:02:47.960 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0[45141]: 2024-09-13T17:02:47.651+0000 7fe400e00640 -1 osd.0 98 *** Got signal Terminated *** 2024-09-13T17:02:47.960 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0[45141]: 2024-09-13T17:02:47.651+0000 7fe400e00640 -1 osd.0 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:02:53.548 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:53 smithi018 podman[92542]: 2024-09-13 17:02:53.296467981 +0000 UTC m=+5.779111920 container died c958668414af792d4946a5230eb8ac6521777db0ff2d2ae9cb6fbdc673fe470b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T17:02:53.802 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:53 smithi018 podman[92542]: 2024-09-13 17:02:53.783134377 +0000 UTC m=+6.265778323 container cleanup c958668414af792d4946a5230eb8ac6521777db0ff2d2ae9cb6fbdc673fe470b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD) 2024-09-13T17:02:53.802 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:53 smithi018 bash[92542]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0 2024-09-13T17:02:54.460 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:54 smithi018 podman[92561]: 2024-09-13 17:02:54.151544708 +0000 UTC m=+0.836536609 container remove c958668414af792d4946a5230eb8ac6521777db0ff2d2ae9cb6fbdc673fe470b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-13T17:02:55.089 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:54 smithi018 podman[92661]: 2024-09-13 17:02:54.663175402 +0000 UTC m=+0.039634070 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:02:55.090 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:54 smithi018 podman[92661]: 2024-09-13 17:02:54.827406781 +0000 UTC m=+0.203865439 container create 486b78ee6ebfc405aed9219bed312cf883335450e3d4a3d46780534a590d9f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-13T17:02:55.090 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:55 smithi018 podman[92661]: 2024-09-13 17:02:55.088821084 +0000 UTC m=+0.465279755 container init 486b78ee6ebfc405aed9219bed312cf883335450e3d4a3d46780534a590d9f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T17:02:55.457 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:55 smithi018 podman[92661]: 2024-09-13 17:02:55.096110575 +0000 UTC m=+0.472569243 container start 486b78ee6ebfc405aed9219bed312cf883335450e3d4a3d46780534a590d9f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T17:02:55.457 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:55 smithi018 podman[92661]: 2024-09-13 17:02:55.230709076 +0000 UTC m=+0.607167745 container attach 486b78ee6ebfc405aed9219bed312cf883335450e3d4a3d46780534a590d9f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T17:02:55.710 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 13 17:02:55 smithi018 podman[92661]: 2024-09-13 17:02:55.457140087 +0000 UTC m=+0.833598764 container died 486b78ee6ebfc405aed9219bed312cf883335450e3d4a3d46780534a590d9f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T17:02:56.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T17:02:56.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:02:56.617 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T17:02:56.618 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T17:02:56.618 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.1 2024-09-13T17:02:56.912 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:02:56 smithi094 systemd[1]: Stopping Ceph osd.1 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:02:57.412 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:02:56 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1[39769]: 2024-09-13T17:02:56.941+0000 7fbb37c8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:02:57.412 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:02:56 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1[39769]: 2024-09-13T17:02:56.941+0000 7fbb37c8d640 -1 osd.1 98 *** Got signal Terminated *** 2024-09-13T17:02:57.412 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:02:56 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1[39769]: 2024-09-13T17:02:56.941+0000 7fbb37c8d640 -1 osd.1 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:03:02.662 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:03:02 smithi094 podman[69999]: 2024-09-13 17:03:02.387328077 +0000 UTC m=+5.571203426 container died a6beed9d9d2698cdf0d77cdb6907f091b576752cca7beb45038065f8d45e67d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T17:03:03.162 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:03:02 smithi094 podman[69999]: 2024-09-13 17:03:02.833817398 +0000 UTC m=+6.017692747 container cleanup a6beed9d9d2698cdf0d77cdb6907f091b576752cca7beb45038065f8d45e67d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T17:03:03.162 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:03:02 smithi094 bash[69999]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1 2024-09-13T17:03:03.508 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:03:03 smithi094 podman[70016]: 2024-09-13 17:03:03.168239321 +0000 UTC m=+0.777926789 container remove a6beed9d9d2698cdf0d77cdb6907f091b576752cca7beb45038065f8d45e67d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T17:03:03.759 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:03:03 smithi094 podman[70103]: 2024-09-13 17:03:03.411006767 +0000 UTC m=+0.024705283 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:03:03.759 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:03:03 smithi094 podman[70103]: 2024-09-13 17:03:03.519167712 +0000 UTC m=+0.132866226 container create 092f12d9ee33b54b120453a4ca8bd31a2f7caa2dd10006ae0d9f2fb51f3ba164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T17:03:03.759 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:03:03 smithi094 podman[70103]: 2024-09-13 17:03:03.755122139 +0000 UTC m=+0.368820654 container init 092f12d9ee33b54b120453a4ca8bd31a2f7caa2dd10006ae0d9f2fb51f3ba164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-13T17:03:03.759 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:03:03 smithi094 podman[70103]: 2024-09-13 17:03:03.758393782 +0000 UTC m=+0.372092298 container start 092f12d9ee33b54b120453a4ca8bd31a2f7caa2dd10006ae0d9f2fb51f3ba164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-13T17:03:04.019 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:03:03 smithi094 podman[70103]: 2024-09-13 17:03:03.855082744 +0000 UTC m=+0.468781279 container attach 092f12d9ee33b54b120453a4ca8bd31a2f7caa2dd10006ae0d9f2fb51f3ba164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T17:03:04.393 INFO:journalctl@ceph.osd.1.smithi094.stdout:Sep 13 17:03:04 smithi094 podman[70126]: 2024-09-13 17:03:04.020676143 +0000 UTC m=+0.016970626 container died 092f12d9ee33b54b120453a4ca8bd31a2f7caa2dd10006ae0d9f2fb51f3ba164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:03:04.725 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T17:03:04.764 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:03:04.765 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T17:03:04.765 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T17:03:04.765 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.2 2024-09-13T17:03:05.080 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:04 smithi144 systemd[1]: Stopping Ceph osd.2 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:03:05.521 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:05 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2[40517]: 2024-09-13T17:03:05.078+0000 7f105f703640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:03:05.521 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:05 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2[40517]: 2024-09-13T17:03:05.078+0000 7f105f703640 -1 osd.2 98 *** Got signal Terminated *** 2024-09-13T17:03:05.522 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:05 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2[40517]: 2024-09-13T17:03:05.078+0000 7f105f703640 -1 osd.2 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:03:10.873 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:10 smithi144 podman[71381]: 2024-09-13 17:03:10.56200372 +0000 UTC m=+5.599860764 container died a33436fa157dfb8ca8657490c0bfd38d4829dd9d6c8f51d3db23c3c0ff7a3ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T17:03:11.206 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:10 smithi144 podman[71381]: 2024-09-13 17:03:10.962255133 +0000 UTC m=+6.000112167 container cleanup a33436fa157dfb8ca8657490c0bfd38d4829dd9d6c8f51d3db23c3c0ff7a3ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T17:03:11.207 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:10 smithi144 bash[71381]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2 2024-09-13T17:03:11.521 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:11 smithi144 podman[71408]: 2024-09-13 17:03:11.205553903 +0000 UTC m=+0.639402197 container remove a33436fa157dfb8ca8657490c0bfd38d4829dd9d6c8f51d3db23c3c0ff7a3ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T17:03:11.885 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:11 smithi144 podman[71496]: 2024-09-13 17:03:11.441181751 +0000 UTC m=+0.016158425 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:03:11.885 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:11 smithi144 podman[71496]: 2024-09-13 17:03:11.548260731 +0000 UTC m=+0.123237399 container create a3fab788a3d6ee02819e889397f6be015b155f54ebe0669a955538aa4dd55b1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-13T17:03:11.885 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:11 smithi144 podman[71496]: 2024-09-13 17:03:11.784339694 +0000 UTC m=+0.359316377 container init a3fab788a3d6ee02819e889397f6be015b155f54ebe0669a955538aa4dd55b1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T17:03:11.885 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:11 smithi144 podman[71496]: 2024-09-13 17:03:11.78799431 +0000 UTC m=+0.362970988 container start a3fab788a3d6ee02819e889397f6be015b155f54ebe0669a955538aa4dd55b1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T17:03:11.885 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:11 smithi144 podman[71496]: 2024-09-13 17:03:11.884179065 +0000 UTC m=+0.459155754 container attach a3fab788a3d6ee02819e889397f6be015b155f54ebe0669a955538aa4dd55b1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T17:03:12.271 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 13 17:03:11 smithi144 podman[71496]: 2024-09-13 17:03:11.976971446 +0000 UTC m=+0.551948114 container died a3fab788a3d6ee02819e889397f6be015b155f54ebe0669a955538aa4dd55b1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:03:12.645 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T17:03:12.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:03:12.687 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T17:03:12.688 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T17:03:12.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.3 2024-09-13T17:03:13.108 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:12 smithi018 systemd[1]: Stopping Ceph osd.3 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:03:13.459 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:13 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3[51870]: 2024-09-13T17:03:13.106+0000 7f5005200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:03:13.460 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:13 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3[51870]: 2024-09-13T17:03:13.106+0000 7f5005200640 -1 osd.3 98 *** Got signal Terminated *** 2024-09-13T17:03:13.460 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:13 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3[51870]: 2024-09-13T17:03:13.106+0000 7f5005200640 -1 osd.3 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:03:13.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:13 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:13.615+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:14.459 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:13 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3[51870]: 2024-09-13T17:03:13.959+0000 7f4ffbc00640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.545200+0000 front 2024-09-13T17:02:47.545324+0000 (oldest deadline 2024-09-13T17:03:13.445462+0000) 2024-09-13T17:03:14.957 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:14.584+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:15.209 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:14 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3[51870]: 2024-09-13T17:03:14.955+0000 7f4ffbc00640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.545200+0000 front 2024-09-13T17:02:47.545324+0000 (oldest deadline 2024-09-13T17:03:13.445462+0000) 2024-09-13T17:03:15.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:15 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:15.401+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:15.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:15 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:15.553+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:16.461 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:15 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3[51870]: 2024-09-13T17:03:15.960+0000 7f4ffbc00640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.545200+0000 front 2024-09-13T17:02:47.545324+0000 (oldest deadline 2024-09-13T17:03:13.445462+0000) 2024-09-13T17:03:16.771 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:16 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:16.473+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:16.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:16 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:16.375+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:16.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:16 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:16.572+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:17.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:17.004+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:17.459 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:16 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3[51870]: 2024-09-13T17:03:16.960+0000 7f4ffbc00640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.545200+0000 front 2024-09-13T17:02:47.545324+0000 (oldest deadline 2024-09-13T17:03:13.445462+0000) 2024-09-13T17:03:17.771 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:17.506+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:17.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:17.338+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:17.917 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:17 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:17.604+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:18.209 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:17 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3[51870]: 2024-09-13T17:03:17.916+0000 7f4ffbc00640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.545200+0000 front 2024-09-13T17:02:47.545324+0000 (oldest deadline 2024-09-13T17:03:13.445462+0000) 2024-09-13T17:03:18.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:17.967+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:18.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:18 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:18.529+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:18.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:18 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:18.375+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:18.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:18 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:18.434+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:18.957 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:18 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:18.607+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:18.958 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:18 smithi018 podman[92763]: 2024-09-13 17:03:18.597771477 +0000 UTC m=+5.619213375 container stop abc06007ca4f513431cda5f0496574adcff1368edfaa623549fc3d83ba175af3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:03:18.958 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:18 smithi018 podman[92763]: 2024-09-13 17:03:18.637680706 +0000 UTC m=+5.659122604 container died abc06007ca4f513431cda5f0496574adcff1368edfaa623549fc3d83ba175af3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T17:03:19.209 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:19 smithi018 podman[92763]: 2024-09-13 17:03:19.11994613 +0000 UTC m=+6.141388034 container cleanup abc06007ca4f513431cda5f0496574adcff1368edfaa623549fc3d83ba175af3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T17:03:19.210 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:19 smithi018 bash[92763]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3 2024-09-13T17:03:19.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:18 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:18.956+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:19.771 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:19.535+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:19.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:19.388+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:19.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:19 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:19.434+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:19.959 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:19 smithi018 podman[92778]: 2024-09-13 17:03:19.496440401 +0000 UTC m=+0.882127925 container remove abc06007ca4f513431cda5f0496574adcff1368edfaa623549fc3d83ba175af3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T17:03:19.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:19 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:19.610+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:20.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:19.977+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:20.392 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:20 smithi018 podman[92866]: 2024-09-13 17:03:19.994803423 +0000 UTC m=+0.027455526 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:03:20.392 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:20 smithi018 podman[92866]: 2024-09-13 17:03:20.113770326 +0000 UTC m=+0.146422428 container create f1a66580086830c08fc0814d8463209dfd4c8c3b2eff38a70229414a496db667 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T17:03:20.654 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:20 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:20.584+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:20.654 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:20 smithi018 podman[92866]: 2024-09-13 17:03:20.391428392 +0000 UTC m=+0.424080494 container init f1a66580086830c08fc0814d8463209dfd4c8c3b2eff38a70229414a496db667 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD) 2024-09-13T17:03:20.654 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:20 smithi018 podman[92866]: 2024-09-13 17:03:20.398757868 +0000 UTC m=+0.431409979 container start f1a66580086830c08fc0814d8463209dfd4c8c3b2eff38a70229414a496db667 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T17:03:20.654 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:20 smithi018 podman[92866]: 2024-09-13 17:03:20.499540452 +0000 UTC m=+0.532192576 container attach f1a66580086830c08fc0814d8463209dfd4c8c3b2eff38a70229414a496db667 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T17:03:20.771 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:20 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:20.517+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:20.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:20 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:20.403+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:20.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:20 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:20.414+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:20.959 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 13 17:03:20 smithi018 podman[92866]: 2024-09-13 17:03:20.653548099 +0000 UTC m=+0.686200209 container died f1a66580086830c08fc0814d8463209dfd4c8c3b2eff38a70229414a496db667 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T17:03:21.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:20 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:20.935+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:21.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T17:03:21.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:03:21.611 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T17:03:21.612 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T17:03:21.612 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.4 2024-09-13T17:03:21.771 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:21.530+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:21.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:21.378+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:21.912 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:21 smithi094 systemd[1]: Stopping Ceph osd.4 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:03:21.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:21 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:21.448+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:21.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:21 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:21.602+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:22.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:21.980+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:22.412 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:21 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4[46665]: 2024-09-13T17:03:21.920+0000 7feabcea7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:03:22.412 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:21 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4[46665]: 2024-09-13T17:03:21.920+0000 7feabcea7640 -1 osd.4 98 *** Got signal Terminated *** 2024-09-13T17:03:22.412 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:21 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4[46665]: 2024-09-13T17:03:21.920+0000 7feabcea7640 -1 osd.4 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:03:22.771 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:22.517+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:22.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:22.403+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:22.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:22.403+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:22.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:22 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:22.468+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:22.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:22 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:22.468+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:22.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:22 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:22.647+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:23.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:22.978+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:23.771 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:23.500+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:23.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:23.442+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:23.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:23.442+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:23.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:23 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:23.507+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:23.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:23 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:23.507+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:23.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:23 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:23.653+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:24.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:23.930+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:24.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:24 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:24.450+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:24.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:24 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:24.450+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:24.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:24 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:24.526+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:24.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:24 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:24.526+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:24.888 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:24 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:24.624+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:24.888 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:24 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:24.624+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:24.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:24 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:24.515+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:24.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:24 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:24.515+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:25.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:24 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:24.954+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:25.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:25 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:25.481+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:25.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:25 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:25.481+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:25.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:25 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:25.488+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:25.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:25 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:25.488+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:25.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:25 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:25.523+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:25.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:25 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:25.523+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:25.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:25 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:25.539+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:25.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:25 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:25.636+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:25.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:25 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:25.636+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:26.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:25 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:25.961+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:26.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:25 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:25.961+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:26.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:26 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:26.459+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:26.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:26 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:26.459+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:26.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:26 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:26.472+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:26.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:26 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:26.472+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:26.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:26 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:26.516+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:26.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:26 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:26.511+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:26.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:26 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:26.511+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:26.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:26 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:26.630+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:26.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:26 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:26.630+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:27.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:26 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:26.963+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:27.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:26 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:26.963+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:27.756 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:27 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:27.501+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:27.757 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:27 smithi094 podman[70217]: 2024-09-13 17:03:27.452391585 +0000 UTC m=+5.646497861 container died e1a192258ab1409cf298b8274e872eb480db6cf9fd81ceec237b750219fee5e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T17:03:27.757 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:27 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:27.532+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:27.757 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:27 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:27.532+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:27.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:27.448+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:27.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:27.448+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:27.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:27.480+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:27.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:27.480+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:27.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:27 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:27.643+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:27.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:27 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:27.643+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:28.124 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:27 smithi094 podman[70217]: 2024-09-13 17:03:27.870930113 +0000 UTC m=+6.065036386 container cleanup e1a192258ab1409cf298b8274e872eb480db6cf9fd81ceec237b750219fee5e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T17:03:28.124 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:27 smithi094 bash[70217]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4 2024-09-13T17:03:28.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:27.932+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:28.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:27 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:27.932+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:28.411 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:28 smithi094 podman[70231]: 2024-09-13 17:03:28.122295098 +0000 UTC m=+0.670858002 container remove e1a192258ab1409cf298b8274e872eb480db6cf9fd81ceec237b750219fee5e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-13T17:03:28.627 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:28 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:28.365+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:28.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:28 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:28.431+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:28.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:28 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:28.431+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:28.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:28 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:28.448+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:28.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:28 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:28.448+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:28.785 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:28 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:28.520+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:28.785 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:28 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:28.577+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:28.785 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:28 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:28.577+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:28.786 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:28 smithi094 podman[70322]: 2024-09-13 17:03:28.427131255 +0000 UTC m=+0.015806451 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:03:28.786 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:28 smithi094 podman[70322]: 2024-09-13 17:03:28.539838046 +0000 UTC m=+0.128513229 container create dd60d943dc49094eab4e950675d501270807d066d10d2c05c9f5632326d5ba69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T17:03:28.786 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:28 smithi094 podman[70322]: 2024-09-13 17:03:28.784100316 +0000 UTC m=+0.372775499 container init dd60d943dc49094eab4e950675d501270807d066d10d2c05c9f5632326d5ba69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T17:03:28.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:28 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:28.626+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:28.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:28 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:28.626+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:29.162 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:28 smithi094 podman[70322]: 2024-09-13 17:03:28.787860795 +0000 UTC m=+0.376535981 container start dd60d943dc49094eab4e950675d501270807d066d10d2c05c9f5632326d5ba69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:03:29.162 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:28 smithi094 podman[70322]: 2024-09-13 17:03:28.900694041 +0000 UTC m=+0.489369225 container attach dd60d943dc49094eab4e950675d501270807d066d10d2c05c9f5632326d5ba69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T17:03:29.162 INFO:journalctl@ceph.osd.4.smithi094.stdout:Sep 13 17:03:28 smithi094 podman[70322]: 2024-09-13 17:03:28.970200804 +0000 UTC m=+0.558875998 container died dd60d943dc49094eab4e950675d501270807d066d10d2c05c9f5632326d5ba69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T17:03:29.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:28 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:28.945+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:29.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:28 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:28.945+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:29.641 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:29 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:29.321+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:29.661 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:29 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:29.515+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:29.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:29 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:29.551+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:29.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:29 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:29.551+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:29.686 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T17:03:29.727 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:03:29.727 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T17:03:29.727 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T17:03:29.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.5 2024-09-13T17:03:29.754 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:29 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:29.396+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:29.755 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:29 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:29.396+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:29.755 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:29 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:29.461+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:29.755 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:29 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:29.461+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:29.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:29 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:29.640+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:29.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:29 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:29.640+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:30.022 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:29 smithi144 systemd[1]: Stopping Ceph osd.5 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:03:30.022 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:29 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:29.920+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:30.022 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:29 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:29.920+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:30.368 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:30.047+0000 7f5118f9d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:03:30.368 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:30.047+0000 7f5118f9d640 -1 osd.5 98 *** Got signal Terminated *** 2024-09-13T17:03:30.368 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:30.047+0000 7f5118f9d640 -1 osd.5 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:03:30.709 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:30 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:30.596+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:30.709 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:30 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:30.596+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:30.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:30 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:30.346+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:30.771 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:30.436+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:30.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:30.436+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:30.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:30.367+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:30.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:30.367+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:30.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:30 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:30.547+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:30.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:30 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:30.594+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:30.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:30 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:30.594+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:31.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:30.916+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:31.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:30 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:30.916+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:31.624 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:31.350+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:31.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:31.470+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:31.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:31.470+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:31.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:31.345+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:31.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:31.345+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:31.773 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:31.345+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:31.911 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:31 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:31.538+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:31.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:31 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:31.611+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:31.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:31 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:31.611+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:31.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:31.623+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:31.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:31.623+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:31.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:31 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:31.623+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:32.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:31.964+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:32.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:31 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:31.964+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:32.648 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:32 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:32.395+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:32.771 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:32 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:32.501+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:32.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:32 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:32.501+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:32.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:32 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:32.501+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:07.869772+0000 front 2024-09-13T17:03:07.869854+0000 (oldest deadline 2024-09-13T17:03:31.969889+0000) 2024-09-13T17:03:32.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:32 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:32.392+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:32.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:32 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:32.392+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:32.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:32 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:32.392+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:32.813 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:32.556+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:32.813 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:32.556+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:32.813 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:32.619+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:32.813 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:32 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:32.619+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:32.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:32 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:32.647+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:32.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:32 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:32.647+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:32.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:32 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:32.647+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:33.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:32 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:32.970+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:33.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:32 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:32.970+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:33.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:33.410+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:33.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:33.623+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:33.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:33.623+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:33.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:33.623+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:33.771 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:33.456+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:33.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:33.456+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:33.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:33.456+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:07.869772+0000 front 2024-09-13T17:03:07.869854+0000 (oldest deadline 2024-09-13T17:03:31.969889+0000) 2024-09-13T17:03:33.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:33.380+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:33.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:33.380+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:33.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:33.380+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:33.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:33.581+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:33.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:33.581+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:33.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:33.578+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:33.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:33.578+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:33.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:33 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:33.578+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:34.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:33.962+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:34.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:33 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:33.962+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:34.546 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:34 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:34.479+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:50.367662+0000 front 2024-09-13T17:02:50.367590+0000 (oldest deadline 2024-09-13T17:03:15.667553+0000) 2024-09-13T17:03:34.546 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:34 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:34.479+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.368487+0000 front 2024-09-13T17:03:00.368573+0000 (oldest deadline 2024-09-13T17:03:23.868515+0000) 2024-09-13T17:03:34.546 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:34 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5[47394]: 2024-09-13T17:03:34.479+0000 7f51155b1640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:07.869772+0000 front 2024-09-13T17:03:07.869854+0000 (oldest deadline 2024-09-13T17:03:31.969889+0000) 2024-09-13T17:03:34.546 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:34 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:34.377+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:34.546 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:34 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:34.377+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:34.546 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:34 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:34.377+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:34.709 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:34 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:34.448+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:34.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:34 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:34.448+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.261062+0000 front 2024-09-13T17:03:08.260875+0000 (oldest deadline 2024-09-13T17:03:33.560859+0000) 2024-09-13T17:03:34.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:34 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:34.583+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:34.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:34 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:34.583+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:34.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:34 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:34.583+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:34.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:34 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:34.582+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:34.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:34 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:34.582+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:34.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:34 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:34.529+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:34.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:34 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:34.529+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:34.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:34 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:34.529+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:35.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:35 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:35.010+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:35.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:35 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:35.010+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:35.656 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:35 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:35.356+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:35.656 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:35 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:35.356+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:35.656 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:35 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:35.356+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:35.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:35 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:35.602+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:35.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:35 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:35.602+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:35.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:35 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:35.523+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:35.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:35 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:35.523+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:35.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:35 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:35.523+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:35.959 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:35 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:35.463+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:35.959 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:35 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:35.463+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.261062+0000 front 2024-09-13T17:03:08.260875+0000 (oldest deadline 2024-09-13T17:03:33.560859+0000) 2024-09-13T17:03:35.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:35 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:35.585+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:35.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:35 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:35.585+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:35.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:35 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:35.585+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:36.019 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:35 smithi144 podman[71601]: 2024-09-13 17:03:35.655552609 +0000 UTC m=+5.725686832 container died fca5c24d78eba3ed89bb0cd4ae24442041a02751967bfa4fe093862010680a2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-13T17:03:36.271 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:36 smithi144 podman[71601]: 2024-09-13 17:03:36.115224564 +0000 UTC m=+6.185358787 container cleanup fca5c24d78eba3ed89bb0cd4ae24442041a02751967bfa4fe093862010680a2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T17:03:36.272 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:36 smithi144 bash[71601]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5 2024-09-13T17:03:36.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:36 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:36.018+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:36.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:36 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:36.018+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:36.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:36 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:36.018+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:36.709 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:36 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:36.440+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:36.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:36 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:36.440+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.261062+0000 front 2024-09-13T17:03:08.260875+0000 (oldest deadline 2024-09-13T17:03:33.560859+0000) 2024-09-13T17:03:36.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:36 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:36.599+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:36.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:36 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:36.599+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:36.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:36 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:36.599+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:36.772 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:36 smithi144 podman[71629]: 2024-09-13 17:03:36.466695829 +0000 UTC m=+0.809698789 container remove fca5c24d78eba3ed89bb0cd4ae24442041a02751967bfa4fe093862010680a2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:03:36.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:36 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:36.352+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:36.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:36 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:36.352+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:36.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:36 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:36.352+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:36.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:36 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:36.586+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:36.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:36 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:36.586+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:36.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:36 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:36.532+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:36.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:36 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:36.532+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:36.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:36 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:36.532+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:37.053 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:36 smithi144 podman[71717]: 2024-09-13 17:03:36.681991663 +0000 UTC m=+0.016245206 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:03:37.054 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:36 smithi144 podman[71717]: 2024-09-13 17:03:36.792721805 +0000 UTC m=+0.126975349 container create ac88ec539310b3182c4ceed8375dc859c6a41c96f9bca5c8f4d866ece1b2a05a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-13T17:03:37.359 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:37 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:37.051+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:37.359 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:37 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:37.051+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:37.360 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:37 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:37.051+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:37.360 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:37 smithi144 podman[71717]: 2024-09-13 17:03:37.061909132 +0000 UTC m=+0.396162675 container init ac88ec539310b3182c4ceed8375dc859c6a41c96f9bca5c8f4d866ece1b2a05a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:03:37.360 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:37 smithi144 podman[71717]: 2024-09-13 17:03:37.065140529 +0000 UTC m=+0.399394072 container start ac88ec539310b3182c4ceed8375dc859c6a41c96f9bca5c8f4d866ece1b2a05a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T17:03:37.360 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:37 smithi144 podman[71717]: 2024-09-13 17:03:37.162019049 +0000 UTC m=+0.496272592 container attach ac88ec539310b3182c4ceed8375dc859c6a41c96f9bca5c8f4d866ece1b2a05a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-13T17:03:37.360 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 13 17:03:37 smithi144 podman[71717]: 2024-09-13 17:03:37.24840577 +0000 UTC m=+0.582659314 container died ac88ec539310b3182c4ceed8375dc859c6a41c96f9bca5c8f4d866ece1b2a05a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:03:37.709 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:37 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:37.444+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:37.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:37 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:37.444+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.261062+0000 front 2024-09-13T17:03:08.260875+0000 (oldest deadline 2024-09-13T17:03:33.560859+0000) 2024-09-13T17:03:37.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:37 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:37.640+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:37.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:37 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:37.640+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:37.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:37 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:37.640+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:37.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:37 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:37.358+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:37.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:37 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:37.358+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:37.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:37 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:37.358+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:37.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:37 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:37.550+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:37.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:37 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:37.550+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:37.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:37 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:37.501+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:37.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:37 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:37.501+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:37.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:37 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:37.501+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:37.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T17:03:38.016 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:03:38.017 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T17:03:38.017 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-13T17:03:38.017 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.6 2024-09-13T17:03:38.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:38 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:38.049+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:38.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:38 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:38.049+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:38.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:38 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:38.049+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:38.443 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:38 smithi018 systemd[1]: Stopping Ceph osd.6 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:03:38.443 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:38.441+0000 7fedf3600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:03:38.443 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:38.442+0000 7fedf3600640 -1 osd.6 98 *** Got signal Terminated *** 2024-09-13T17:03:38.443 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:38.442+0000 7fedf3600640 -1 osd.6 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:03:38.709 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:38.488+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:38.709 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:38.488+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.261062+0000 front 2024-09-13T17:03:08.260875+0000 (oldest deadline 2024-09-13T17:03:33.560859+0000) 2024-09-13T17:03:38.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:38.672+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:38.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:38.672+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:38.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:38 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:38.672+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:38.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:38 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:38.404+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:38.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:38 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:38.404+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:38.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:38 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:38.404+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:38.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:38 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:38.543+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:38.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:38 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:38.543+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:38.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:38 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:38.537+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:38.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:38 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:38.537+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:38.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:38 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:38.537+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:39.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:39.011+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:39.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:39.011+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:39.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:39.011+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:39.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:39.011+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:39.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:39.416+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:39.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:39.416+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:39.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:39.416+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:39.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:39 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:39.552+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:39.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:39 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:39.552+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:39.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:39 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:39.555+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:39.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:39 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:39.555+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:39.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:39 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:39.555+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:39.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:39.638+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:39.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:39.638+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:39.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:39.638+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:39.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:39.638+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:39.960 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:39.477+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:39.960 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:39.477+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.261062+0000 front 2024-09-13T17:03:08.260875+0000 (oldest deadline 2024-09-13T17:03:33.560859+0000) 2024-09-13T17:03:39.960 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:39.477+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:16.962910+0000 front 2024-09-13T17:03:16.963012+0000 (oldest deadline 2024-09-13T17:03:38.663179+0000) 2024-09-13T17:03:40.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:39.976+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:40.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:39.976+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:40.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:39.976+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:40.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:39 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:39.976+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:40.709 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:40 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:40.438+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:40.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:40 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:40.438+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.261062+0000 front 2024-09-13T17:03:08.260875+0000 (oldest deadline 2024-09-13T17:03:33.560859+0000) 2024-09-13T17:03:40.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:40 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:40.438+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:16.962910+0000 front 2024-09-13T17:03:16.963012+0000 (oldest deadline 2024-09-13T17:03:38.663179+0000) 2024-09-13T17:03:40.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:40 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:40.617+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:40.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:40 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:40.617+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:40.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:40 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:40.617+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:40.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:40 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:40.617+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:40.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:40 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:40.445+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:40.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:40 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:40.445+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:40.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:40 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:40.445+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:40.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:40 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:40.571+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:40.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:40 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:40.571+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:40.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:40 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:40.571+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:40.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:40 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:40.536+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:40.913 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:40 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:40.536+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:40.913 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:40 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:40.536+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:41.480 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:41 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:41.024+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:41.480 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:41 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:41.024+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:41.480 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:41 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:41.024+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:41.480 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:41 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:41.024+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:41.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:41 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:41.435+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:41.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:41 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:41.435+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.261062+0000 front 2024-09-13T17:03:08.260875+0000 (oldest deadline 2024-09-13T17:03:33.560859+0000) 2024-09-13T17:03:41.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:41 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:41.435+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:16.962910+0000 front 2024-09-13T17:03:16.963012+0000 (oldest deadline 2024-09-13T17:03:38.663179+0000) 2024-09-13T17:03:41.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:41 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:41.631+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:41.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:41 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:41.631+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:41.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:41 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:41.631+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:41.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:41 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:41.631+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:41.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:41 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:41.479+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:41.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:41 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:41.479+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:41.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:41 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:41.479+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:41.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:41 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:41.581+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:41.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:41 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:41.581+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:41.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:41 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:41.581+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:41.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:41 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:41.559+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:41.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:41 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:41.559+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:41.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:41 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:41.559+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:42.475 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:42.029+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:42.475 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:42.029+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:42.475 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:42.029+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:42.475 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:42.029+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:42.709 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:42.391+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:42.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:42.391+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.261062+0000 front 2024-09-13T17:03:08.260875+0000 (oldest deadline 2024-09-13T17:03:33.560859+0000) 2024-09-13T17:03:42.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:42.391+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:16.962910+0000 front 2024-09-13T17:03:16.963012+0000 (oldest deadline 2024-09-13T17:03:38.663179+0000) 2024-09-13T17:03:42.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:42.581+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:42.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:42.581+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:42.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:42.581+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:42.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:42 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:42.581+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:42.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:42.474+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:42.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:42.474+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:42.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:42.474+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:42.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:42 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:42.567+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:42.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:42 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:42.567+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:42.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:42 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:42.567+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:42.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:42 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:42.565+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:42.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:42 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:42.565+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:42.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:42 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:42.565+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:43.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:42.985+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:43.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:42.985+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:43.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:42.985+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:43.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:42 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:42.985+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:43.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:43.361+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.859313+0000 front 2024-09-13T17:03:01.859404+0000 (oldest deadline 2024-09-13T17:03:28.260198+0000) 2024-09-13T17:03:43.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:43.361+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.261062+0000 front 2024-09-13T17:03:08.260875+0000 (oldest deadline 2024-09-13T17:03:33.560859+0000) 2024-09-13T17:03:43.710 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6[58801]: 2024-09-13T17:03:43.361+0000 7fedef000640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:16.962910+0000 front 2024-09-13T17:03:16.963012+0000 (oldest deadline 2024-09-13T17:03:38.663179+0000) 2024-09-13T17:03:43.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:43.563+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:43.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:43.563+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:43.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:43.563+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:43.710 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:43 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:43.563+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:43.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:43 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:43.461+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:43.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:43 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:43.461+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:43.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:43 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:43.461+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:43.911 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:43 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:43.575+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:43.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:43 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:43.575+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:43.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:43 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:43.575+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:43.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:43 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:43.543+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:43.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:43 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:43.543+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:43.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:43 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:43.543+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:43.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:43 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:43.543+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:44.209 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:43 smithi018 podman[92978]: 2024-09-13 17:03:43.949647011 +0000 UTC m=+5.638986431 container died 414bd74f362803c56d46e7ccfe447cec21065366dd8bc991af86b50c1e376624 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T17:03:44.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:43 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:43.990+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:44.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:43 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:43.990+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:44.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:43 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:43.990+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:44.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:43 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:43.990+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:44.611 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:44 smithi018 podman[92978]: 2024-09-13 17:03:44.488492856 +0000 UTC m=+6.177832275 container cleanup 414bd74f362803c56d46e7ccfe447cec21065366dd8bc991af86b50c1e376624 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-13T17:03:44.611 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:44 smithi018 bash[92978]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6 2024-09-13T17:03:44.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:44 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:44.468+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:44.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:44 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:44.468+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:44.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:44 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:44.468+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:44.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:44 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:44.559+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:44.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:44 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:44.559+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:44.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:44 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:44.559+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:44.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:44 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:44.514+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:44.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:44 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:44.514+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:44.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:44 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:44.514+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:44.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:44 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:44.514+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:44.959 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:44 smithi018 podman[92996]: 2024-09-13 17:03:44.706921507 +0000 UTC m=+0.742367273 container remove 414bd74f362803c56d46e7ccfe447cec21065366dd8bc991af86b50c1e376624 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T17:03:44.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:44 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:44.609+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:44.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:44 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:44.609+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:44.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:44 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:44.609+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:44.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:44 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:44.609+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:45.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:44 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:44.944+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:45.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:44 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:44.944+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:45.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:44 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:44.944+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:45.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:44 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:44.944+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:45.542 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:45 smithi018 podman[93083]: 2024-09-13 17:03:45.157607167 +0000 UTC m=+0.027009919 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:03:45.543 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:45 smithi018 podman[93083]: 2024-09-13 17:03:45.424542705 +0000 UTC m=+0.293945417 container create 70f0dba0de3130bdf4742f4de985d3df894b744e6f3bd7055de8f5da6f450c5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD) 2024-09-13T17:03:45.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:45 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:45.422+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:45.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:45 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:45.422+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:45.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:45 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:45.422+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:45.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:45 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:45.598+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:45.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:45 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:45.598+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:45.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:45 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:45.598+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:45.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:45 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:45.561+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:45.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:45 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:45.561+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:45.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:45 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:45.561+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:45.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:45 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:45.561+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:45.954 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:45 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:45.590+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:45.954 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:45 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:45.590+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:45.954 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:45 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:45.590+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:45.954 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:45 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:45.590+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:45.954 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:45 smithi018 podman[93083]: 2024-09-13 17:03:45.685414319 +0000 UTC m=+0.554817053 container init 70f0dba0de3130bdf4742f4de985d3df894b744e6f3bd7055de8f5da6f450c5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T17:03:45.954 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:45 smithi018 podman[93083]: 2024-09-13 17:03:45.692205712 +0000 UTC m=+0.561608435 container start 70f0dba0de3130bdf4742f4de985d3df894b744e6f3bd7055de8f5da6f450c5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T17:03:45.955 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:45 smithi018 podman[93083]: 2024-09-13 17:03:45.776850574 +0000 UTC m=+0.646253299 container attach 70f0dba0de3130bdf4742f4de985d3df894b744e6f3bd7055de8f5da6f450c5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T17:03:46.209 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 13 17:03:45 smithi018 podman[93083]: 2024-09-13 17:03:45.954098162 +0000 UTC m=+0.823500889 container died 70f0dba0de3130bdf4742f4de985d3df894b744e6f3bd7055de8f5da6f450c5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731) 2024-09-13T17:03:46.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:45 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:45.905+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:46.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:45 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:45.905+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:46.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:45 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:45.905+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:46.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:45 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:45.905+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:46.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.6.service' 2024-09-13T17:03:46.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:03:46.763 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-13T17:03:46.763 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-13T17:03:46.763 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.7 2024-09-13T17:03:46.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:46 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:46.413+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:46.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:46 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:46.413+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:46.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:46 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:46.413+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:46.792 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:46 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:46.604+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:46.792 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:46 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:46.604+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:46.792 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:46 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:46.604+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:46.792 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:46 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:46.518+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:46.792 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:46 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:46.518+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:46.793 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:46 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:46.518+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:46.793 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:46 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:46.518+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:46.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:46 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:46.599+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:46.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:46 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:46.599+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:46.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:46 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:46.599+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:46.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:46 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:46.599+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:47.086 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:46 smithi094 systemd[1]: Stopping Ceph osd.7 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:03:47.086 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:47.084+0000 7fcd1eebf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:03:47.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:46 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:46.919+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:47.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:46 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:46.919+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:47.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:46 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:46.919+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:47.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:46 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:46.919+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:47.411 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:47.084+0000 7fcd1eebf640 -1 osd.7 98 *** Got signal Terminated *** 2024-09-13T17:03:47.412 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:47.084+0000 7fcd1eebf640 -1 osd.7 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:03:47.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:47 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:47.442+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:47.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:47 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:47.442+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:47.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:47 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:47.442+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:47.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:47.649+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:47.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:47.649+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:47.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:47.649+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:47.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:47.551+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:47.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:47.551+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:47.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:47.551+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:47.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:47.551+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:47.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:47.610+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:47.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:47.610+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:47.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:47.610+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:47.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:47 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:47.610+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:48.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:47 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:47.909+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:48.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:47 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:47.909+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:48.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:47 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:47.909+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:48.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:47 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:47.909+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:48.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:48 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:48.471+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:48.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:48 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:48.471+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:48.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:48 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:48.471+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:48.911 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:48 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:48.635+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:48.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:48 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:48.635+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:48.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:48 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:48.635+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:48.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:48 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:48.635+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.772845+0000 front 2024-09-13T17:03:26.772671+0000 (oldest deadline 2024-09-13T17:03:48.472759+0000) 2024-09-13T17:03:48.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:48 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:48.527+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:48.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:48 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:48.527+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:48.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:48 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:48.527+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:48.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:48 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:48.527+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:48.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:48 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:48.527+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:48.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:48 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:48.645+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:48.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:48 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:48.645+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:48.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:48 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:48.645+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:48.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:48 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:48.645+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:49.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:48 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:48.947+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:49.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:48 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:48.947+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:49.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:48 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:48.947+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:49.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:48 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:48.947+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:49.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:49 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:49.422+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:49.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:49 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:49.422+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:49.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:49 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:49.422+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:49.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:49 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:49.422+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:03:49.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:49 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:49.654+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:49.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:49 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:49.654+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:49.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:49 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:49.654+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:49.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:49 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:49.654+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.772845+0000 front 2024-09-13T17:03:26.772671+0000 (oldest deadline 2024-09-13T17:03:48.472759+0000) 2024-09-13T17:03:49.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:49 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:49.576+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:49.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:49 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:49.576+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:49.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:49 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:49.576+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:49.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:49 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:49.576+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:49.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:49 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:49.576+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:49.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:49.679+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:49.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:49.679+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:49.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:49.679+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:49.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:49.679+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:49.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:49 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:49.679+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:50.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:49 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:49.951+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:50.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:49 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:49.951+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:50.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:49 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:49.951+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:50.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:49 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:49.951+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:50.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:50 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:50.467+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:50.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:50 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:50.467+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:50.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:50 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:50.467+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:50.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:50 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:50.467+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:03:50.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:50.609+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:50.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:50.609+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:50.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:50.609+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:50.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:50.609+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.772845+0000 front 2024-09-13T17:03:26.772671+0000 (oldest deadline 2024-09-13T17:03:48.472759+0000) 2024-09-13T17:03:50.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:50.539+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:50.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:50.539+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:50.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:50.539+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:50.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:50.539+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:50.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:50 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:50.539+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:50.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:50 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:50.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:50.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:50 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:50.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:50.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:50 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:50.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:50.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:50 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:50.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:50.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:50 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:50.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:51.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:50 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:50.941+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:51.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:50 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:50.941+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:51.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:50 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:50.941+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:51.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:50 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:50.941+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:51.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:51 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:51.491+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:51.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:51 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:51.491+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:51.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:51 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:51.491+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:51.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:51 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:51.491+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:03:51.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:51 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:51.598+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:01.068850+0000 front 2024-09-13T17:03:01.068941+0000 (oldest deadline 2024-09-13T17:03:24.568986+0000) 2024-09-13T17:03:51.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:51 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:51.598+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.869994+0000 front 2024-09-13T17:03:09.870110+0000 (oldest deadline 2024-09-13T17:03:32.169954+0000) 2024-09-13T17:03:51.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:51 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:51.598+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:18.071107+0000 front 2024-09-13T17:03:18.071070+0000 (oldest deadline 2024-09-13T17:03:39.771017+0000) 2024-09-13T17:03:51.912 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:51 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7[53461]: 2024-09-13T17:03:51.598+0000 7fcd174cb640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.772845+0000 front 2024-09-13T17:03:26.772671+0000 (oldest deadline 2024-09-13T17:03:48.472759+0000) 2024-09-13T17:03:51.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:51 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:51.522+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:51.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:51 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:51.522+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:51.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:51 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:51.522+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:51.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:51 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:51.522+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:51.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:51 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:51.522+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:51.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:51 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:51.622+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:51.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:51 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:51.622+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:51.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:51 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:51.622+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:51.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:51 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:51.622+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:51.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:51 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:51.622+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:52.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:51 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:51.940+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:52.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:51 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:51.940+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:52.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:51 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:51.940+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:52.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:51 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:51.940+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:52.478 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:52 smithi094 podman[70436]: 2024-09-13 17:03:52.436978506 +0000 UTC m=+5.476363126 container died 31fe791b02cb93bdf3cbf4a22416e44a7ef824c1725af021d9dd55aef0f20bbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T17:03:52.478 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:52 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:52.473+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:52.478 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:52 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:52.473+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:52.478 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:52 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:52.473+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:52.478 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:52 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:52.473+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:52.478 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:52 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:52.473+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:52.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:52 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:52.481+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:52.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:52 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:52.481+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:52.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:52 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:52.481+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:52.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:52 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:52.481+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:03:52.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:52 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:52.629+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:52.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:52 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:52.629+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:52.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:52 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:52.629+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:52.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:52 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:52.629+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:52.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:52 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:52.629+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:53.078 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:52 smithi094 podman[70436]: 2024-09-13 17:03:52.81793154 +0000 UTC m=+5.857316164 container cleanup 31fe791b02cb93bdf3cbf4a22416e44a7ef824c1725af021d9dd55aef0f20bbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:03:53.078 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:52 smithi094 bash[70436]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7 2024-09-13T17:03:53.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:52 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:52.964+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:53.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:52 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:52.964+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:53.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:52 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:52.964+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:53.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:52 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:52.964+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:53.411 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:53 smithi094 podman[70452]: 2024-09-13 17:03:53.077324071 +0000 UTC m=+0.628821495 container remove 31fe791b02cb93bdf3cbf4a22416e44a7ef824c1725af021d9dd55aef0f20bbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T17:03:53.690 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:53 smithi094 podman[70544]: 2024-09-13 17:03:53.331811369 +0000 UTC m=+0.015592098 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:03:53.691 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:53 smithi094 podman[70544]: 2024-09-13 17:03:53.436869366 +0000 UTC m=+0.120650094 container create c15e7ff45779ba4f0fcca2fe6b8b443a0f14f84ec365f998c0558d20a50a5f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T17:03:53.691 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:53 smithi094 podman[70544]: 2024-09-13 17:03:53.689740123 +0000 UTC m=+0.373520855 container init c15e7ff45779ba4f0fcca2fe6b8b443a0f14f84ec365f998c0558d20a50a5f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2) 2024-09-13T17:03:53.691 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:53 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:53.445+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:53.691 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:53 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:53.445+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:53.691 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:53 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:53.445+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:53.691 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:53 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:53.445+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:53.691 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:53 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:53.445+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:53.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:53 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:53.505+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:53.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:53 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:53.505+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:53.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:53 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:53.505+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:53.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:53 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:53.505+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:03:53.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:53 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:53.668+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:53.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:53 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:53.668+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:53.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:53 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:53.668+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:53.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:53 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:53.668+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:53.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:53 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:53.668+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:54.152 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:53 smithi094 podman[70544]: 2024-09-13 17:03:53.693398495 +0000 UTC m=+0.377179224 container start c15e7ff45779ba4f0fcca2fe6b8b443a0f14f84ec365f998c0558d20a50a5f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T17:03:54.152 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:53 smithi094 podman[70544]: 2024-09-13 17:03:53.798030202 +0000 UTC m=+0.481810937 container attach c15e7ff45779ba4f0fcca2fe6b8b443a0f14f84ec365f998c0558d20a50a5f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T17:03:54.152 INFO:journalctl@ceph.osd.7.smithi094.stdout:Sep 13 17:03:53 smithi094 podman[70544]: 2024-09-13 17:03:53.873992151 +0000 UTC m=+0.557772883 container died c15e7ff45779ba4f0fcca2fe6b8b443a0f14f84ec365f998c0558d20a50a5f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T17:03:54.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:53 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:53.932+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:54.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:53 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:53.932+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:54.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:53 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:53.932+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:54.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:53 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:53.932+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:54.518 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.7.service' 2024-09-13T17:03:54.600 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:03:54.600 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-13T17:03:54.601 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-13T17:03:54.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.8 2024-09-13T17:03:54.767 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:54 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:54.428+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:54.767 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:54 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:54.428+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:54.768 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:54 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:54.428+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:54.768 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:54 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:54.428+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:54.768 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:54 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:54.428+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:54.771 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:54 smithi144 systemd[1]: Stopping Ceph osd.8 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:03:54.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:54.493+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:54.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:54.493+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:54.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:54.493+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:54.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:54.493+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:03:54.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:54 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:54.675+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:54.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:54 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:54.675+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:54.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:54 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:54.675+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:54.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:54 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:54.675+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:54.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:54 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:54.675+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:55.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:54.920+0000 7f2b20dc9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:03:55.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:54.920+0000 7f2b20dc9640 -1 osd.8 98 *** Got signal Terminated *** 2024-09-13T17:03:55.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:54.920+0000 7f2b20dc9640 -1 osd.8 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:03:55.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:54.942+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:55.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:54.942+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:55.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:54.942+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:55.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:54 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:54.942+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:55.661 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:55 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:55.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:55.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:55 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:55.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:55.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:55 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:55.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:55.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:55 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:55.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:55.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:55 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:55.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:55.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:55 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:55.471+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:55.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:55 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:55.471+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:55.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:55 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:55.471+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:55.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:55 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:55.471+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:03:55.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:55 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:55.684+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:55.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:55 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:55.684+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:55.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:55 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:55.684+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:55.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:55 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:55.684+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:55.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:55 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:55.684+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:56.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:55 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:55.975+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:56.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:55 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:55.975+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:56.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:55 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:55.975+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:56.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:55 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:55.975+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:56.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:56 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:56.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:56.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:56 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:56.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:56.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:56 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:56.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:56.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:56 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:56.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:56.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:56 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:56.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:56.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:56 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:56.481+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:56.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:56 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:56.481+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:56.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:56 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:56.481+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:56.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:56 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:56.481+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:03:56.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:56 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:56.688+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:56.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:56 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:56.688+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:56.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:56 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:56.688+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:56.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:56 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:56.688+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:56.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:56 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:56.688+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:56.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:56 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:56.688+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:03:57.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:57.005+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:57.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:57.005+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:57.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:57.006+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:57.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:57.006+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:57.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:57.489+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:57.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:57.489+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:57.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:57.489+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:57.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:57.489+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:03:57.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:57.489+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:03:57.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:57 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:57.449+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:57.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:57 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:57.449+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:57.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:57 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:57.449+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:57.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:57 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:57.449+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:57.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:57 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:57.449+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:57.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:57 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:57.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:57.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:57 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:57.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:57.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:57 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:57.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:57.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:57 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:57.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:57.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:57 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:57.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:57.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:57 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:57.657+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:03:58.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:57.961+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:58.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:57.961+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:58.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:57.961+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:58.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:57 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:57.961+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:58.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:58.505+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:03:58.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:58.505+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:03:58.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:58.505+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:03:58.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:58.505+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:03:58.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:58.505+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:03:58.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:58 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:58.469+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:58.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:58 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:58.469+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:58.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:58 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:58.469+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:58.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:58 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:58.469+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:58.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:58 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:58.469+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:58.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:58 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:58.469+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:03:58.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:58.689+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:58.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:58.689+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:58.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:58.689+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:58.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:58.689+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:58.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:58.689+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:58.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:58 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:58.689+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:03:59.271 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:58.962+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:49.192713+0000 front 2024-09-13T17:02:49.192756+0000 (oldest deadline 2024-09-13T17:03:16.193110+0000) 2024-09-13T17:03:59.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:58.962+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:59.594634+0000 front 2024-09-13T17:02:59.594653+0000 (oldest deadline 2024-09-13T17:03:25.494677+0000) 2024-09-13T17:03:59.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:58.962+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.595462+0000 front 2024-09-13T17:03:09.595436+0000 (oldest deadline 2024-09-13T17:03:35.495540+0000) 2024-09-13T17:03:59.272 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:03:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8[53905]: 2024-09-13T17:03:58.962+0000 7f2b1d3dd640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.696882+0000 front 2024-09-13T17:03:17.696945+0000 (oldest deadline 2024-09-13T17:03:38.796825+0000) 2024-09-13T17:03:59.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:59 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:59.472+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:03:59.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:59 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:59.472+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:03:59.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:59 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:59.472+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:03:59.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:59 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:59.472+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:03:59.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:59 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:59.472+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:03:59.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:03:59 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:03:59.472+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:03:59.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:59 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:59.690+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:03:59.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:59 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:59.690+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:03:59.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:59 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:59.690+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:03:59.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:59 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:59.690+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:03:59.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:59 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:59.690+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:03:59.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:03:59 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:03:59.690+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:04:00.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:59 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:59.531+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:00.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:59 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:59.531+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:00.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:59 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:59.531+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:00.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:59 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:59.531+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:00.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:03:59 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:03:59.531+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:00.763 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:04:00 smithi144 podman[71821]: 2024-09-13 17:04:00.466567401 +0000 UTC m=+5.669667037 container died dc94fce292b51a21948efa882d691a86f279347a274a71b0ae4ee21912b97d57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-09-13T17:04:00.764 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:00 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:00.531+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:00.764 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:00 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:00.531+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:00.764 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:00 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:00.531+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:00.764 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:00 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:00.531+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:00.764 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:00 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:00.531+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:00.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:00 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:00.466+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:00.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:00 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:00.466+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:00.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:00 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:00.466+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:00.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:00 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:00.466+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:00.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:00 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:00.466+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:00.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:00 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:00.466+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:01.021 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:04:00 smithi144 podman[71821]: 2024-09-13 17:04:00.861462905 +0000 UTC m=+6.064562543 container cleanup dc94fce292b51a21948efa882d691a86f279347a274a71b0ae4ee21912b97d57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:04:01.021 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:04:00 smithi144 bash[71821]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8 2024-09-13T17:04:01.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:00 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:00.718+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:04:01.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:00 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:00.718+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:04:01.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:00 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:00.718+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:04:01.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:00 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:00.718+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:04:01.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:00 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:00.718+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:04:01.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:00 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:00.718+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:04:01.473 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:04:01 smithi144 podman[71837]: 2024-09-13 17:04:01.146020375 +0000 UTC m=+0.678328973 container remove dc94fce292b51a21948efa882d691a86f279347a274a71b0ae4ee21912b97d57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T17:04:01.759 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:04:01 smithi144 podman[71930]: 2024-09-13 17:04:01.374953903 +0000 UTC m=+0.016265169 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:04:01.759 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:04:01 smithi144 podman[71930]: 2024-09-13 17:04:01.479965192 +0000 UTC m=+0.121276450 container create 6902352eb87b10dc015454fb3f1281a46f4188a67082ac6740ea473eb7287b15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-13T17:04:01.759 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:04:01 smithi144 podman[71930]: 2024-09-13 17:04:01.7577099 +0000 UTC m=+0.399021169 container init 6902352eb87b10dc015454fb3f1281a46f4188a67082ac6740ea473eb7287b15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T17:04:01.760 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:01 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:01.491+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:01.760 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:01 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:01.492+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:01.760 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:01 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:01.492+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:01.760 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:01 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:01.492+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:01.760 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:01 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:01.492+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:01.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:01 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:01.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:01.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:01 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:01.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:01.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:01 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:01.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:01.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:01 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:01.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:01.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:01 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:01.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:01.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:01 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:01.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:01.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:01 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:01.671+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:04:01.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:01 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:01.671+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:04:01.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:01 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:01.671+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:04:01.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:01 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:01.671+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:04:01.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:01 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:01.671+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:04:01.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:01 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:01.671+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:04:02.021 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:04:01 smithi144 podman[71930]: 2024-09-13 17:04:01.761172346 +0000 UTC m=+0.402483609 container start 6902352eb87b10dc015454fb3f1281a46f4188a67082ac6740ea473eb7287b15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS) 2024-09-13T17:04:02.022 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:04:01 smithi144 podman[71930]: 2024-09-13 17:04:01.857828088 +0000 UTC m=+0.499139362 container attach 6902352eb87b10dc015454fb3f1281a46f4188a67082ac6740ea473eb7287b15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:04:02.022 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 13 17:04:01 smithi144 podman[71953]: 2024-09-13 17:04:01.97250349 +0000 UTC m=+0.017038147 container died 6902352eb87b10dc015454fb3f1281a46f4188a67082ac6740ea473eb7287b15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2) 2024-09-13T17:04:02.521 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:02 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:02.473+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:02.522 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:02 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:02.473+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:02.522 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:02 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:02.473+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:02.522 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:02 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:02.473+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:02.522 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:02 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:02.473+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:02.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.8.service' 2024-09-13T17:04:02.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:02.618 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-13T17:04:02.618 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-13T17:04:02.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.9 2024-09-13T17:04:02.813 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:02 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:02.478+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:02.813 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:02 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:02.478+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:02.814 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:02 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:02.478+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:02.814 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:02 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:02.478+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:02.814 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:02 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:02.478+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:02.814 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:02 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:02.478+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:02.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:02 smithi018 systemd[1]: Stopping Ceph osd.9 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:02.959 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:02 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:02.717+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:04:02.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:02 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:02.717+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:04:02.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:02 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:02.717+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:04:02.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:02 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:02.717+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:04:02.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:02 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:02.717+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:04:02.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:02 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:02.717+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:04:03.460 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:03 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:03.043+0000 7f1d08e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:03.460 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:03 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:03.043+0000 7f1d08e00640 -1 osd.9 98 *** Got signal Terminated *** 2024-09-13T17:04:03.460 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:03 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:03.043+0000 7f1d08e00640 -1 osd.9 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:04:03.770 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:03 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:03.490+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:03.770 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:03 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:03.490+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:03.770 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:03 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:03.490+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:03.770 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:03 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:03.490+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:03.770 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:03 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:03.490+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:03.824 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:03 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:03.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:03.824 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:03 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:03.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:03.824 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:03 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:03.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:03.824 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:03 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:03.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:03.825 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:03 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:03.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:03.825 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:03 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:03.433+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:03.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:03 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:03.699+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:04:03.961 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:03 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:03.699+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:04:03.961 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:03 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:03.699+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:04:03.961 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:03 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:03.699+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:04:03.961 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:03 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:03.699+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:04:03.961 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:03 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:03.699+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:04:04.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:04 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:04.429+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:04.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:04 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:04.429+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:04.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:04 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:04.429+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:04.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:04 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:04.429+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:04.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:04 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:04.429+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:04.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:04 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:04.429+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:04.913 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:04 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:04.429+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:05.021 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:04 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:04.521+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:05.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:04 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:04.521+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:05.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:04 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:04.521+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:05.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:04 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:04.521+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:05.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:04 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:04.521+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:05.209 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:04 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:04.734+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:04:05.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:04 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:04.734+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:04:05.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:04 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:04.734+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:04:05.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:04 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:04.734+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:04:05.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:04 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:04.734+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:04:05.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:04 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:04.734+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:04:05.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:05 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:05.510+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:05.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:05 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:05.510+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:05.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:05 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:05.510+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:05.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:05 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:05.510+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:05.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:05 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:05.510+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:05.911 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:05 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:05.427+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:05.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:05 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:05.427+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:05.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:05 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:05.427+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:05.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:05 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:05.427+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:05.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:05 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:05.427+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:05.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:05 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:05.427+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:05.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:05 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:05.427+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:06.212 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:05 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:05.761+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:04:06.212 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:05 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:05.761+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:04:06.212 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:05 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:05.761+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:04:06.213 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:05 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:05.761+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:04:06.213 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:05 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:05.761+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:04:06.213 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:05 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:05.761+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:04:06.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:06 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:06.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:06.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:06 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:06.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:06.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:06 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:06.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:06.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:06 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:06.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:06.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:06 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:06.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:06.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:06 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:06.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:06.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:06 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:06.389+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:06.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:06 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:06.508+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:06.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:06 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:06.508+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:06.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:06 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:06.508+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:06.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:06 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:06.508+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:06.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:06 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:06.508+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:07.209 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:06.771+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:04:07.209 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:06.771+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:04:07.209 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:06.771+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:04:07.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:06.771+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:04:07.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:06.771+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:04:07.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:06 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:06.771+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:04:07.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:07 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:07.407+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:07.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:07 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:07.407+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:07.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:07 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:07.407+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:07.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:07 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:07.407+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:07.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:07 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:07.407+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:07.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:07 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:07.407+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:07.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:07 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:07.407+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:08.021 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:07 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:07.533+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:08.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:07 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:07.533+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:08.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:07 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:07.533+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:08.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:07 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:07.533+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:08.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:07 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:07.533+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:08.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:07 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:07.533+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:08.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:07 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:07.803+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:47.405290+0000 front 2024-09-13T17:02:47.405468+0000 (oldest deadline 2024-09-13T17:03:13.305472+0000) 2024-09-13T17:04:08.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:07 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:07.803+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:03:00.307341+0000 front 2024-09-13T17:03:00.307241+0000 (oldest deadline 2024-09-13T17:03:24.407238+0000) 2024-09-13T17:04:08.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:07 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:07.803+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.708712+0000 front 2024-09-13T17:03:09.708850+0000 (oldest deadline 2024-09-13T17:03:31.408793+0000) 2024-09-13T17:04:08.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:07 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:07.803+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:14.909988+0000 front 2024-09-13T17:03:14.909952+0000 (oldest deadline 2024-09-13T17:03:39.010155+0000) 2024-09-13T17:04:08.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:07 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:07.803+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.712736+0000 front 2024-09-13T17:03:24.712818+0000 (oldest deadline 2024-09-13T17:03:49.412405+0000) 2024-09-13T17:04:08.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:07 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9[65375]: 2024-09-13T17:04:07.803+0000 7f1cff800640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:30.513430+0000 front 2024-09-13T17:03:30.513410+0000 (oldest deadline 2024-09-13T17:03:56.413160+0000) 2024-09-13T17:04:08.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:08 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:08.391+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:08.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:08 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:08.391+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:08.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:08 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:08.391+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:08.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:08 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:08.391+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:08.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:08 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:08.391+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:08.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:08 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:08.391+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:08.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:08 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:08.391+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:08.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:08 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:08.515+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:08.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:08 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:08.515+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:08.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:08 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:08.515+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:08.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:08 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:08.515+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:08.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:08 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:08.515+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:08.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:08 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:08.515+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:08.960 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:08 smithi018 podman[93197]: 2024-09-13 17:04:08.543791366 +0000 UTC m=+5.628981112 container died 610dc5baa2a982d82c2fcf74dd4b0f64158c990a3764456a79d39c6826a3e6af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T17:04:09.392 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:09 smithi018 podman[93197]: 2024-09-13 17:04:09.140492852 +0000 UTC m=+6.225682597 container cleanup 610dc5baa2a982d82c2fcf74dd4b0f64158c990a3764456a79d39c6826a3e6af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-13T17:04:09.392 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:09 smithi018 bash[93197]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9 2024-09-13T17:04:09.661 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:09 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:09.402+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:09.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:09 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:09.402+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:09.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:09 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:09.402+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:09.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:09 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:09.402+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:09.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:09 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:09.402+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:09.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:09 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:09.402+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:09.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:09 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:09.402+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:09.709 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:09 smithi018 podman[93213]: 2024-09-13 17:04:09.391517617 +0000 UTC m=+0.836064585 container remove 610dc5baa2a982d82c2fcf74dd4b0f64158c990a3764456a79d39c6826a3e6af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T17:04:10.021 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:09 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:09.527+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:10.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:09 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:09.527+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:10.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:09 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:09.527+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:10.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:09 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:09.527+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:10.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:09 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:09.527+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:10.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:09 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:09.527+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:10.209 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:09 smithi018 podman[93299]: 2024-09-13 17:04:09.744760109 +0000 UTC m=+0.027279043 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:04:10.210 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:09 smithi018 podman[93299]: 2024-09-13 17:04:09.875932293 +0000 UTC m=+0.158451225 container create 1d4669e28b97c795e958e92370f1c5a76b0b537a0ff4a4f861d91319f26aacd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T17:04:10.509 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:10 smithi018 podman[93299]: 2024-09-13 17:04:10.228350322 +0000 UTC m=+0.510869278 container init 1d4669e28b97c795e958e92370f1c5a76b0b537a0ff4a4f861d91319f26aacd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T17:04:10.510 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:10 smithi018 podman[93299]: 2024-09-13 17:04:10.235662058 +0000 UTC m=+0.518181001 container start 1d4669e28b97c795e958e92370f1c5a76b0b537a0ff4a4f861d91319f26aacd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:04:10.510 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:10 smithi018 podman[93299]: 2024-09-13 17:04:10.353109115 +0000 UTC m=+0.635628062 container attach 1d4669e28b97c795e958e92370f1c5a76b0b537a0ff4a4f861d91319f26aacd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T17:04:10.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:10 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:10.395+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:10.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:10 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:10.395+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:10.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:10 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:10.395+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:10.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:10 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:10.395+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:10.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:10 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:10.395+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:10.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:10 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:10.395+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:10.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:10 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:10.395+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:10.881 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 13 17:04:10 smithi018 podman[93326]: 2024-09-13 17:04:10.55035374 +0000 UTC m=+0.027732800 container died 1d4669e28b97c795e958e92370f1c5a76b0b537a0ff4a4f861d91319f26aacd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T17:04:11.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:10 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:10.529+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:11.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:10 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:10.529+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:11.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:10 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:10.529+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:11.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:10 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:10.529+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:11.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:10 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:10.529+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:11.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:10 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:10.529+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:11.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.9.service' 2024-09-13T17:04:11.322 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:11.322 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-13T17:04:11.323 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-13T17:04:11.323 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.10 2024-09-13T17:04:11.640 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:11.354+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:11.640 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:11.354+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:11.640 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:11.354+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:11.640 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:11.354+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:11.641 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:11.354+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:11.641 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:11.354+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:11.641 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:11.354+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:11.641 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 systemd[1]: Stopping Ceph osd.10 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:11.641 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:11.638+0000 7fd7acc7c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:11.641 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:11.638+0000 7fd7acc7c640 -1 osd.10 98 *** Got signal Terminated *** 2024-09-13T17:04:11.641 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:11 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:11.638+0000 7fd7acc7c640 -1 osd.10 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:04:12.021 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:11 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:11.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:12.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:11 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:11.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:12.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:11 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:11.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:12.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:11 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:11.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:12.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:11 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:11.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:12.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:11 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:11.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:12.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:12 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:12.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:12.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:12 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:12.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:12.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:12 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:12.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:12.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:12 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:12.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:12.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:12 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:12.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:12.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:12 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:12.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:12.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:12 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:12.399+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:12.773 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:12 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:12.497+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:12.773 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:12 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:12.497+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:12.773 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:12 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:12.497+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:12.773 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:12 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:12.497+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:12.773 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:12 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:12.497+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:12.773 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:12 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:12.497+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:13.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:13 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:13.507+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:13.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:13 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:13.507+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:13.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:13 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:13.507+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:13.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:13 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:13.507+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:13.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:13 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:13.507+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:13.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:13 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:13.507+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:13.866 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:13 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:13.417+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:13.866 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:13 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:13.417+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:13.866 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:13 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:13.417+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:13.866 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:13 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:13.417+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:13.866 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:13 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:13.417+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:13.866 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:13 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:13.417+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:13.866 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:13 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:13.417+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:14.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:14 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:14.502+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:14.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:14 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:14.502+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:14.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:14 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:14.502+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:14.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:14 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:14.502+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:14.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:14 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:14.502+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:14.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:14 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:14.502+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:14.773 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:14 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:14.502+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-09-13T17:03:47.410505+0000 front 2024-09-13T17:03:47.410446+0000 (oldest deadline 2024-09-13T17:04:14.410776+0000) 2024-09-13T17:04:14.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:14 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:14.439+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:14.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:14 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:14.439+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:14.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:14 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:14.439+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:14.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:14 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:14.439+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:14.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:14 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:14.439+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:14.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:14 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:14.439+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:14.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:14 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:14.439+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:15.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:15 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:15.480+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:15.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:15 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:15.480+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:15.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:15 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:15.480+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:15.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:15 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:15.480+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:15.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:15 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:15.480+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:15.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:15 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:15.480+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:15.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:15 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:15.480+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-09-13T17:03:47.410505+0000 front 2024-09-13T17:03:47.410446+0000 (oldest deadline 2024-09-13T17:04:14.410776+0000) 2024-09-13T17:04:15.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:15 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:15.416+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:15.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:15 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:15.416+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:15.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:15 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:15.416+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:15.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:15 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:15.416+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:15.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:15 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:15.416+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:15.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:15 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:15.416+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:15.912 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:15 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:15.416+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:16.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:16 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:16.394+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.913719+0000 front 2024-09-13T17:02:51.913707+0000 (oldest deadline 2024-09-13T17:03:17.714129+0000) 2024-09-13T17:04:16.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:16 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:16.394+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:57.714502+0000 front 2024-09-13T17:02:57.714474+0000 (oldest deadline 2024-09-13T17:03:22.414489+0000) 2024-09-13T17:04:16.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:16 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:16.394+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:09.316367+0000 front 2024-09-13T17:03:09.316447+0000 (oldest deadline 2024-09-13T17:03:33.416481+0000) 2024-09-13T17:04:16.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:16 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:16.394+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-13T17:03:17.517676+0000 front 2024-09-13T17:03:17.517749+0000 (oldest deadline 2024-09-13T17:03:43.417630+0000) 2024-09-13T17:04:16.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:16 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:16.394+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:26.918396+0000 front 2024-09-13T17:03:26.918426+0000 (oldest deadline 2024-09-13T17:03:48.018522+0000) 2024-09-13T17:04:16.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:16 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:16.394+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:32.020106+0000 front 2024-09-13T17:03:32.020159+0000 (oldest deadline 2024-09-13T17:03:57.820723+0000) 2024-09-13T17:04:16.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:16 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10[60468]: 2024-09-13T17:04:16.394+0000 7fd7a5288640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:41.322086+0000 front 2024-09-13T17:03:41.322065+0000 (oldest deadline 2024-09-13T17:04:04.122110+0000) 2024-09-13T17:04:16.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:16 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:16.486+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:16.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:16 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:16.486+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:16.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:16 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:16.486+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:16.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:16 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:16.486+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:16.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:16 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:16.486+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:16.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:16 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:16.486+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:16.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:16 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:16.486+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-09-13T17:03:47.410505+0000 front 2024-09-13T17:03:47.410446+0000 (oldest deadline 2024-09-13T17:04:14.410776+0000) 2024-09-13T17:04:17.380 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:17 smithi094 podman[70661]: 2024-09-13 17:04:17.063336088 +0000 UTC m=+5.539685146 container died 3b68a34decdf560cb0677a5a0ba189b0289b5ffb5daac1f1d467e67b810a640a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T17:04:17.381 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:17 smithi094 podman[70661]: 2024-09-13 17:04:17.380037078 +0000 UTC m=+5.856386136 container cleanup 3b68a34decdf560cb0677a5a0ba189b0289b5ffb5daac1f1d467e67b810a640a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T17:04:17.661 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:17 smithi094 bash[70661]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10 2024-09-13T17:04:17.662 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:17 smithi094 podman[70678]: 2024-09-13 17:04:17.597592995 +0000 UTC m=+0.529340104 container remove 3b68a34decdf560cb0677a5a0ba189b0289b5ffb5daac1f1d467e67b810a640a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T17:04:18.021 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:17.520+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:18.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:17.520+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:18.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:17.520+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:18.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:17.520+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:18.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:17.520+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:18.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:17.520+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:18.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:17 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:17.520+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-09-13T17:03:47.410505+0000 front 2024-09-13T17:03:47.410446+0000 (oldest deadline 2024-09-13T17:04:14.410776+0000) 2024-09-13T17:04:18.163 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:17 smithi094 podman[70764]: 2024-09-13 17:04:17.814092239 +0000 UTC m=+0.015506781 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:04:18.164 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:17 smithi094 podman[70764]: 2024-09-13 17:04:17.915058905 +0000 UTC m=+0.116473440 container create 3648b0a897f7b7358d4cdb290759660cc97735100b83d66cb95b6864b710cfba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T17:04:18.164 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:18 smithi094 podman[70764]: 2024-09-13 17:04:18.159439898 +0000 UTC m=+0.360854437 container init 3648b0a897f7b7358d4cdb290759660cc97735100b83d66cb95b6864b710cfba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T17:04:18.164 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:18 smithi094 podman[70764]: 2024-09-13 17:04:18.162890665 +0000 UTC m=+0.364305197 container start 3648b0a897f7b7358d4cdb290759660cc97735100b83d66cb95b6864b710cfba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T17:04:18.629 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:18 smithi094 podman[70764]: 2024-09-13 17:04:18.276116104 +0000 UTC m=+0.477530646 container attach 3648b0a897f7b7358d4cdb290759660cc97735100b83d66cb95b6864b710cfba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:04:18.630 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:18 smithi094 podman[70764]: 2024-09-13 17:04:18.351358599 +0000 UTC m=+0.552773132 container died 3648b0a897f7b7358d4cdb290759660cc97735100b83d66cb95b6864b710cfba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T17:04:18.868 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.10.service' 2024-09-13T17:04:18.892 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:18 smithi094 podman[70787]: 2024-09-13 17:04:18.845750949 +0000 UTC m=+0.488650066 container remove 3648b0a897f7b7358d4cdb290759660cc97735100b83d66cb95b6864b710cfba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:04:18.892 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:18 smithi094 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.10.service: Deactivated successfully. 2024-09-13T17:04:18.892 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:18 smithi094 systemd[1]: Stopped Ceph osd.10 for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T17:04:18.892 INFO:journalctl@ceph.osd.10.smithi094.stdout:Sep 13 17:04:18 smithi094 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.10.service: Consumed 2min 44.541s CPU time. 2024-09-13T17:04:18.908 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:18.909 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-13T17:04:18.909 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-13T17:04:18.909 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.11 2024-09-13T17:04:18.938 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:18 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:18.544+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:18.939 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:18 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:18.544+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:18.939 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:18 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:18.544+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:18.939 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:18 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:18.544+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:18.939 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:18 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:18.544+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:18.939 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:18 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:18.544+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:18.939 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:18 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:18.544+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-09-13T17:03:47.410505+0000 front 2024-09-13T17:03:47.410446+0000 (oldest deadline 2024-09-13T17:04:14.410776+0000) 2024-09-13T17:04:19.231 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:18 smithi144 systemd[1]: Stopping Ceph osd.11 for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:19.521 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:19.229+0000 7f054c169640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:19.522 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:19.229+0000 7f054c169640 -1 osd.11 98 *** Got signal Terminated *** 2024-09-13T17:04:19.522 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:19.229+0000 7f054c169640 -1 osd.11 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:04:20.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:19.534+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:20.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:19.534+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:20.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:19.534+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:20.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:19.534+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:20.023 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:19.534+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:20.023 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:19.534+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:20.023 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:19 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:19.534+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-09-13T17:03:47.410505+0000 front 2024-09-13T17:03:47.410446+0000 (oldest deadline 2024-09-13T17:04:14.410776+0000) 2024-09-13T17:04:20.771 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:20 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:20.516+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:20.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:20 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:20.516+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:20.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:20 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:20.516+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:20.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:20 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:20.516+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:20.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:20 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:20.516+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:20.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:20 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:20.516+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:20.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:20 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:20.516+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-09-13T17:03:47.410505+0000 front 2024-09-13T17:03:47.410446+0000 (oldest deadline 2024-09-13T17:04:14.410776+0000) 2024-09-13T17:04:21.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:21.483+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:21.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:21.483+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:21.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:21.483+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:21.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:21.483+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:21.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:21.483+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:21.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:21.483+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:21.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:21.483+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-09-13T17:03:47.410505+0000 front 2024-09-13T17:03:47.410446+0000 (oldest deadline 2024-09-13T17:04:14.410776+0000) 2024-09-13T17:04:21.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:21 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:21.483+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6820 osd.8 since back 2024-09-13T17:03:58.511675+0000 front 2024-09-13T17:03:58.511647+0000 (oldest deadline 2024-09-13T17:04:20.811721+0000) 2024-09-13T17:04:23.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:22.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:23.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:22.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:23.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:22.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:23.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:22.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:23.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:22.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:23.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:22.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:23.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:22.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-09-13T17:03:47.410505+0000 front 2024-09-13T17:03:47.410446+0000 (oldest deadline 2024-09-13T17:04:14.410776+0000) 2024-09-13T17:04:23.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:22 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:22.525+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6820 osd.8 since back 2024-09-13T17:03:58.511675+0000 front 2024-09-13T17:03:58.511647+0000 (oldest deadline 2024-09-13T17:04:20.811721+0000) 2024-09-13T17:04:23.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:23.512+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-13T17:02:51.303377+0000 front 2024-09-13T17:02:51.303426+0000 (oldest deadline 2024-09-13T17:03:15.403088+0000) 2024-09-13T17:04:23.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:23.512+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6804 osd.1 since back 2024-09-13T17:02:58.304146+0000 front 2024-09-13T17:02:58.304224+0000 (oldest deadline 2024-09-13T17:03:22.404085+0000) 2024-09-13T17:04:23.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:23.512+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-13T17:03:08.205314+0000 front 2024-09-13T17:03:08.205299+0000 (oldest deadline 2024-09-13T17:03:31.105409+0000) 2024-09-13T17:04:23.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:23.512+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6812 osd.4 since back 2024-09-13T17:03:24.007364+0000 front 2024-09-13T17:03:24.007232+0000 (oldest deadline 2024-09-13T17:03:48.707345+0000) 2024-09-13T17:04:23.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:23.512+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-13T17:03:31.008276+0000 front 2024-09-13T17:03:31.008311+0000 (oldest deadline 2024-09-13T17:03:56.908348+0000) 2024-09-13T17:04:23.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:23.512+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-13T17:03:43.309821+0000 front 2024-09-13T17:03:43.309861+0000 (oldest deadline 2024-09-13T17:04:07.409832+0000) 2024-09-13T17:04:23.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:23.512+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.94:6820 osd.7 since back 2024-09-13T17:03:47.410505+0000 front 2024-09-13T17:03:47.410446+0000 (oldest deadline 2024-09-13T17:04:14.410776+0000) 2024-09-13T17:04:23.772 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:23 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11[60439]: 2024-09-13T17:04:23.512+0000 7f0544775640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.144:6820 osd.8 since back 2024-09-13T17:03:58.511675+0000 front 2024-09-13T17:03:58.511647+0000 (oldest deadline 2024-09-13T17:04:20.811721+0000) 2024-09-13T17:04:24.898 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:24 smithi144 podman[72046]: 2024-09-13 17:04:24.622702476 +0000 UTC m=+5.514952694 container died d304b41e8e0f2234b35273a74999fa6a6458cbbfed01a400df0b2aa274438efd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T17:04:25.256 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:24 smithi144 podman[72046]: 2024-09-13 17:04:24.979778408 +0000 UTC m=+5.872028550 container cleanup d304b41e8e0f2234b35273a74999fa6a6458cbbfed01a400df0b2aa274438efd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T17:04:25.257 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:24 smithi144 bash[72046]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11 2024-09-13T17:04:25.521 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:25 smithi144 podman[72062]: 2024-09-13 17:04:25.256153212 +0000 UTC m=+0.622853251 container remove d304b41e8e0f2234b35273a74999fa6a6458cbbfed01a400df0b2aa274438efd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T17:04:25.901 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:25 smithi144 podman[72146]: 2024-09-13 17:04:25.50367965 +0000 UTC m=+0.016015259 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T17:04:25.901 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:25 smithi144 podman[72146]: 2024-09-13 17:04:25.606748166 +0000 UTC m=+0.119083751 container create 1369e14967159b2472627e3409639f55791d71d5c2d5252e2d8ccd48ba4931f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:04:25.902 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:25 smithi144 podman[72146]: 2024-09-13 17:04:25.825687789 +0000 UTC m=+0.338023381 container init 1369e14967159b2472627e3409639f55791d71d5c2d5252e2d8ccd48ba4931f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T17:04:25.902 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:25 smithi144 podman[72146]: 2024-09-13 17:04:25.828974507 +0000 UTC m=+0.341310093 container start 1369e14967159b2472627e3409639f55791d71d5c2d5252e2d8ccd48ba4931f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T17:04:25.902 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:25 smithi144 podman[72146]: 2024-09-13 17:04:25.90065909 +0000 UTC m=+0.412994676 container attach 1369e14967159b2472627e3409639f55791d71d5c2d5252e2d8ccd48ba4931f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T17:04:26.272 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 13 17:04:26 smithi144 podman[72146]: 2024-09-13 17:04:26.013458249 +0000 UTC m=+0.525793835 container died 1369e14967159b2472627e3409639f55791d71d5c2d5252e2d8ccd48ba4931f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:04:26.596 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@osd.11.service' 2024-09-13T17:04:26.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:26.678 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-13T17:04:26.678 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-13T17:04:26.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.a 2024-09-13T17:04:27.138 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 13 17:04:26 smithi018 systemd[1]: Stopping Ceph mds.a for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:27.456 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 13 17:04:27 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-a[72241]: 2024-09-13T17:04:27.136+0000 7f429e000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:27.456 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 13 17:04:27 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-a[72241]: 2024-09-13T17:04:27.136+0000 7f429e000640 -1 mds.a *** got signal Terminated *** 2024-09-13T17:04:28.641 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 13 17:04:28 smithi018 podman[93414]: 2024-09-13 17:04:28.35777731 +0000 UTC m=+1.384751371 container died f9c0996eb133d028448c96bc1b1f9dcbabdacc7c1ddc1a9a29f56ecf13cf3f84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-a, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T17:04:28.959 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 13 17:04:28 smithi018 podman[93414]: 2024-09-13 17:04:28.799207018 +0000 UTC m=+1.826181087 container cleanup f9c0996eb133d028448c96bc1b1f9dcbabdacc7c1ddc1a9a29f56ecf13cf3f84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2) 2024-09-13T17:04:28.960 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 13 17:04:28 smithi018 bash[93414]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-a 2024-09-13T17:04:29.270 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 13 17:04:29 smithi018 podman[93437]: 2024-09-13 17:04:29.000350677 +0000 UTC m=+0.636590520 container remove f9c0996eb133d028448c96bc1b1f9dcbabdacc7c1ddc1a9a29f56ecf13cf3f84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731) 2024-09-13T17:04:29.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.a.service' 2024-09-13T17:04:29.362 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:29.362 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-13T17:04:29.363 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-13T17:04:29.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.d 2024-09-13T17:04:29.710 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 17:04:29 smithi018 systemd[1]: Stopping Ceph mds.d for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:30.209 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 17:04:29 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-d[71296]: 2024-09-13T17:04:29.758+0000 7f72c6200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:30.209 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 17:04:29 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-d[71296]: 2024-09-13T17:04:29.758+0000 7f72c6200640 -1 mds.d *** got signal Terminated *** 2024-09-13T17:04:32.847 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 17:04:32 smithi018 podman[93545]: 2024-09-13 17:04:32.546725691 +0000 UTC m=+2.912712732 container died b34164176946891f7b7d40c0dca879263e416a45e801fa79443c63297219ad24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-d, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T17:04:33.209 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 17:04:32 smithi018 podman[93545]: 2024-09-13 17:04:32.952962243 +0000 UTC m=+3.318949275 container cleanup b34164176946891f7b7d40c0dca879263e416a45e801fa79443c63297219ad24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:04:33.209 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 17:04:32 smithi018 bash[93545]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-d 2024-09-13T17:04:33.513 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 13 17:04:33 smithi018 podman[93556]: 2024-09-13 17:04:33.262583359 +0000 UTC m=+0.709485022 container remove b34164176946891f7b7d40c0dca879263e416a45e801fa79443c63297219ad24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:04:33.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.d.service' 2024-09-13T17:04:33.602 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:33.603 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-13T17:04:33.603 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-13T17:04:33.603 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.g 2024-09-13T17:04:33.959 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:04:33 smithi018 systemd[1]: Stopping Ceph mds.g for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:34.459 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:04:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g[71871]: 2024-09-13T17:04:33.992+0000 7fddf7800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:34.459 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:04:33 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g[71871]: 2024-09-13T17:04:33.992+0000 7fddf7800640 -1 mds.g *** got signal Terminated *** 2024-09-13T17:04:38.166 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:04:37 smithi018 podman[93667]: 2024-09-13 17:04:37.871512467 +0000 UTC m=+3.993385734 container died c4b7cbb788f597d07a7043d59d97a6cbddd3f853ffa1b9685462c7ccc9ff9024 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T17:04:38.459 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:04:38 smithi018 podman[93667]: 2024-09-13 17:04:38.281526939 +0000 UTC m=+4.403400206 container cleanup c4b7cbb788f597d07a7043d59d97a6cbddd3f853ffa1b9685462c7ccc9ff9024 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:04:38.460 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:04:38 smithi018 bash[93667]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g 2024-09-13T17:04:38.829 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 13 17:04:38 smithi018 podman[93679]: 2024-09-13 17:04:38.558057113 +0000 UTC m=+0.678269586 container remove c4b7cbb788f597d07a7043d59d97a6cbddd3f853ffa1b9685462c7ccc9ff9024 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T17:04:38.837 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.g.service' 2024-09-13T17:04:38.906 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:38.906 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-13T17:04:38.907 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-13T17:04:38.907 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.j 2024-09-13T17:04:39.209 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 17:04:38 smithi018 systemd[1]: Stopping Ceph mds.j for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:39.709 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 17:04:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j[70914]: 2024-09-13T17:04:39.304+0000 7f2a9ba00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:39.709 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 17:04:39 smithi018 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j[70914]: 2024-09-13T17:04:39.304+0000 7f2a9ba00640 -1 mds.j *** got signal Terminated *** 2024-09-13T17:04:41.460 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 17:04:41 smithi018 podman[93786]: 2024-09-13 17:04:41.136952489 +0000 UTC m=+1.944708586 container stop 2460fe1f9ce078373fad055c50da5f001c3a63ed56ab392df7404c8254844e9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T17:04:41.460 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 17:04:41 smithi018 podman[93786]: 2024-09-13 17:04:41.163854647 +0000 UTC m=+1.971610757 container died 2460fe1f9ce078373fad055c50da5f001c3a63ed56ab392df7404c8254844e9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T17:04:41.829 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 17:04:41 smithi018 podman[93786]: 2024-09-13 17:04:41.585200857 +0000 UTC m=+2.392956959 container cleanup 2460fe1f9ce078373fad055c50da5f001c3a63ed56ab392df7404c8254844e9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T17:04:41.829 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 17:04:41 smithi018 bash[93786]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j 2024-09-13T17:04:42.108 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 13 17:04:41 smithi018 podman[93798]: 2024-09-13 17:04:41.827825302 +0000 UTC m=+0.660624653 container remove 2460fe1f9ce078373fad055c50da5f001c3a63ed56ab392df7404c8254844e9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-j, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T17:04:42.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.j.service' 2024-09-13T17:04:42.198 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:42.199 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-13T17:04:42.199 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-13T17:04:42.199 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.b 2024-09-13T17:04:42.498 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:04:42 smithi094 systemd[1]: Stopping Ceph mds.b for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:42.911 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:04:42 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b[65662]: 2024-09-13T17:04:42.496+0000 7fa9e2e9c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:42.912 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:04:42 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b[65662]: 2024-09-13T17:04:42.496+0000 7fa9e2e9c640 -1 mds.b *** got signal Terminated *** 2024-09-13T17:04:46.162 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:04:45 smithi094 podman[70866]: 2024-09-13 17:04:45.822250723 +0000 UTC m=+3.431739102 container died 88b0f03328cb87d7ffef789263229b31e1c63356dadcc910d170fdd17956041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-13T17:04:46.457 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:04:46 smithi094 podman[70866]: 2024-09-13 17:04:46.263709194 +0000 UTC m=+3.873197563 container cleanup 88b0f03328cb87d7ffef789263229b31e1c63356dadcc910d170fdd17956041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:04:46.457 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:04:46 smithi094 bash[70866]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b 2024-09-13T17:04:46.683 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.b.service' 2024-09-13T17:04:46.707 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:04:46 smithi094 podman[70891]: 2024-09-13 17:04:46.45667479 +0000 UTC m=+0.630024104 container remove 88b0f03328cb87d7ffef789263229b31e1c63356dadcc910d170fdd17956041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:04:46.707 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:04:46 smithi094 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-13T17:04:46.708 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:04:46 smithi094 systemd[1]: Stopped Ceph mds.b for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T17:04:46.708 INFO:journalctl@ceph.mds.b.smithi094.stdout:Sep 13 17:04:46 smithi094 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.b.service: Consumed 4min 8.356s CPU time. 2024-09-13T17:04:46.720 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:46.720 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-13T17:04:46.720 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-13T17:04:46.721 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.e 2024-09-13T17:04:47.043 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 17:04:46 smithi094 systemd[1]: Stopping Ceph mds.e for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:47.411 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 17:04:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-e[65052]: 2024-09-13T17:04:47.041+0000 7f5e98fba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:47.412 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 17:04:47 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-e[65052]: 2024-09-13T17:04:47.041+0000 7f5e98fba640 -1 mds.e *** got signal Terminated *** 2024-09-13T17:04:51.335 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 17:04:51 smithi094 podman[71001]: 2024-09-13 17:04:51.054150722 +0000 UTC m=+4.104360732 container died 0d92e712d87097f07035b56c81b347b6a7abc7c168eb2477b3f959d4ff87d781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True) 2024-09-13T17:04:51.662 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 17:04:51 smithi094 podman[71001]: 2024-09-13 17:04:51.434178954 +0000 UTC m=+4.484388964 container cleanup 0d92e712d87097f07035b56c81b347b6a7abc7c168eb2477b3f959d4ff87d781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T17:04:51.662 INFO:journalctl@ceph.mds.e.smithi094.stdout:Sep 13 17:04:51 smithi094 bash[71001]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-e 2024-09-13T17:04:51.827 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.e.service' 2024-09-13T17:04:51.861 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:51.861 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-13T17:04:51.861 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-13T17:04:51.861 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.h 2024-09-13T17:04:52.412 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 17:04:51 smithi094 systemd[1]: Stopping Ceph mds.h for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:52.412 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 17:04:52 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h[65358]: 2024-09-13T17:04:52.187+0000 7f237f244640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:52.412 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 17:04:52 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h[65358]: 2024-09-13T17:04:52.187+0000 7f237f244640 -1 mds.h *** got signal Terminated *** 2024-09-13T17:04:54.115 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 17:04:53 smithi094 podman[71117]: 2024-09-13 17:04:53.824892604 +0000 UTC m=+1.740064739 container died 9f7bd9e97b5b03bf7be7555dd007a421c8774beb854bd27f3580488df11cfd0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:04:54.412 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 17:04:54 smithi094 podman[71117]: 2024-09-13 17:04:54.213035219 +0000 UTC m=+2.128207345 container cleanup 9f7bd9e97b5b03bf7be7555dd007a421c8774beb854bd27f3580488df11cfd0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T17:04:54.412 INFO:journalctl@ceph.mds.h.smithi094.stdout:Sep 13 17:04:54 smithi094 bash[71117]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-h 2024-09-13T17:04:54.595 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.h.service' 2024-09-13T17:04:54.627 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:54.627 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-13T17:04:54.627 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-13T17:04:54.627 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.k 2024-09-13T17:04:54.911 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 17:04:54 smithi094 systemd[1]: Stopping Ceph mds.k for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:55.412 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 17:04:54 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-k[64731]: 2024-09-13T17:04:54.916+0000 7f4c7d818640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:55.412 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 17:04:54 smithi094 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-k[64731]: 2024-09-13T17:04:54.916+0000 7f4c7d818640 -1 mds.k *** got signal Terminated *** 2024-09-13T17:04:58.076 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 17:04:57 smithi094 podman[71238]: 2024-09-13 17:04:57.745133034 +0000 UTC m=+2.910343433 container died 8b97e1e7e352b572c19b6715bb67340a868fa73ad976331e964bbf4a19974421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:04:58.077 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 17:04:58 smithi094 podman[71238]: 2024-09-13 17:04:58.075306466 +0000 UTC m=+3.240516864 container cleanup 8b97e1e7e352b572c19b6715bb67340a868fa73ad976331e964bbf4a19974421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T17:04:58.411 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 17:04:58 smithi094 bash[71238]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-k 2024-09-13T17:04:58.412 INFO:journalctl@ceph.mds.k.smithi094.stdout:Sep 13 17:04:58 smithi094 podman[71250]: 2024-09-13 17:04:58.276514138 +0000 UTC m=+0.527239645 container remove 8b97e1e7e352b572c19b6715bb67340a868fa73ad976331e964bbf4a19974421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T17:04:58.499 DEBUG:teuthology.orchestra.run.smithi094:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.k.service' 2024-09-13T17:04:58.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:04:58.531 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-13T17:04:58.531 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-13T17:04:58.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.c 2024-09-13T17:04:58.888 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:04:58 smithi144 systemd[1]: Stopping Ceph mds.c for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:04:59.138 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:04:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c[65686]: 2024-09-13T17:04:58.885+0000 7faa0712a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:59.138 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:04:58 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c[65686]: 2024-09-13T17:04:58.885+0000 7faa0712a640 -1 mds.c *** got signal Terminated *** 2024-09-13T17:05:02.096 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:05:01 smithi144 podman[72250]: 2024-09-13 17:05:01.832411296 +0000 UTC m=+3.105969974 container died b9736da3e20f2f0c5777d1e88b5ab43d8be84c3d228080927c977a74e9d079ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T17:05:02.354 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:05:02 smithi144 podman[72250]: 2024-09-13 17:05:02.17763677 +0000 UTC m=+3.451195448 container cleanup b9736da3e20f2f0c5777d1e88b5ab43d8be84c3d228080927c977a74e9d079ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2) 2024-09-13T17:05:02.354 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:05:02 smithi144 bash[72250]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c 2024-09-13T17:05:02.612 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 13 17:05:02 smithi144 podman[72273]: 2024-09-13 17:05:02.353669258 +0000 UTC m=+0.518446862 container remove b9736da3e20f2f0c5777d1e88b5ab43d8be84c3d228080927c977a74e9d079ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:05:02.617 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.c.service' 2024-09-13T17:05:02.652 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:05:02.652 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-13T17:05:02.652 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-13T17:05:02.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.f 2024-09-13T17:05:02.983 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 17:05:02 smithi144 systemd[1]: Stopping Ceph mds.f for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:05:03.271 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 17:05:02 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f[65383]: 2024-09-13T17:05:02.980+0000 7f7f34a1d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:05:03.271 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 17:05:02 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f[65383]: 2024-09-13T17:05:02.980+0000 7f7f34a1d640 -1 mds.f *** got signal Terminated *** 2024-09-13T17:05:06.117 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 17:05:05 smithi144 podman[72383]: 2024-09-13 17:05:05.833771404 +0000 UTC m=+2.960021643 container died 41e9cd222da81b6fcfe8fe6aaa9451de540b2f6a4941fc1cdad01ca5cd8c2f04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:05:06.458 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 17:05:06 smithi144 podman[72383]: 2024-09-13 17:05:06.206179 +0000 UTC m=+3.332429250 container cleanup 41e9cd222da81b6fcfe8fe6aaa9451de540b2f6a4941fc1cdad01ca5cd8c2f04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:05:06.458 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 13 17:05:06 smithi144 bash[72383]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-f 2024-09-13T17:05:06.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.f.service' 2024-09-13T17:05:06.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:05:06.619 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-13T17:05:06.619 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-13T17:05:06.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.i 2024-09-13T17:05:06.771 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:05:06 smithi144 systemd[1]: Stopping Ceph mds.i for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:05:07.271 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:05:06 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i[65987]: 2024-09-13T17:05:06.958+0000 7fe3b2db4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:05:07.272 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:05:06 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i[65987]: 2024-09-13T17:05:06.958+0000 7fe3b2db4640 -1 mds.i *** got signal Terminated *** 2024-09-13T17:05:10.022 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:05:09 smithi144 podman[72506]: 2024-09-13 17:05:09.817319217 +0000 UTC m=+2.982509335 container died 8d178548df97b6a083cd970532d2b13404df4fb2c1a50e2477946b5618d5f395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T17:05:10.444 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:05:10 smithi144 podman[72506]: 2024-09-13 17:05:10.251266257 +0000 UTC m=+3.416456372 container cleanup 8d178548df97b6a083cd970532d2b13404df4fb2c1a50e2477946b5618d5f395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T17:05:10.445 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:05:10 smithi144 bash[72506]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i 2024-09-13T17:05:10.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.i.service' 2024-09-13T17:05:10.708 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:05:10 smithi144 podman[72519]: 2024-09-13 17:05:10.444086905 +0000 UTC m=+0.618083277 container remove 8d178548df97b6a083cd970532d2b13404df4fb2c1a50e2477946b5618d5f395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T17:05:10.708 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:05:10 smithi144 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-13T17:05:10.708 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:05:10 smithi144 systemd[1]: Stopped Ceph mds.i for d8ff35a0-71ee-11ef-bceb-c7b262605968. 2024-09-13T17:05:10.709 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 13 17:05:10 smithi144 systemd[1]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.i.service: Consumed 21.711s CPU time. 2024-09-13T17:05:10.720 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:05:10.720 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-13T17:05:10.720 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-13T17:05:10.720 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.l 2024-09-13T17:05:11.021 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 17:05:10 smithi144 systemd[1]: Stopping Ceph mds.l for d8ff35a0-71ee-11ef-bceb-c7b262605968... 2024-09-13T17:05:11.521 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 17:05:11 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-l[65079]: 2024-09-13T17:05:11.046+0000 7f5b6f705640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:05:11.522 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 17:05:11 smithi144 ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-l[65079]: 2024-09-13T17:05:11.047+0000 7f5b6f705640 -1 mds.l *** got signal Terminated *** 2024-09-13T17:05:15.521 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 17:05:15 smithi144 podman[72628]: 2024-09-13 17:05:15.062733304 +0000 UTC m=+4.126218427 container died 9c1475af95463a135afefb19e076e8cb0cdf77a181219578dd961ebd7271a2b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:05:15.915 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 17:05:15 smithi144 podman[72628]: 2024-09-13 17:05:15.613521209 +0000 UTC m=+4.677006337 container cleanup 9c1475af95463a135afefb19e076e8cb0cdf77a181219578dd961ebd7271a2b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T17:05:15.915 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 13 17:05:15 smithi144 bash[72628]: ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968-mds-l 2024-09-13T17:05:16.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d8ff35a0-71ee-11ef-bceb-c7b262605968@mds.l.service' 2024-09-13T17:05:16.061 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:05:16.062 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-13T17:05:16.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T17:05:16.289 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T17:05:20.069 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T17:05:20.228 INFO:teuthology.orchestra.run.smithi094.stdout:Deleting cluster with fsid: d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T17:05:22.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T17:05:22.738 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T17:05:24.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:25.059 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:25.091 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:25.119 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T17:05:25.120 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829/remote/smithi018/crash 2024-09-13T17:05:25.121 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/crash -- . 2024-09-13T17:05:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:tar: /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T17:05:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:tar: Error is not recoverable: exiting now 2024-09-13T17:05:25.181 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829/remote/smithi094/crash 2024-09-13T17:05:25.182 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/crash -- . 2024-09-13T17:05:25.223 INFO:teuthology.orchestra.run.smithi094.stderr:tar: /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T17:05:25.223 INFO:teuthology.orchestra.run.smithi094.stderr:tar: Error is not recoverable: exiting now 2024-09-13T17:05:25.225 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829/remote/smithi144/crash 2024-09-13T17:05:25.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/crash -- . 2024-09-13T17:05:25.265 INFO:teuthology.orchestra.run.smithi144.stderr:tar: /var/lib/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T17:05:25.265 INFO:teuthology.orchestra.run.smithi144.stderr:tar: Error is not recoverable: exiting now 2024-09-13T17:05:25.266 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T17:05:25.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T17:05:25.328 INFO:teuthology.orchestra.run.smithi018.stderr:grep: /var/log/ceph/d8ff35a0-71ee-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-13T17:05:25.347 INFO:tasks.cephadm:Compressing logs... 2024-09-13T17:05:25.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:05:25.352 DEBUG:teuthology.orchestra.run.smithi094:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:05:25.354 DEBUG:teuthology.orchestra.run.smithi144:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:05:25.378 INFO:teuthology.orchestra.run.smithi144.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T17:05:25.390 INFO:teuthology.orchestra.run.smithi094.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T17:05:25.412 INFO:teuthology.orchestra.run.smithi018.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T17:10:35.575 INFO:tasks.cephadm:Archiving logs... 2024-09-13T17:10:35.576 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829/remote/smithi018/log 2024-09-13T17:10:35.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:11:08.692 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829/remote/smithi094/log 2024-09-13T17:11:08.693 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:11:45.993 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829/remote/smithi144/log 2024-09-13T17:11:45.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:12:04.983 INFO:tasks.cephadm:Removing cluster... 2024-09-13T17:12:04.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 --force 2024-09-13T17:12:05.209 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T17:12:06.476 DEBUG:teuthology.orchestra.run.smithi094:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 --force 2024-09-13T17:12:06.629 INFO:teuthology.orchestra.run.smithi094.stdout:Deleting cluster with fsid: d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T17:12:07.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d8ff35a0-71ee-11ef-bceb-c7b262605968 --force 2024-09-13T17:12:07.339 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: d8ff35a0-71ee-11ef-bceb-c7b262605968 2024-09-13T17:12:07.754 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T17:12:07.755 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T17:12:07.795 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T17:12:07.819 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T17:12:07.847 INFO:tasks.cephadm:Teardown complete 2024-09-13T17:12:07.848 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T17:12:07.952 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T17:12:07.952 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:12:07.959 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:12:07.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:12:08.127 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T17:12:08.239 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T17:12:08.239 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:12:08.244 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:12:08.247 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:12:08.259 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:12:08.261 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:12:08.266 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:12:08.266 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-13T17:12:08.266 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 -45us[ -32us] +/- 42ms 2024-09-13T17:12:08.266 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 +673us[ +673us] +/- 59ms 2024-09-13T17:12:08.266 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -690us[ -690us] +/- 73ms 2024-09-13T17:12:08.266 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:12:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-09-13T17:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 -69us[ -72us] +/- 42ms 2024-09-13T17:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 +647us[ +647us] +/- 59ms 2024-09-13T17:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -714us[ -714us] +/- 73ms 2024-09-13T17:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:12:08.283 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:12:08.284 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-13T17:12:08.284 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 -63us[ -70us] +/- 42ms 2024-09-13T17:12:08.284 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 +662us[ +654us] +/- 59ms 2024-09-13T17:12:08.284 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -710us[ -718us] +/- 73ms 2024-09-13T17:12:08.284 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:12:08.285 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T17:12:08.295 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T17:12:08.295 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T17:12:08.348 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T17:12:08.498 DEBUG:teuthology.orchestra.run.smithi094:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T17:12:08.604 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T17:12:08.674 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:12:08.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:12:08.735 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:12:08.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:12:08.764 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:12:08.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:12:08.794 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T17:12:08.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T17:12:08.858 INFO:teuthology.task.internal:Duration was 2302.296294 seconds 2024-09-13T17:12:08.858 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T17:12:08.929 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T17:12:08.929 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:12:08.933 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:12:08.936 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:12:08.975 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:12:09.021 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:12:09.067 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:12:09.566 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T17:12:09.566 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T17:12:09.567 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:12:09.617 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T17:12:09.617 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:12:09.643 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T17:12:09.643 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:12:09.676 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T17:12:09.676 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:12:09.680 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:12:09.685 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:12:09.745 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T17:12:09.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:12:09.749 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:12:09.753 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:12:10.254 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T17:12:10.266 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T17:12:10.267 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:12:10.328 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:12:10.365 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:12:10.391 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T17:12:10.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:12:10.407 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:12:10.409 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:12:10.445 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-09-13T17:12:10.456 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-09-13T17:12:10.490 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-13T17:12:10.520 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:12:10.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:12:10.554 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:12:10.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:12:10.569 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:12:10.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:12:10.585 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T17:12:10.596 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T17:12:10.597 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829/remote/smithi018 2024-09-13T17:12:10.597 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:12:10.670 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829/remote/smithi094 2024-09-13T17:12:10.671 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:12:10.708 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903829/remote/smithi144 2024-09-13T17:12:10.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:12:10.746 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T17:12:10.746 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:12:10.750 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:12:10.753 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:12:10.798 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T17:12:10.814 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T17:12:10.814 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T17:12:10.854 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T17:12:10.854 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:12:10.858 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:12:10.860 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:12:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:12 /home/ubuntu/cephtest 2024-09-13T17:12:10.875 INFO:teuthology.orchestra.run.smithi144.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:12 /home/ubuntu/cephtest 2024-09-13T17:12:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: 393253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:12 /home/ubuntu/cephtest 2024-09-13T17:12:10.891 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T17:12:10.901 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T17:12:11.004 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} duration: 2302.29629445076 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T17:12:11.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:12:11.098 INFO:teuthology.run:pass